Nov 22 14:12:00 user nova-compute[74776]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74776) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 22 14:12:00 user nova-compute[74776]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74776) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 22 14:12:00 user nova-compute[74776]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74776) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 22 14:12:00 user nova-compute[74776]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 22 14:12:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:12:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:12:00 user nova-compute[74776]: INFO nova.virt.driver [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 22 14:12:00 user nova-compute[74776]: INFO nova.compute.provider_config [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 22 14:12:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] Acquiring lock "singleton_lock" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:12:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] Acquired lock "singleton_lock" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:12:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] Releasing lock "singleton_lock" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:12:00 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] Full set of CONF: {{(pid=74776) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 22 14:12:00 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ******************************************************************************** {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] Configuration options gathered from: {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ================================================================================ {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] allow_resize_to_same_host      = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] arq_binding_timeout            = 300 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] backdoor_port                  = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] backdoor_socket                = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] block_device_allocate_retries  = 300 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] block_device_allocate_retries_interval = 5 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cert                           = self.pem {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] compute_monitors               = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] config_dir                     = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] config_drive_format            = iso9660 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] config_source                  = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] console_host                   = user {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] control_exchange               = nova {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cpu_allocation_ratio           = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] daemon                         = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] debug                          = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] default_access_ip_network_name = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] default_availability_zone      = nova {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] default_ephemeral_format       = ext4 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] default_green_pool_size        = 1000 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] default_schedule_zone          = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] disk_allocation_ratio          = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] enable_new_services            = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] enabled_ssl_apis               = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] flat_injected                  = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] force_config_drive             = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] force_raw_images               = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] graceful_shutdown_timeout      = 5 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] heal_instance_info_cache_interval = 60 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] host                           = user {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] instance_build_timeout         = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] instance_delete_interval       = 300 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] instance_name_template         = instance-%08x {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] instance_usage_audit           = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] instance_usage_audit_period    = month {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] internal_service_availability_zone = internal {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] key                            = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] live_migration_retry_count     = 30 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] log_config_append              = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] log_dir                        = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] log_file                       = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] log_options                    = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] log_rotate_interval            = 1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] log_rotate_interval_type       = days {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] log_rotation_type              = none {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] long_rpc_timeout               = 1800 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] max_concurrent_builds          = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] max_concurrent_live_migrations = 1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] max_concurrent_snapshots       = 5 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] max_local_block_devices        = 3 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] max_logfile_count              = 30 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] max_logfile_size_mb            = 200 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] maximum_instance_delete_attempts = 5 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] metadata_listen                = 0.0.0.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] metadata_listen_port           = 8775 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] metadata_workers               = 3 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] migrate_max_retries            = -1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] mkisofs_cmd                    = genisoimage {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] my_ip                          = 10.0.0.210 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] network_allocate_retries       = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] osapi_compute_listen_port      = 8774 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] osapi_compute_unique_server_name_scope =  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] osapi_compute_workers          = 3 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] password_length                = 12 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] periodic_enable                = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] periodic_fuzzy_delay           = 60 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] pointer_model                  = ps2mouse {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] preallocate_images             = none {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] publish_errors                 = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] pybasedir                      = /opt/stack/nova {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ram_allocation_ratio           = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] rate_limit_burst               = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] rate_limit_except_level        = CRITICAL {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] rate_limit_interval            = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] reboot_timeout                 = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] reclaim_instance_interval      = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] record                         = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] reimage_timeout_per_gb         = 60 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] report_interval                = 120 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] rescue_timeout                 = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] reserved_host_cpus             = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] reserved_host_disk_mb          = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] reserved_host_memory_mb        = 512 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] reserved_huge_pages            = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] resize_confirm_window          = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] resize_fs_using_block_device   = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] resume_guests_state_on_host_boot = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] rpc_response_timeout           = 60 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] run_external_periodic_tasks    = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] running_deleted_instance_action = reap {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] running_deleted_instance_timeout = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] scheduler_instance_sync_interval = 120 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] service_down_time              = 720 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] servicegroup_driver            = db {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] shelved_offload_time           = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] shelved_poll_interval          = 3600 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] shutdown_timeout               = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] source_is_ipv6                 = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ssl_only                       = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] state_path                     = /opt/stack/data/nova {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] sync_power_state_interval      = 600 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] sync_power_state_pool_size     = 1000 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] syslog_log_facility            = LOG_USER {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] tempdir                        = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] timeout_nbd                    = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] transport_url                  = **** {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] update_resources_interval      = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] use_cow_images                 = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] use_eventlog                   = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] use_journal                    = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] use_json                       = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] use_rootwrap_daemon            = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] use_stderr                     = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] use_syslog                     = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vcpu_pin_set                   = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vif_plugging_is_fatal          = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vif_plugging_timeout           = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] virt_mkfs                      = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] volume_usage_poll_interval     = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] watch_log_file                 = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] web                            = /usr/share/spice-html5 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_concurrency.disable_process_locking = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.auth_strategy              = keystone {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.compute_link_prefix        = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.dhcp_domain                = novalocal {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.enable_instance_password   = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.glance_link_prefix         = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.instance_list_per_project_cells = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.list_records_by_skipping_down_cells = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.local_metadata_per_cell    = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.max_limit                  = 1000 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.metadata_cache_expiration  = 15 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.neutron_default_tenant_id  = default {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.use_forwarded_for          = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.use_neutron_default_nets   = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.vendordata_dynamic_targets = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.vendordata_jsonfile_path   = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.backend_argument         = **** {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.config_prefix            = cache.oslo {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.dead_timeout             = 60.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.debug_cache_backend      = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.enable_retry_client      = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.enable_socket_keepalive  = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.enabled                  = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.expiration_time          = 600 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.hashclient_retry_attempts = 2 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.memcache_dead_retry      = 300 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.memcache_password        =  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.memcache_sasl_enabled    = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.memcache_username        =  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.proxies                  = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.retry_attempts           = 2 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.retry_delay              = 0.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.socket_keepalive_count   = 1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.socket_keepalive_idle    = 1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.socket_keepalive_interval = 1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.tls_allowed_ciphers      = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.tls_cafile               = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.tls_certfile             = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.tls_enabled              = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cache.tls_keyfile              = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cinder.auth_section            = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cinder.auth_type               = password {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cinder.cafile                  = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cinder.certfile                = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cinder.collect_timing          = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cinder.cross_az_attach         = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cinder.debug                   = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cinder.endpoint_template       = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cinder.http_retries            = 3 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cinder.insecure                = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cinder.keyfile                 = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cinder.os_region_name          = RegionOne {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cinder.split_loggers           = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cinder.timeout                 = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] compute.cpu_dedicated_set      = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] compute.cpu_shared_set         = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] compute.image_type_exclude_list = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] compute.resource_provider_association_refresh = 300 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] compute.shutdown_retry_interval = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] conductor.workers              = 3 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] console.allowed_origins        = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] console.ssl_ciphers            = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] console.ssl_minimum_version    = default {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] consoleauth.token_ttl          = 600 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cyborg.cafile                  = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cyborg.certfile                = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cyborg.collect_timing          = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cyborg.connect_retries         = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cyborg.connect_retry_delay     = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cyborg.endpoint_override       = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cyborg.insecure                = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cyborg.keyfile                 = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cyborg.max_version             = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cyborg.min_version             = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cyborg.region_name             = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cyborg.service_name            = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cyborg.service_type            = accelerator {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cyborg.split_loggers           = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cyborg.status_code_retries     = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cyborg.status_code_retry_delay = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cyborg.timeout                 = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] cyborg.version                 = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] database.backend               = sqlalchemy {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] database.connection            = **** {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] database.connection_debug      = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] database.connection_parameters =  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] database.connection_recycle_time = 3600 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] database.connection_trace      = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] database.db_inc_retry_interval = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] database.db_max_retries        = 20 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] database.db_max_retry_interval = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] database.db_retry_interval     = 1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] database.max_overflow          = 50 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] database.max_pool_size         = 5 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] database.max_retries           = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] database.mysql_wsrep_sync_wait = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] database.pool_timeout          = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] database.retry_interval        = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] database.slave_connection      = **** {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] database.sqlite_synchronous    = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api_database.backend           = sqlalchemy {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api_database.connection        = **** {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api_database.connection_debug  = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api_database.connection_parameters =  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api_database.connection_recycle_time = 3600 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api_database.connection_trace  = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api_database.db_inc_retry_interval = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api_database.db_max_retries    = 20 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api_database.db_max_retry_interval = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api_database.db_retry_interval = 1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api_database.max_overflow      = 50 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api_database.max_pool_size     = 5 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api_database.max_retries       = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api_database.pool_timeout      = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api_database.retry_interval    = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api_database.slave_connection  = **** {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] api_database.sqlite_synchronous = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] devices.enabled_mdev_types     = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ephemeral_storage_encryption.enabled = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.api_servers             = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.cafile                  = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.certfile                = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.collect_timing          = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.connect_retries         = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.connect_retry_delay     = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.debug                   = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.default_trusted_certificate_ids = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.enable_certificate_validation = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.enable_rbd_download     = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.endpoint_override       = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.insecure                = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.keyfile                 = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.max_version             = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.min_version             = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.num_retries             = 3 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.rbd_ceph_conf           =  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.rbd_connect_timeout     = 5 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.rbd_pool                =  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.rbd_user                =  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.region_name             = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.service_name            = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.service_type            = image {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.split_loggers           = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.status_code_retries     = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.status_code_retry_delay = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.timeout                 = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.verify_glance_signatures = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] glance.version                 = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] guestfs.debug                  = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] hyperv.config_drive_cdrom      = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] hyperv.config_drive_inject_password = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] hyperv.enable_remotefx         = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] hyperv.instances_path_share    =  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] hyperv.limit_cpu_features      = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] hyperv.use_multipath_io        = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] hyperv.vswitch_name            = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] mks.enabled                    = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] image_cache.manager_interval   = 2400 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] image_cache.precache_concurrency = 1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] image_cache.remove_unused_base_images = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] image_cache.subdirectory_name  = _base {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.api_max_retries         = 60 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.api_retry_interval      = 2 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.auth_section            = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.auth_type               = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.cafile                  = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.certfile                = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.collect_timing          = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.conductor_group         = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.connect_retries         = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.connect_retry_delay     = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.endpoint_override       = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.insecure                = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.keyfile                 = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.max_version             = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.min_version             = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.peer_list               = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.region_name             = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.serial_console_state_timeout = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.service_name            = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.service_type            = baremetal {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.split_loggers           = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.status_code_retries     = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.status_code_retry_delay = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.timeout                 = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ironic.version                 = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] key_manager.fixed_key          = **** {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican.barbican_api_version  = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican.barbican_endpoint     = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican.barbican_endpoint_type = public {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican.barbican_region_name  = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican.cafile                = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican.certfile              = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican.collect_timing        = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican.insecure              = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican.keyfile               = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican.number_of_retries     = 60 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican.retry_delay           = 1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican.send_service_user_token = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican.split_loggers         = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican.timeout               = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican.verify_ssl            = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican.verify_ssl_path       = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican_service_user.auth_section = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican_service_user.auth_type = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican_service_user.cafile   = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican_service_user.certfile = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican_service_user.collect_timing = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican_service_user.insecure = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican_service_user.keyfile  = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican_service_user.split_loggers = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] barbican_service_user.timeout  = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vault.approle_role_id          = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vault.approle_secret_id        = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vault.cafile                   = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vault.certfile                 = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vault.collect_timing           = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vault.insecure                 = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vault.keyfile                  = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vault.kv_mountpoint            = secret {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vault.kv_path                  = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vault.kv_version               = 2 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vault.namespace                = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vault.root_token_id            = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vault.split_loggers            = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vault.ssl_ca_crt_file          = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vault.timeout                  = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vault.use_ssl                  = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] keystone.auth_section          = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] keystone.auth_type             = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] keystone.cafile                = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] keystone.certfile              = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] keystone.collect_timing        = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] keystone.connect_retries       = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] keystone.connect_retry_delay   = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] keystone.endpoint_override     = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] keystone.insecure              = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] keystone.keyfile               = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] keystone.max_version           = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] keystone.min_version           = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] keystone.region_name           = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] keystone.service_name          = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] keystone.service_type          = identity {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] keystone.split_loggers         = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] keystone.status_code_retries   = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] keystone.status_code_retry_delay = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] keystone.timeout               = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] keystone.version               = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.connection_uri         =  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.cpu_mode               = custom {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: WARNING oslo_config.cfg [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.cpu_power_governor_high = performance {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.cpu_power_management   = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.device_detach_attempts = 8 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.device_detach_timeout  = 20 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.disk_cachemodes        = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.disk_prefix            = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.enabled_perf_events    = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.file_backed_memory     = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.gid_maps               = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.hw_disk_discard        = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.hw_machine_type        = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.images_rbd_pool        = rbd {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.images_type            = default {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.images_volume_group    = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.inject_key             = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.inject_partition       = -2 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.inject_password        = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.iscsi_iface            = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.iser_use_multipath     = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.live_migration_downtime = 500 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.live_migration_inbound_addr = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.live_migration_scheme  = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.live_migration_timeout_action = abort {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.live_migration_tunnelled = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: WARNING oslo_config.cfg [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 22 14:12:01 user nova-compute[74776]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 22 14:12:01 user nova-compute[74776]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 22 14:12:01 user nova-compute[74776]: and ``live_migration_inbound_addr`` respectively.
Nov 22 14:12:01 user nova-compute[74776]: ).  Its value may be silently ignored in the future.
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.live_migration_with_native_tls = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.max_queues             = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.nfs_mount_options      = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.num_pcie_ports         = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.pmem_namespaces        = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.quobyte_client_cfg     = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.rbd_secret_uuid        = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.rbd_user               = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.rescue_image_id        = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.rescue_kernel_id       = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.rx_queue_size          = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.smbfs_mount_options    =  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.snapshot_compression   = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.snapshot_image_format  = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.sparse_logical_volumes = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.swtpm_enabled          = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.swtpm_group            = tss {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.swtpm_user             = tss {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.sysinfo_serial         = unique {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.tb_cache_size          = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.tx_queue_size          = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.uid_maps               = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.use_virtio_for_bridges = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.virt_type              = kvm {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.volume_clear           = zero {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.volume_clear_size      = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.volume_use_multipath   = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.vzstorage_cache_path   = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.auth_section           = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.auth_type              = password {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.cafile                 = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.certfile               = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.collect_timing         = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.connect_retries        = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.connect_retry_delay    = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.default_floating_pool  = public {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.endpoint_override      = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.extension_sync_interval = 600 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.http_retries           = 3 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.insecure               = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.keyfile                = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.max_version            = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.min_version            = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.ovs_bridge             = br-int {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.physnets               = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.region_name            = RegionOne {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.service_metadata_proxy = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.service_name           = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.service_type           = network {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.split_loggers          = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.status_code_retries    = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.status_code_retry_delay = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.timeout                = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] neutron.version                = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] notifications.bdms_in_notifications = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] notifications.default_level    = INFO {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] notifications.notification_format = unversioned {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] notifications.notify_on_state_change = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] pci.alias                      = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] pci.device_spec                = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] pci.report_in_placement        = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.auth_section         = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.auth_type            = password {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.cafile               = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.certfile             = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.collect_timing       = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.connect_retries      = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.connect_retry_delay  = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.default_domain_id    = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.default_domain_name  = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.domain_id            = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.domain_name          = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.endpoint_override    = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.insecure             = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.keyfile              = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.max_version          = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.min_version          = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.password             = **** {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.project_domain_id    = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.project_domain_name  = Default {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.project_id           = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.project_name         = service {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.region_name          = RegionOne {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.service_name         = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.service_type         = placement {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.split_loggers        = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.status_code_retries  = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.status_code_retry_delay = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.system_scope         = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.timeout              = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.trust_id             = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.user_domain_id       = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.user_domain_name     = Default {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.user_id              = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.username             = placement {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] placement.version              = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] quota.cores                    = 20 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] quota.count_usage_from_placement = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] quota.injected_file_content_bytes = 10240 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] quota.injected_file_path_length = 255 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] quota.injected_files           = 5 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] quota.instances                = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] quota.key_pairs                = 100 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] quota.metadata_items           = 128 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] quota.ram                      = 51200 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] quota.recheck_quota            = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] quota.server_group_members     = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] quota.server_groups            = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] rdp.enabled                    = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] scheduler.image_metadata_prefilter = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] scheduler.max_attempts         = 3 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] scheduler.max_placement_results = 1000 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] scheduler.workers              = 3 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.host_subset_size = 1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.isolated_hosts = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.isolated_images = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.pci_in_placement = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.track_instance_changes = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] metrics.required               = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] metrics.weight_multiplier      = 1.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] metrics.weight_setting         = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] serial_console.enabled         = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] serial_console.port_range      = 10000:20000 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] serial_console.serialproxy_port = 6083 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] service_user.auth_section      = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] service_user.auth_type         = password {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] service_user.cafile            = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] service_user.certfile          = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] service_user.collect_timing    = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] service_user.insecure          = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] service_user.keyfile           = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] service_user.send_service_user_token = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] service_user.split_loggers     = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] service_user.timeout           = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] spice.agent_enabled            = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] spice.enabled                  = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] spice.html5proxy_port          = 6082 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] spice.image_compression        = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] spice.jpeg_compression         = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] spice.playback_compression     = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] spice.server_listen            = 127.0.0.1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] spice.streaming_mode           = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] spice.zlib_compression         = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] upgrade_levels.baseapi         = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] upgrade_levels.compute         = auto {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] upgrade_levels.conductor       = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] upgrade_levels.scheduler       = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vendordata_dynamic_auth.cafile = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vendordata_dynamic_auth.certfile = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vendordata_dynamic_auth.insecure = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vendordata_dynamic_auth.timeout = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.api_retry_count         = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.ca_file                 = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.cache_prefix            = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.cluster_name            = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.connection_pool_size    = 10 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.console_delay_seconds   = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.datastore_regex         = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.host_ip                 = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.host_password           = **** {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.host_port               = 443 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.host_username           = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.insecure                = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.integration_bridge      = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.maximum_objects         = 100 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.pbm_default_policy      = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.pbm_enabled             = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.pbm_wsdl_location       = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.serial_port_proxy_uri   = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.serial_port_service_uri = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.task_poll_interval      = 0.5 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.use_linked_clone        = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.vnc_keymap              = en-us {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.vnc_port                = 5900 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vmware.vnc_port_total          = 10000 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vnc.auth_schemes               = ['none'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vnc.enabled                    = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vnc.novncproxy_port            = 6080 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vnc.vencrypt_ca_certs          = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vnc.vencrypt_client_cert       = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vnc.vencrypt_client_key        = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] workarounds.disable_rootwrap   = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] workarounds.enable_numa_live_migration = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] workarounds.libvirt_disable_apic = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] wsgi.client_socket_timeout     = 900 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] wsgi.default_pool_size         = 1000 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] wsgi.keep_alive                = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] wsgi.max_header_line           = 16384 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] wsgi.ssl_ca_file               = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] wsgi.ssl_cert_file             = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] wsgi.ssl_key_file              = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] wsgi.tcp_keepidle              = 600 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] zvm.ca_file                    = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] zvm.cloud_connector_url        = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] zvm.reachable_timeout          = 300 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_policy.enforce_new_defaults = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_policy.enforce_scope      = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_policy.policy_default_rule = default {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] profiler.connection_string     = messaging:// {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] profiler.enabled               = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] profiler.es_doc_type           = notification {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] profiler.es_scroll_size        = 10000 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] profiler.es_scroll_time        = 2m {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] profiler.filter_error_trace    = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] profiler.hmac_keys             = **** {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] profiler.sentinel_service_name = mymaster {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] profiler.socket_timeout        = 0.1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] profiler.trace_requests        = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] profiler.trace_sqlalchemy      = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] profiler_jaeger.process_tags   = {} {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] profiler_jaeger.service_name_prefix = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] profiler_otlp.service_name_prefix = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] remote_debug.host              = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] remote_debug.port              = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_notifications.retry = -1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.auth_section        = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.auth_type           = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.cafile              = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.certfile            = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.collect_timing      = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.connect_retries     = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.connect_retry_delay = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.endpoint_id         = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.endpoint_override   = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.insecure            = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.keyfile             = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.max_version         = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.min_version         = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.region_name         = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.service_name        = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.service_type        = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.split_loggers       = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.status_code_retries = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.status_code_retry_delay = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.timeout             = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.valid_interfaces    = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_limit.version             = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_reports.file_event_handler = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] oslo_reports.log_dir           = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vif_plug_ovs_privileged.group  = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] vif_plug_ovs_privileged.user   = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] os_vif_ovs.isolate_vif         = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] os_brick.lock_path             = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] privsep_osbrick.capabilities   = [21] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] privsep_osbrick.group          = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] privsep_osbrick.helper_command = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] privsep_osbrick.user           = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] nova_sys_admin.group           = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] nova_sys_admin.helper_command  = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] nova_sys_admin.user            = None {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG oslo_service.service [None req-373bbd36-7a25-466d-9cf5-29eca60c2822 None None] ******************************************************************************** {{(pid=74776) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 22 14:12:01 user nova-compute[74776]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 22 14:12:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Connecting to libvirt: qemu:///system {{(pid=74776) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f1c7beea350> {{(pid=74776) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 22 14:12:01 user nova-compute[74776]: libvirt:  error : internal error: could not initialize domain event timer
Nov 22 14:12:01 user nova-compute[74776]: WARNING nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 22 14:12:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f1c7beea350> {{(pid=74776) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Starting native event thread {{(pid=74776) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Starting green dispatch thread {{(pid=74776) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 22 14:12:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Starting connection event dispatch thread {{(pid=74776) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 22 14:12:01 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Connection event '1' reason 'None'
Nov 22 14:12:01 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 22 14:12:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.mount [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Initialising _HostMountState generation 0 {{(pid=74776) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 22 14:12:08 user nova-compute[74776]: INFO nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Libvirt host capabilities <capabilities>
Nov 22 14:12:08 user nova-compute[74776]:   <host>
Nov 22 14:12:08 user nova-compute[74776]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 22 14:12:08 user nova-compute[74776]:     <cpu>
Nov 22 14:12:08 user nova-compute[74776]:       <arch>x86_64</arch>
Nov 22 14:12:08 user nova-compute[74776]:       <model>IvyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <vendor>Intel</vendor>
Nov 22 14:12:08 user nova-compute[74776]:       <microcode version='1070'/>
Nov 22 14:12:08 user nova-compute[74776]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 22 14:12:08 user nova-compute[74776]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature name='ss'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature name='vmx'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature name='pcid'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature name='osxsave'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature name='hypervisor'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature name='arat'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature name='tsc_adjust'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature name='md-clear'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature name='stibp'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature name='arch-capabilities'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature name='ssbd'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature name='invtsc'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature name='rsba'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature name='skip-l1dfl-vmentry'/>
Nov 22 14:12:08 user nova-compute[74776]:       <pages unit='KiB' size='4'/>
Nov 22 14:12:08 user nova-compute[74776]:       <pages unit='KiB' size='2048'/>
Nov 22 14:12:08 user nova-compute[74776]:     </cpu>
Nov 22 14:12:08 user nova-compute[74776]:     <power_management>
Nov 22 14:12:08 user nova-compute[74776]:       <suspend_mem/>
Nov 22 14:12:08 user nova-compute[74776]:       <suspend_disk/>
Nov 22 14:12:08 user nova-compute[74776]:       <suspend_hybrid/>
Nov 22 14:12:08 user nova-compute[74776]:     </power_management>
Nov 22 14:12:08 user nova-compute[74776]:     <iommu support='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     <migration_features>
Nov 22 14:12:08 user nova-compute[74776]:       <live/>
Nov 22 14:12:08 user nova-compute[74776]:       <uri_transports>
Nov 22 14:12:08 user nova-compute[74776]:         <uri_transport>tcp</uri_transport>
Nov 22 14:12:08 user nova-compute[74776]:         <uri_transport>rdma</uri_transport>
Nov 22 14:12:08 user nova-compute[74776]:       </uri_transports>
Nov 22 14:12:08 user nova-compute[74776]:     </migration_features>
Nov 22 14:12:08 user nova-compute[74776]:     <topology>
Nov 22 14:12:08 user nova-compute[74776]:       <cells num='2'>
Nov 22 14:12:08 user nova-compute[74776]:         <cell id='0'>
Nov 22 14:12:08 user nova-compute[74776]:           <memory unit='KiB'>8189224</memory>
Nov 22 14:12:08 user nova-compute[74776]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 22 14:12:08 user nova-compute[74776]:           <pages unit='KiB' size='2048'>0</pages>
Nov 22 14:12:08 user nova-compute[74776]:           <distances>
Nov 22 14:12:08 user nova-compute[74776]:             <sibling id='0' value='10'/>
Nov 22 14:12:08 user nova-compute[74776]:             <sibling id='1' value='20'/>
Nov 22 14:12:08 user nova-compute[74776]:           </distances>
Nov 22 14:12:08 user nova-compute[74776]:           <cpus num='6'>
Nov 22 14:12:08 user nova-compute[74776]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 22 14:12:08 user nova-compute[74776]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 22 14:12:08 user nova-compute[74776]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 22 14:12:08 user nova-compute[74776]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 22 14:12:08 user nova-compute[74776]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 22 14:12:08 user nova-compute[74776]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 22 14:12:08 user nova-compute[74776]:           </cpus>
Nov 22 14:12:08 user nova-compute[74776]:         </cell>
Nov 22 14:12:08 user nova-compute[74776]:         <cell id='1'>
Nov 22 14:12:08 user nova-compute[74776]:           <memory unit='KiB'>8206460</memory>
Nov 22 14:12:08 user nova-compute[74776]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 22 14:12:08 user nova-compute[74776]:           <pages unit='KiB' size='2048'>0</pages>
Nov 22 14:12:08 user nova-compute[74776]:           <distances>
Nov 22 14:12:08 user nova-compute[74776]:             <sibling id='0' value='20'/>
Nov 22 14:12:08 user nova-compute[74776]:             <sibling id='1' value='10'/>
Nov 22 14:12:08 user nova-compute[74776]:           </distances>
Nov 22 14:12:08 user nova-compute[74776]:           <cpus num='6'>
Nov 22 14:12:08 user nova-compute[74776]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 22 14:12:08 user nova-compute[74776]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 22 14:12:08 user nova-compute[74776]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 22 14:12:08 user nova-compute[74776]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 22 14:12:08 user nova-compute[74776]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 22 14:12:08 user nova-compute[74776]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 22 14:12:08 user nova-compute[74776]:           </cpus>
Nov 22 14:12:08 user nova-compute[74776]:         </cell>
Nov 22 14:12:08 user nova-compute[74776]:       </cells>
Nov 22 14:12:08 user nova-compute[74776]:     </topology>
Nov 22 14:12:08 user nova-compute[74776]:     <cache>
Nov 22 14:12:08 user nova-compute[74776]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 22 14:12:08 user nova-compute[74776]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 22 14:12:08 user nova-compute[74776]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 22 14:12:08 user nova-compute[74776]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 22 14:12:08 user nova-compute[74776]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 22 14:12:08 user nova-compute[74776]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 22 14:12:08 user nova-compute[74776]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 22 14:12:08 user nova-compute[74776]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 22 14:12:08 user nova-compute[74776]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 22 14:12:08 user nova-compute[74776]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 22 14:12:08 user nova-compute[74776]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 22 14:12:08 user nova-compute[74776]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 22 14:12:08 user nova-compute[74776]:     </cache>
Nov 22 14:12:08 user nova-compute[74776]:     <secmodel>
Nov 22 14:12:08 user nova-compute[74776]:       <model>apparmor</model>
Nov 22 14:12:08 user nova-compute[74776]:       <doi>0</doi>
Nov 22 14:12:08 user nova-compute[74776]:     </secmodel>
Nov 22 14:12:08 user nova-compute[74776]:     <secmodel>
Nov 22 14:12:08 user nova-compute[74776]:       <model>dac</model>
Nov 22 14:12:08 user nova-compute[74776]:       <doi>0</doi>
Nov 22 14:12:08 user nova-compute[74776]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 22 14:12:08 user nova-compute[74776]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 22 14:12:08 user nova-compute[74776]:     </secmodel>
Nov 22 14:12:08 user nova-compute[74776]:   </host>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='alpha'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>64</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>clipper</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='armv6l'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>32</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>integratorcp</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>borzoi</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>spitz</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>nuri</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>musca-b1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>versatileab</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>kzm</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>musca-a</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>smdkc210</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>sx1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>z2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>tosa</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>sabrelite</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>realview-eb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>n810</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>n800</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>versatilepb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>terrier</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mainstone</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>midway</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>musicpal</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>microbit</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>cubieboard</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>verdex</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>netduino2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>raspi2b</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>cheetah</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>highbank</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>akita</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>connex</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>collie</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>raspi0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='armv7l'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>32</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>integratorcp</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>borzoi</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>spitz</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>nuri</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>musca-b1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>versatileab</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>kzm</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>musca-a</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>smdkc210</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>sx1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>z2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>tosa</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>sabrelite</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>realview-eb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>n810</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>n800</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>versatilepb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>terrier</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mainstone</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>midway</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>musicpal</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>microbit</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>cubieboard</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>verdex</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>netduino2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>raspi2b</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>cheetah</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>highbank</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>akita</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>connex</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>collie</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>raspi0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='aarch64'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>64</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>integratorcp</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>borzoi</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>spitz</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>nuri</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>musca-b1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>versatileab</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>kzm</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>musca-a</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>smdkc210</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>sx1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>z2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>tosa</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>sabrelite</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>realview-eb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>n810</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>n800</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>versatilepb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>terrier</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mainstone</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>midway</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>musicpal</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>microbit</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>cubieboard</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>verdex</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>netduino2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>raspi3b</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>raspi2b</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>cheetah</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>highbank</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>akita</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>connex</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>collie</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>raspi0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <acpi default='on' toggle='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='cris'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>32</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='i686'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>32</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>x-remote</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>isapc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>microvm</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='kvm'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <pae/>
Nov 22 14:12:08 user nova-compute[74776]:       <nonpae/>
Nov 22 14:12:08 user nova-compute[74776]:       <acpi default='on' toggle='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:       <apic default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='m68k'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>32</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>an5206</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>q800</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>next-cube</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='microblaze'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>32</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='microblazeel'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>32</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='mips'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>32</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='16'>malta</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mipssim</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='mipsel'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>32</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='16'>malta</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mipssim</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='mips64'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>64</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='16'>malta</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mipssim</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>pica61</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>magnum</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='mips64el'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>64</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='16'>malta</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mipssim</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>pica61</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>magnum</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='16'>boston</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='ppc'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>32</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>g3beige</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mac99</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='32'>ppce500</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>pegasos2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>sam460ex</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>bamboo</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>40p</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>ref405ep</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>taihu</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='ppc64'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>64</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2048'>powernv9</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>taihu</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2048'>powernv10</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='32'>ppce500</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>40p</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>pegasos2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>bamboo</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>g3beige</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mac99</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>sam460ex</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>ref405ep</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2048'>powernv8</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='ppc64le'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>64</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2048'>powernv9</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>taihu</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2048'>powernv10</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='32'>ppce500</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>40p</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>pegasos2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>bamboo</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>g3beige</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>mac99</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>sam460ex</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>ref405ep</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2048'>powernv8</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='riscv32'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>32</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='8'>spike</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>opentitan</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='5'>sifive_u</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>sifive_e</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='8'>virt</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='riscv64'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>64</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='8'>spike</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='5'>sifive_u</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>shakti_c</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>sifive_e</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='8'>virt</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='s390x'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>64</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='sh4'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>32</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>shix</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>r2d</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='sh4eb'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>64</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>shix</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>r2d</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='sparc'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>32</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>SS-5</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>SS-20</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>LX</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>SS-4</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>SS-10</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>Voyager</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='sparc64'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>64</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>sun4u</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>niagara</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>sun4v</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='x86_64'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>64</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>x-remote</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='1'>isapc</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>microvm</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='kvm'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <acpi default='on' toggle='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:       <apic default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='xtensa'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>32</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>sim</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='32'>kc705</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='32'>ml605</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='32'>virt</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='32'>lx200</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='32'>lx60</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]:   <guest>
Nov 22 14:12:08 user nova-compute[74776]:     <os_type>hvm</os_type>
Nov 22 14:12:08 user nova-compute[74776]:     <arch name='xtensaeb'>
Nov 22 14:12:08 user nova-compute[74776]:       <wordsize>32</wordsize>
Nov 22 14:12:08 user nova-compute[74776]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='4'>sim</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='32'>kc705</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='32'>ml605</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='32'>virt</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='32'>lx200</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='32'>lx60</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 22 14:12:08 user nova-compute[74776]:       <domain type='qemu'/>
Nov 22 14:12:08 user nova-compute[74776]:     </arch>
Nov 22 14:12:08 user nova-compute[74776]:     <features>
Nov 22 14:12:08 user nova-compute[74776]:       <cpuselection/>
Nov 22 14:12:08 user nova-compute[74776]:       <deviceboot/>
Nov 22 14:12:08 user nova-compute[74776]:       <disksnapshot default='on' toggle='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     </features>
Nov 22 14:12:08 user nova-compute[74776]:   </guest>
Nov 22 14:12:08 user nova-compute[74776]: </capabilities>
Nov 22 14:12:08 user nova-compute[74776]: 
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 22 14:12:08 user nova-compute[74776]: <domainCapabilities>
Nov 22 14:12:08 user nova-compute[74776]:   <path>/usr/bin/qemu-system-i386</path>
Nov 22 14:12:08 user nova-compute[74776]:   <domain>kvm</domain>
Nov 22 14:12:08 user nova-compute[74776]:   <machine>pc-i440fx-6.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:   <arch>i686</arch>
Nov 22 14:12:08 user nova-compute[74776]:   <vcpu max='255'/>
Nov 22 14:12:08 user nova-compute[74776]:   <iothreads supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:   <os supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:     <enum name='firmware'/>
Nov 22 14:12:08 user nova-compute[74776]:     <loader supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='type'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>rom</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>pflash</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='readonly'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>yes</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>no</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='secure'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>no</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </loader>
Nov 22 14:12:08 user nova-compute[74776]:   </os>
Nov 22 14:12:08 user nova-compute[74776]:   <cpu>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='host-passthrough' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='hostPassthroughMigratable'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>off</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='maximum' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='maximumMigratable'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>on</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>off</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='host-model' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <vendor>Intel</vendor>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ss'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='vmx'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='pcid'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='hypervisor'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='arat'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='umip'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='md-clear'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='stibp'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ssbd'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ibpb'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ibrs'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='amd-stibp'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='disable' name='erms'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='disable' name='lm'/>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='custom' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>qemu64</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>qemu32</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>phenom</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium3</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium2</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>n270</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>kvm64</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>kvm32</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>coreduo</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>core2duo</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>athlon</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Westmere-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Westmere</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Snowridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>SandyBridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Penryn</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G5</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G4</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G3</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G2</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G1</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Nehalem-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Nehalem</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>IvyBridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Icelake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-Rome</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-Milan</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Dhyana</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cooperlake</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Conroe</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>486</model>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:   </cpu>
Nov 22 14:12:08 user nova-compute[74776]:   <memoryBacking supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:     <enum name='sourceType'>
Nov 22 14:12:08 user nova-compute[74776]:       <value>file</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>anonymous</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>memfd</value>
Nov 22 14:12:08 user nova-compute[74776]:     </enum>
Nov 22 14:12:08 user nova-compute[74776]:   </memoryBacking>
Nov 22 14:12:08 user nova-compute[74776]:   <devices>
Nov 22 14:12:08 user nova-compute[74776]:     <disk supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='diskDevice'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>disk</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>cdrom</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>floppy</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>lun</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='bus'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>ide</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>fdc</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>scsi</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>usb</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>sata</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-non-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </disk>
Nov 22 14:12:08 user nova-compute[74776]:     <graphics supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='type'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>sdl</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vnc</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>spice</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>egl-headless</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </graphics>
Nov 22 14:12:08 user nova-compute[74776]:     <video supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='modelType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vga</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>cirrus</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vmvga</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>qxl</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>none</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>bochs</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>ramfb</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </video>
Nov 22 14:12:08 user nova-compute[74776]:     <hostdev supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='mode'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>subsystem</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='startupPolicy'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>default</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>mandatory</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>requisite</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>optional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='subsysType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>usb</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>pci</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>scsi</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='capsType'/>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='pciBackend'/>
Nov 22 14:12:08 user nova-compute[74776]:     </hostdev>
Nov 22 14:12:08 user nova-compute[74776]:     <rng supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-non-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='backendModel'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>random</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>egd</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>builtin</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </rng>
Nov 22 14:12:08 user nova-compute[74776]:     <filesystem supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='driverType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>path</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>handle</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtiofs</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </filesystem>
Nov 22 14:12:08 user nova-compute[74776]:     <tpm supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>tpm-tis</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>tpm-crb</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='backendModel'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>passthrough</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>emulator</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </tpm>
Nov 22 14:12:08 user nova-compute[74776]:   </devices>
Nov 22 14:12:08 user nova-compute[74776]:   <features>
Nov 22 14:12:08 user nova-compute[74776]:     <gic supported='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     <vmcoreinfo supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <genid supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <backingStoreInput supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <backup supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <sev supported='no'/>
Nov 22 14:12:08 user nova-compute[74776]:   </features>
Nov 22 14:12:08 user nova-compute[74776]: </domainCapabilities>
Nov 22 14:12:08 user nova-compute[74776]:  {{(pid=74776) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 22 14:12:08 user nova-compute[74776]: <domainCapabilities>
Nov 22 14:12:08 user nova-compute[74776]:   <path>/usr/bin/qemu-system-i386</path>
Nov 22 14:12:08 user nova-compute[74776]:   <domain>kvm</domain>
Nov 22 14:12:08 user nova-compute[74776]:   <machine>pc-q35-6.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:   <arch>i686</arch>
Nov 22 14:12:08 user nova-compute[74776]:   <vcpu max='288'/>
Nov 22 14:12:08 user nova-compute[74776]:   <iothreads supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:   <os supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:     <enum name='firmware'/>
Nov 22 14:12:08 user nova-compute[74776]:     <loader supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='type'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>rom</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>pflash</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='readonly'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>yes</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>no</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='secure'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>no</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </loader>
Nov 22 14:12:08 user nova-compute[74776]:   </os>
Nov 22 14:12:08 user nova-compute[74776]:   <cpu>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='host-passthrough' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='hostPassthroughMigratable'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>off</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='maximum' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='maximumMigratable'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>on</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>off</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='host-model' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <vendor>Intel</vendor>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ss'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='vmx'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='pcid'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='hypervisor'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='arat'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='umip'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='md-clear'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='stibp'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ssbd'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ibpb'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ibrs'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='amd-stibp'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='disable' name='erms'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='disable' name='lm'/>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='custom' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>qemu64</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>qemu32</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>phenom</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium3</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium2</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>n270</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>kvm64</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>kvm32</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>coreduo</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>core2duo</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>athlon</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Westmere-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Westmere</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Snowridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>SandyBridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Penryn</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G5</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G4</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G3</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G2</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G1</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Nehalem-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Nehalem</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>IvyBridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Icelake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-Rome</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-Milan</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Dhyana</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cooperlake</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Conroe</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>486</model>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:   </cpu>
Nov 22 14:12:08 user nova-compute[74776]:   <memoryBacking supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:     <enum name='sourceType'>
Nov 22 14:12:08 user nova-compute[74776]:       <value>file</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>anonymous</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>memfd</value>
Nov 22 14:12:08 user nova-compute[74776]:     </enum>
Nov 22 14:12:08 user nova-compute[74776]:   </memoryBacking>
Nov 22 14:12:08 user nova-compute[74776]:   <devices>
Nov 22 14:12:08 user nova-compute[74776]:     <disk supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='diskDevice'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>disk</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>cdrom</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>floppy</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>lun</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='bus'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>fdc</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>scsi</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>usb</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>sata</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-non-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </disk>
Nov 22 14:12:08 user nova-compute[74776]:     <graphics supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='type'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>sdl</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vnc</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>spice</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>egl-headless</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </graphics>
Nov 22 14:12:08 user nova-compute[74776]:     <video supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='modelType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vga</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>cirrus</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vmvga</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>qxl</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>none</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>bochs</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>ramfb</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </video>
Nov 22 14:12:08 user nova-compute[74776]:     <hostdev supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='mode'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>subsystem</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='startupPolicy'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>default</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>mandatory</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>requisite</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>optional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='subsysType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>usb</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>pci</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>scsi</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='capsType'/>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='pciBackend'/>
Nov 22 14:12:08 user nova-compute[74776]:     </hostdev>
Nov 22 14:12:08 user nova-compute[74776]:     <rng supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-non-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='backendModel'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>random</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>egd</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>builtin</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </rng>
Nov 22 14:12:08 user nova-compute[74776]:     <filesystem supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='driverType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>path</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>handle</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtiofs</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </filesystem>
Nov 22 14:12:08 user nova-compute[74776]:     <tpm supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>tpm-tis</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>tpm-crb</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='backendModel'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>passthrough</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>emulator</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </tpm>
Nov 22 14:12:08 user nova-compute[74776]:   </devices>
Nov 22 14:12:08 user nova-compute[74776]:   <features>
Nov 22 14:12:08 user nova-compute[74776]:     <gic supported='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     <vmcoreinfo supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <genid supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <backingStoreInput supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <backup supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <sev supported='no'/>
Nov 22 14:12:08 user nova-compute[74776]:   </features>
Nov 22 14:12:08 user nova-compute[74776]: </domainCapabilities>
Nov 22 14:12:08 user nova-compute[74776]:  {{(pid=74776) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 22 14:12:08 user nova-compute[74776]: <domainCapabilities>
Nov 22 14:12:08 user nova-compute[74776]:   <path>/usr/bin/qemu-system-i386</path>
Nov 22 14:12:08 user nova-compute[74776]:   <domain>kvm</domain>
Nov 22 14:12:08 user nova-compute[74776]:   <machine>pc-i440fx-jammy</machine>
Nov 22 14:12:08 user nova-compute[74776]:   <arch>i686</arch>
Nov 22 14:12:08 user nova-compute[74776]:   <vcpu max='255'/>
Nov 22 14:12:08 user nova-compute[74776]:   <iothreads supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:   <os supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:     <enum name='firmware'/>
Nov 22 14:12:08 user nova-compute[74776]:     <loader supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='type'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>rom</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>pflash</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='readonly'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>yes</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>no</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='secure'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>no</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </loader>
Nov 22 14:12:08 user nova-compute[74776]:   </os>
Nov 22 14:12:08 user nova-compute[74776]:   <cpu>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='host-passthrough' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='hostPassthroughMigratable'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>off</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='maximum' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='maximumMigratable'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>on</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>off</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='host-model' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <vendor>Intel</vendor>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ss'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='vmx'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='pcid'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='hypervisor'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='arat'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='umip'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='md-clear'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='stibp'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ssbd'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ibpb'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ibrs'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='amd-stibp'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='disable' name='erms'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='disable' name='lm'/>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='custom' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>qemu64</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>qemu32</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>phenom</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium3</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium2</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>n270</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>kvm64</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>kvm32</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>coreduo</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>core2duo</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>athlon</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Westmere-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Westmere</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Snowridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>SandyBridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Penryn</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G5</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G4</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G3</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G2</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G1</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Nehalem-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Nehalem</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>IvyBridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Icelake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-Rome</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-Milan</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Dhyana</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cooperlake</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Conroe</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>486</model>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:   </cpu>
Nov 22 14:12:08 user nova-compute[74776]:   <memoryBacking supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:     <enum name='sourceType'>
Nov 22 14:12:08 user nova-compute[74776]:       <value>file</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>anonymous</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>memfd</value>
Nov 22 14:12:08 user nova-compute[74776]:     </enum>
Nov 22 14:12:08 user nova-compute[74776]:   </memoryBacking>
Nov 22 14:12:08 user nova-compute[74776]:   <devices>
Nov 22 14:12:08 user nova-compute[74776]:     <disk supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='diskDevice'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>disk</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>cdrom</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>floppy</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>lun</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='bus'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>ide</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>fdc</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>scsi</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>usb</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>sata</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-non-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </disk>
Nov 22 14:12:08 user nova-compute[74776]:     <graphics supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='type'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>sdl</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vnc</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>spice</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>egl-headless</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </graphics>
Nov 22 14:12:08 user nova-compute[74776]:     <video supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='modelType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vga</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>cirrus</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vmvga</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>qxl</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>none</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>bochs</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>ramfb</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </video>
Nov 22 14:12:08 user nova-compute[74776]:     <hostdev supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='mode'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>subsystem</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='startupPolicy'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>default</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>mandatory</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>requisite</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>optional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='subsysType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>usb</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>pci</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>scsi</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='capsType'/>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='pciBackend'/>
Nov 22 14:12:08 user nova-compute[74776]:     </hostdev>
Nov 22 14:12:08 user nova-compute[74776]:     <rng supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-non-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='backendModel'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>random</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>egd</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>builtin</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </rng>
Nov 22 14:12:08 user nova-compute[74776]:     <filesystem supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='driverType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>path</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>handle</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtiofs</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </filesystem>
Nov 22 14:12:08 user nova-compute[74776]:     <tpm supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>tpm-tis</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>tpm-crb</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='backendModel'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>passthrough</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>emulator</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </tpm>
Nov 22 14:12:08 user nova-compute[74776]:   </devices>
Nov 22 14:12:08 user nova-compute[74776]:   <features>
Nov 22 14:12:08 user nova-compute[74776]:     <gic supported='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     <vmcoreinfo supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <genid supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <backingStoreInput supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <backup supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <sev supported='no'/>
Nov 22 14:12:08 user nova-compute[74776]:   </features>
Nov 22 14:12:08 user nova-compute[74776]: </domainCapabilities>
Nov 22 14:12:08 user nova-compute[74776]:  {{(pid=74776) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 22 14:12:08 user nova-compute[74776]: <domainCapabilities>
Nov 22 14:12:08 user nova-compute[74776]:   <path>/usr/bin/qemu-system-i386</path>
Nov 22 14:12:08 user nova-compute[74776]:   <domain>kvm</domain>
Nov 22 14:12:08 user nova-compute[74776]:   <machine>pc-q35-jammy</machine>
Nov 22 14:12:08 user nova-compute[74776]:   <arch>i686</arch>
Nov 22 14:12:08 user nova-compute[74776]:   <vcpu max='288'/>
Nov 22 14:12:08 user nova-compute[74776]:   <iothreads supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:   <os supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:     <enum name='firmware'/>
Nov 22 14:12:08 user nova-compute[74776]:     <loader supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='type'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>rom</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>pflash</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='readonly'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>yes</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>no</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='secure'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>no</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </loader>
Nov 22 14:12:08 user nova-compute[74776]:   </os>
Nov 22 14:12:08 user nova-compute[74776]:   <cpu>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='host-passthrough' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='hostPassthroughMigratable'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>off</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='maximum' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='maximumMigratable'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>on</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>off</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='host-model' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <vendor>Intel</vendor>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ss'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='vmx'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='pcid'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='hypervisor'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='arat'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='umip'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='md-clear'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='stibp'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ssbd'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ibpb'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ibrs'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='amd-stibp'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='disable' name='erms'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='disable' name='lm'/>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='custom' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>qemu64</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>qemu32</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>phenom</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium3</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium2</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>n270</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>kvm64</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>kvm32</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>coreduo</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>core2duo</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>athlon</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Westmere-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Westmere</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Snowridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>SandyBridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Penryn</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G5</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G4</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G3</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G2</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G1</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Nehalem-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Nehalem</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>IvyBridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Icelake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-Rome</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-Milan</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Dhyana</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cooperlake</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Conroe</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>486</model>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:   </cpu>
Nov 22 14:12:08 user nova-compute[74776]:   <memoryBacking supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:     <enum name='sourceType'>
Nov 22 14:12:08 user nova-compute[74776]:       <value>file</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>anonymous</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>memfd</value>
Nov 22 14:12:08 user nova-compute[74776]:     </enum>
Nov 22 14:12:08 user nova-compute[74776]:   </memoryBacking>
Nov 22 14:12:08 user nova-compute[74776]:   <devices>
Nov 22 14:12:08 user nova-compute[74776]:     <disk supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='diskDevice'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>disk</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>cdrom</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>floppy</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>lun</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='bus'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>fdc</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>scsi</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>usb</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>sata</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-non-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </disk>
Nov 22 14:12:08 user nova-compute[74776]:     <graphics supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='type'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>sdl</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vnc</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>spice</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>egl-headless</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </graphics>
Nov 22 14:12:08 user nova-compute[74776]:     <video supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='modelType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vga</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>cirrus</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vmvga</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>qxl</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>none</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>bochs</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>ramfb</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </video>
Nov 22 14:12:08 user nova-compute[74776]:     <hostdev supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='mode'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>subsystem</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='startupPolicy'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>default</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>mandatory</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>requisite</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>optional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='subsysType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>usb</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>pci</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>scsi</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='capsType'/>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='pciBackend'/>
Nov 22 14:12:08 user nova-compute[74776]:     </hostdev>
Nov 22 14:12:08 user nova-compute[74776]:     <rng supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-non-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='backendModel'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>random</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>egd</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>builtin</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </rng>
Nov 22 14:12:08 user nova-compute[74776]:     <filesystem supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='driverType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>path</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>handle</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtiofs</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </filesystem>
Nov 22 14:12:08 user nova-compute[74776]:     <tpm supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>tpm-tis</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>tpm-crb</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='backendModel'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>passthrough</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>emulator</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </tpm>
Nov 22 14:12:08 user nova-compute[74776]:   </devices>
Nov 22 14:12:08 user nova-compute[74776]:   <features>
Nov 22 14:12:08 user nova-compute[74776]:     <gic supported='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     <vmcoreinfo supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <genid supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <backingStoreInput supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <backup supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <sev supported='no'/>
Nov 22 14:12:08 user nova-compute[74776]:   </features>
Nov 22 14:12:08 user nova-compute[74776]: </domainCapabilities>
Nov 22 14:12:08 user nova-compute[74776]:  {{(pid=74776) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 22 14:12:08 user nova-compute[74776]: <domainCapabilities>
Nov 22 14:12:08 user nova-compute[74776]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 22 14:12:08 user nova-compute[74776]:   <domain>kvm</domain>
Nov 22 14:12:08 user nova-compute[74776]:   <machine>pc-i440fx-6.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:   <arch>x86_64</arch>
Nov 22 14:12:08 user nova-compute[74776]:   <vcpu max='255'/>
Nov 22 14:12:08 user nova-compute[74776]:   <iothreads supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:   <os supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:     <enum name='firmware'>
Nov 22 14:12:08 user nova-compute[74776]:       <value>efi</value>
Nov 22 14:12:08 user nova-compute[74776]:     </enum>
Nov 22 14:12:08 user nova-compute[74776]:     <loader supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='type'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>rom</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>pflash</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='readonly'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>yes</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>no</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='secure'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>no</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </loader>
Nov 22 14:12:08 user nova-compute[74776]:   </os>
Nov 22 14:12:08 user nova-compute[74776]:   <cpu>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='host-passthrough' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='hostPassthroughMigratable'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>on</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>off</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='maximum' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='maximumMigratable'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>on</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>off</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='host-model' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <vendor>Intel</vendor>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ss'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='vmx'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='pcid'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='hypervisor'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='arat'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='umip'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='md-clear'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='stibp'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ssbd'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='invtsc'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ibpb'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ibrs'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='amd-stibp'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='rsba'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='pschange-mc-no'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='disable' name='erms'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='custom' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>qemu64</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>qemu32</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>phenom</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium3</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium2</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>n270</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>kvm64</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>kvm32</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>coreduo</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>core2duo</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>athlon</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Westmere-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Westmere</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Snowridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>SandyBridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Penryn</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G5</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G4</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G3</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G2</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Opteron_G1</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Nehalem</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>IvyBridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Icelake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-Rome</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-Milan</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Dhyana</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cooperlake</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Conroe</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>486</model>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:   </cpu>
Nov 22 14:12:08 user nova-compute[74776]:   <memoryBacking supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:     <enum name='sourceType'>
Nov 22 14:12:08 user nova-compute[74776]:       <value>file</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>anonymous</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>memfd</value>
Nov 22 14:12:08 user nova-compute[74776]:     </enum>
Nov 22 14:12:08 user nova-compute[74776]:   </memoryBacking>
Nov 22 14:12:08 user nova-compute[74776]:   <devices>
Nov 22 14:12:08 user nova-compute[74776]:     <disk supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='diskDevice'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>disk</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>cdrom</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>floppy</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>lun</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='bus'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>ide</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>fdc</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>scsi</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>usb</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>sata</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-non-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </disk>
Nov 22 14:12:08 user nova-compute[74776]:     <graphics supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='type'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>sdl</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vnc</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>spice</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>egl-headless</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </graphics>
Nov 22 14:12:08 user nova-compute[74776]:     <video supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='modelType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vga</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>cirrus</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vmvga</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>qxl</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>none</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>bochs</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>ramfb</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </video>
Nov 22 14:12:08 user nova-compute[74776]:     <hostdev supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='mode'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>subsystem</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='startupPolicy'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>default</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>mandatory</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>requisite</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>optional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='subsysType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>usb</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>pci</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>scsi</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='capsType'/>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='pciBackend'/>
Nov 22 14:12:08 user nova-compute[74776]:     </hostdev>
Nov 22 14:12:08 user nova-compute[74776]:     <rng supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-non-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='backendModel'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>random</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>egd</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>builtin</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </rng>
Nov 22 14:12:08 user nova-compute[74776]:     <filesystem supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='driverType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>path</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>handle</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtiofs</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </filesystem>
Nov 22 14:12:08 user nova-compute[74776]:     <tpm supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>tpm-tis</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>tpm-crb</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='backendModel'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>passthrough</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>emulator</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </tpm>
Nov 22 14:12:08 user nova-compute[74776]:   </devices>
Nov 22 14:12:08 user nova-compute[74776]:   <features>
Nov 22 14:12:08 user nova-compute[74776]:     <gic supported='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     <vmcoreinfo supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <genid supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <backingStoreInput supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <backup supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <sev supported='no'/>
Nov 22 14:12:08 user nova-compute[74776]:   </features>
Nov 22 14:12:08 user nova-compute[74776]: </domainCapabilities>
Nov 22 14:12:08 user nova-compute[74776]:  {{(pid=74776) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 22 14:12:08 user nova-compute[74776]: <domainCapabilities>
Nov 22 14:12:08 user nova-compute[74776]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 22 14:12:08 user nova-compute[74776]:   <domain>kvm</domain>
Nov 22 14:12:08 user nova-compute[74776]:   <machine>pc-q35-6.2</machine>
Nov 22 14:12:08 user nova-compute[74776]:   <arch>x86_64</arch>
Nov 22 14:12:08 user nova-compute[74776]:   <vcpu max='288'/>
Nov 22 14:12:08 user nova-compute[74776]:   <iothreads supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:   <os supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:     <enum name='firmware'>
Nov 22 14:12:08 user nova-compute[74776]:       <value>efi</value>
Nov 22 14:12:08 user nova-compute[74776]:     </enum>
Nov 22 14:12:08 user nova-compute[74776]:     <loader supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='type'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>rom</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>pflash</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='readonly'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>yes</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>no</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='secure'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>yes</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>no</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </loader>
Nov 22 14:12:08 user nova-compute[74776]:   </os>
Nov 22 14:12:08 user nova-compute[74776]:   <cpu>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='host-passthrough' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='hostPassthroughMigratable'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>on</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>off</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='maximum' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='maximumMigratable'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>on</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>off</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='host-model' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <vendor>Intel</vendor>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ss'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='vmx'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='pcid'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='hypervisor'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='arat'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='umip'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='md-clear'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='stibp'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ssbd'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='invtsc'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ibpb'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ibrs'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='amd-stibp'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='rsba'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='pschange-mc-no'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='disable' name='erms'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='custom' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>qemu64</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>qemu32</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>phenom</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium3</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium2</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>n270</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>kvm64</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>kvm32</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>coreduo</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>core2duo</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>athlon</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Westmere-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Westmere</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Snowridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>SandyBridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Penryn</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G5</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G4</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G3</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G2</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Opteron_G1</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Nehalem</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>IvyBridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Icelake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-Rome</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-Milan</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Dhyana</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cooperlake</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Conroe</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>486</model>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:   </cpu>
Nov 22 14:12:08 user nova-compute[74776]:   <memoryBacking supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:     <enum name='sourceType'>
Nov 22 14:12:08 user nova-compute[74776]:       <value>file</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>anonymous</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>memfd</value>
Nov 22 14:12:08 user nova-compute[74776]:     </enum>
Nov 22 14:12:08 user nova-compute[74776]:   </memoryBacking>
Nov 22 14:12:08 user nova-compute[74776]:   <devices>
Nov 22 14:12:08 user nova-compute[74776]:     <disk supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='diskDevice'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>disk</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>cdrom</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>floppy</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>lun</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='bus'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>fdc</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>scsi</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>usb</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>sata</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-non-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </disk>
Nov 22 14:12:08 user nova-compute[74776]:     <graphics supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='type'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>sdl</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vnc</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>spice</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>egl-headless</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </graphics>
Nov 22 14:12:08 user nova-compute[74776]:     <video supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='modelType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vga</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>cirrus</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vmvga</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>qxl</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>none</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>bochs</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>ramfb</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </video>
Nov 22 14:12:08 user nova-compute[74776]:     <hostdev supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='mode'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>subsystem</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='startupPolicy'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>default</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>mandatory</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>requisite</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>optional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='subsysType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>usb</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>pci</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>scsi</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='capsType'/>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='pciBackend'/>
Nov 22 14:12:08 user nova-compute[74776]:     </hostdev>
Nov 22 14:12:08 user nova-compute[74776]:     <rng supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-non-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='backendModel'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>random</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>egd</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>builtin</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </rng>
Nov 22 14:12:08 user nova-compute[74776]:     <filesystem supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='driverType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>path</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>handle</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtiofs</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </filesystem>
Nov 22 14:12:08 user nova-compute[74776]:     <tpm supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>tpm-tis</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>tpm-crb</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='backendModel'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>passthrough</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>emulator</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </tpm>
Nov 22 14:12:08 user nova-compute[74776]:   </devices>
Nov 22 14:12:08 user nova-compute[74776]:   <features>
Nov 22 14:12:08 user nova-compute[74776]:     <gic supported='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     <vmcoreinfo supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <genid supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <backingStoreInput supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <backup supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <sev supported='no'/>
Nov 22 14:12:08 user nova-compute[74776]:   </features>
Nov 22 14:12:08 user nova-compute[74776]: </domainCapabilities>
Nov 22 14:12:08 user nova-compute[74776]:  {{(pid=74776) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 22 14:12:08 user nova-compute[74776]: <domainCapabilities>
Nov 22 14:12:08 user nova-compute[74776]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 22 14:12:08 user nova-compute[74776]:   <domain>kvm</domain>
Nov 22 14:12:08 user nova-compute[74776]:   <machine>pc-i440fx-jammy</machine>
Nov 22 14:12:08 user nova-compute[74776]:   <arch>x86_64</arch>
Nov 22 14:12:08 user nova-compute[74776]:   <vcpu max='255'/>
Nov 22 14:12:08 user nova-compute[74776]:   <iothreads supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:   <os supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:     <enum name='firmware'>
Nov 22 14:12:08 user nova-compute[74776]:       <value>efi</value>
Nov 22 14:12:08 user nova-compute[74776]:     </enum>
Nov 22 14:12:08 user nova-compute[74776]:     <loader supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='type'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>rom</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>pflash</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='readonly'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>yes</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>no</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='secure'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>no</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </loader>
Nov 22 14:12:08 user nova-compute[74776]:   </os>
Nov 22 14:12:08 user nova-compute[74776]:   <cpu>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='host-passthrough' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='hostPassthroughMigratable'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>on</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>off</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='maximum' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='maximumMigratable'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>on</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>off</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='host-model' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <vendor>Intel</vendor>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ss'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='vmx'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='pcid'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='hypervisor'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='arat'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='umip'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='md-clear'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='stibp'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ssbd'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='invtsc'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ibpb'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ibrs'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='amd-stibp'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='rsba'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='pschange-mc-no'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='disable' name='erms'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='custom' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>qemu64</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>qemu32</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>phenom</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium3</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium2</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>n270</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>kvm64</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>kvm32</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>coreduo</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>core2duo</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>athlon</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Westmere-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Westmere</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Snowridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>SandyBridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Penryn</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G5</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G4</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G3</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G2</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Opteron_G1</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Nehalem</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>IvyBridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Icelake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-Rome</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-Milan</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Dhyana</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cooperlake</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Conroe</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>486</model>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:   </cpu>
Nov 22 14:12:08 user nova-compute[74776]:   <memoryBacking supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:     <enum name='sourceType'>
Nov 22 14:12:08 user nova-compute[74776]:       <value>file</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>anonymous</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>memfd</value>
Nov 22 14:12:08 user nova-compute[74776]:     </enum>
Nov 22 14:12:08 user nova-compute[74776]:   </memoryBacking>
Nov 22 14:12:08 user nova-compute[74776]:   <devices>
Nov 22 14:12:08 user nova-compute[74776]:     <disk supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='diskDevice'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>disk</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>cdrom</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>floppy</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>lun</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='bus'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>ide</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>fdc</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>scsi</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>usb</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>sata</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-non-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </disk>
Nov 22 14:12:08 user nova-compute[74776]:     <graphics supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='type'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>sdl</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vnc</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>spice</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>egl-headless</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </graphics>
Nov 22 14:12:08 user nova-compute[74776]:     <video supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='modelType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vga</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>cirrus</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vmvga</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>qxl</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>none</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>bochs</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>ramfb</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </video>
Nov 22 14:12:08 user nova-compute[74776]:     <hostdev supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='mode'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>subsystem</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='startupPolicy'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>default</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>mandatory</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>requisite</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>optional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='subsysType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>usb</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>pci</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>scsi</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='capsType'/>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='pciBackend'/>
Nov 22 14:12:08 user nova-compute[74776]:     </hostdev>
Nov 22 14:12:08 user nova-compute[74776]:     <rng supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-non-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='backendModel'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>random</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>egd</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>builtin</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </rng>
Nov 22 14:12:08 user nova-compute[74776]:     <filesystem supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='driverType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>path</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>handle</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtiofs</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </filesystem>
Nov 22 14:12:08 user nova-compute[74776]:     <tpm supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>tpm-tis</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>tpm-crb</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='backendModel'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>passthrough</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>emulator</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </tpm>
Nov 22 14:12:08 user nova-compute[74776]:   </devices>
Nov 22 14:12:08 user nova-compute[74776]:   <features>
Nov 22 14:12:08 user nova-compute[74776]:     <gic supported='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     <vmcoreinfo supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <genid supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <backingStoreInput supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <backup supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <sev supported='no'/>
Nov 22 14:12:08 user nova-compute[74776]:   </features>
Nov 22 14:12:08 user nova-compute[74776]: </domainCapabilities>
Nov 22 14:12:08 user nova-compute[74776]:  {{(pid=74776) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 14:12:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 22 14:12:08 user nova-compute[74776]: <domainCapabilities>
Nov 22 14:12:08 user nova-compute[74776]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 22 14:12:08 user nova-compute[74776]:   <domain>kvm</domain>
Nov 22 14:12:08 user nova-compute[74776]:   <machine>pc-q35-jammy</machine>
Nov 22 14:12:08 user nova-compute[74776]:   <arch>x86_64</arch>
Nov 22 14:12:08 user nova-compute[74776]:   <vcpu max='288'/>
Nov 22 14:12:08 user nova-compute[74776]:   <iothreads supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:   <os supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:     <enum name='firmware'>
Nov 22 14:12:08 user nova-compute[74776]:       <value>efi</value>
Nov 22 14:12:08 user nova-compute[74776]:     </enum>
Nov 22 14:12:08 user nova-compute[74776]:     <loader supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='type'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>rom</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>pflash</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='readonly'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>yes</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>no</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='secure'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>yes</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>no</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </loader>
Nov 22 14:12:08 user nova-compute[74776]:   </os>
Nov 22 14:12:08 user nova-compute[74776]:   <cpu>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='host-passthrough' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='hostPassthroughMigratable'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>on</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>off</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='maximum' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='maximumMigratable'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>on</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>off</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='host-model' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <vendor>Intel</vendor>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ss'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='vmx'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='pcid'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='hypervisor'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='arat'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='tsc_adjust'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='umip'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='md-clear'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='stibp'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='arch-capabilities'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ssbd'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='invtsc'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ibpb'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='ibrs'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='amd-stibp'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='amd-ssbd'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='rsba'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='require' name='pschange-mc-no'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='disable' name='erms'/>
Nov 22 14:12:08 user nova-compute[74776]:       <feature policy='disable' name='xsaveopt'/>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:     <mode name='custom' supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>qemu64</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>qemu32</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>phenom</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium3</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium2</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>pentium</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>n270</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>kvm64</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>kvm32</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>coreduo</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>core2duo</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>athlon</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Westmere-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Westmere</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Snowridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Skylake-Client</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>SandyBridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Penryn</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G5</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G4</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G3</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Opteron_G2</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Opteron_G1</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Nehalem</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>IvyBridge</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Icelake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Haswell</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-Rome</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-Milan</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC-IBPB</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>EPYC</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Dhyana</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cooperlake</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>Conroe</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Cascadelake-Server</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-noTSX</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell-IBRS</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='no'>Broadwell</model>
Nov 22 14:12:08 user nova-compute[74776]:       <model usable='yes'>486</model>
Nov 22 14:12:08 user nova-compute[74776]:     </mode>
Nov 22 14:12:08 user nova-compute[74776]:   </cpu>
Nov 22 14:12:08 user nova-compute[74776]:   <memoryBacking supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:     <enum name='sourceType'>
Nov 22 14:12:08 user nova-compute[74776]:       <value>file</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>anonymous</value>
Nov 22 14:12:08 user nova-compute[74776]:       <value>memfd</value>
Nov 22 14:12:08 user nova-compute[74776]:     </enum>
Nov 22 14:12:08 user nova-compute[74776]:   </memoryBacking>
Nov 22 14:12:08 user nova-compute[74776]:   <devices>
Nov 22 14:12:08 user nova-compute[74776]:     <disk supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='diskDevice'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>disk</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>cdrom</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>floppy</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>lun</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='bus'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>fdc</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>scsi</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>usb</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>sata</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-non-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </disk>
Nov 22 14:12:08 user nova-compute[74776]:     <graphics supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='type'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>sdl</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vnc</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>spice</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>egl-headless</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </graphics>
Nov 22 14:12:08 user nova-compute[74776]:     <video supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='modelType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vga</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>cirrus</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>vmvga</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>qxl</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>none</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>bochs</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>ramfb</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </video>
Nov 22 14:12:08 user nova-compute[74776]:     <hostdev supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='mode'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>subsystem</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='startupPolicy'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>default</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>mandatory</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>requisite</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>optional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='subsysType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>usb</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>pci</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>scsi</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='capsType'/>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='pciBackend'/>
Nov 22 14:12:08 user nova-compute[74776]:     </hostdev>
Nov 22 14:12:08 user nova-compute[74776]:     <rng supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtio-non-transitional</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='backendModel'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>random</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>egd</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>builtin</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </rng>
Nov 22 14:12:08 user nova-compute[74776]:     <filesystem supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='driverType'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>path</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>handle</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>virtiofs</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </filesystem>
Nov 22 14:12:08 user nova-compute[74776]:     <tpm supported='yes'>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='model'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>tpm-tis</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>tpm-crb</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:       <enum name='backendModel'>
Nov 22 14:12:08 user nova-compute[74776]:         <value>passthrough</value>
Nov 22 14:12:08 user nova-compute[74776]:         <value>emulator</value>
Nov 22 14:12:08 user nova-compute[74776]:       </enum>
Nov 22 14:12:08 user nova-compute[74776]:     </tpm>
Nov 22 14:12:08 user nova-compute[74776]:   </devices>
Nov 22 14:12:08 user nova-compute[74776]:   <features>
Nov 22 14:12:08 user nova-compute[74776]:     <gic supported='no'/>
Nov 22 14:12:08 user nova-compute[74776]:     <vmcoreinfo supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <genid supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <backingStoreInput supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <backup supported='yes'/>
Nov 22 14:12:08 user nova-compute[74776]:     <sev supported='no'/>
Nov 22 14:12:08 user nova-compute[74776]:   </features>
Nov 22 14:12:08 user nova-compute[74776]: </domainCapabilities>
Nov 22 14:12:08 user nova-compute[74776]:  {{(pid=74776) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74776) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74776) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Checking secure boot support for host arch (x86_64) {{(pid=74776) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Checking secure boot support for host arch (x86_64) {{(pid=74776) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Checking secure boot support for host arch (x86_64) {{(pid=74776) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 22 14:12:09 user nova-compute[74776]: INFO nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Secure Boot support detected
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] cpu compare xml: <cpu match="exact">
Nov 22 14:12:09 user nova-compute[74776]:   <model>Nehalem</model>
Nov 22 14:12:09 user nova-compute[74776]: </cpu>
Nov 22 14:12:09 user nova-compute[74776]:  {{(pid=74776) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 22 14:12:09 user nova-compute[74776]: INFO nova.virt.node [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Generated node identity b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a
Nov 22 14:12:09 user nova-compute[74776]: INFO nova.virt.node [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Wrote node identity b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a to /opt/stack/data/nova/compute_id
Nov 22 14:12:09 user nova-compute[74776]: WARNING nova.compute.manager [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Compute nodes ['b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 22 14:12:09 user nova-compute[74776]: INFO nova.compute.manager [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 22 14:12:09 user nova-compute[74776]: WARNING nova.compute.manager [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 22 14:12:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:12:09 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:12:09 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Hypervisor/Node resource view: name=user free_ram=10973MB free_disk=26.160152435302734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:12:09 user nova-compute[74776]: WARNING nova.compute.resource_tracker [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] No compute node record for user:b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a could not be found.
Nov 22 14:12:09 user nova-compute[74776]: INFO nova.compute.resource_tracker [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Compute node record created for user:user with uuid: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:12:09 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] [req-4de8793e-0c0f-4105-8297-ea73fd1dd0d9] Created resource provider record via placement API for resource provider with UUID b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a and name user.
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74776) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 22 14:12:09 user nova-compute[74776]: INFO nova.virt.libvirt.host [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] kernel doesn't support AMD SEV
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Updating inventory in ProviderTree for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Libvirt baseline CPU <cpu>
Nov 22 14:12:09 user nova-compute[74776]:   <arch>x86_64</arch>
Nov 22 14:12:09 user nova-compute[74776]:   <model>Nehalem</model>
Nov 22 14:12:09 user nova-compute[74776]:   <vendor>Intel</vendor>
Nov 22 14:12:09 user nova-compute[74776]:   <topology sockets="6" cores="1" threads="1"/>
Nov 22 14:12:09 user nova-compute[74776]: </cpu>
Nov 22 14:12:09 user nova-compute[74776]:  {{(pid=74776) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Updated inventory for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Updating resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a generation from 0 to 1 during operation: update_inventory {{(pid=74776) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Updating inventory in ProviderTree for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Updating resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a generation from 1 to 2 during operation: update_traits {{(pid=74776) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:12:09 user nova-compute[74776]: DEBUG nova.service [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Creating RPC server for service compute {{(pid=74776) start /opt/stack/nova/nova/service.py:182}}
Nov 22 14:12:10 user nova-compute[74776]: DEBUG nova.service [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] Join ServiceGroup membership for this service compute {{(pid=74776) start /opt/stack/nova/nova/service.py:199}}
Nov 22 14:12:10 user nova-compute[74776]: DEBUG nova.servicegroup.drivers.db [None req-57fae292-286e-414b-93b1-4f97ffad5d21 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74776) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Didn't find any instances for network info cache update. {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:13:06 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:13:06 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:13:06 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=10337MB free_disk=26.06383514404297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:13:06 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:14:01 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:14:01 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:14:01 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:14:01 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:14:01 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:14:01 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:14:01 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:14:01 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:14:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:14:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:14:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:14:01 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:14:02 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:14:02 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:14:02 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=10298MB free_disk=26.128482818603516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:14:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:14:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:14:02 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:14:02 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:14:02 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:14:02 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:14:02 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:14:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:14:03 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:14:03 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:14:03 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:14:03 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 14:14:03 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Didn't find any instances for network info cache update. {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 14:14:03 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:15:01 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:15:01 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:15:02 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:15:02 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:15:02 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:15:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:15:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:15:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:15:02 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:15:03 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:15:03 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:15:03 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=10305MB free_disk=25.880596160888672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:15:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:15:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:15:03 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:15:03 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:15:03 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:15:03 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:15:03 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:15:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:15:04 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:15:04 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:15:04 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 14:15:04 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Didn't find any instances for network info cache update. {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 14:15:04 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:15:04 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:15:04 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:15:04 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:16:02 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:16:02 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:16:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:02 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:16:03 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:16:03 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:16:03 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=9621MB free_disk=25.90154266357422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:16:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:03 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:16:03 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:16:03 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:16:03 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:16:03 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:16:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:04 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:16:04 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:16:04 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:16:04 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:16:04 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:16:04 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:16:04 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:16:05 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:16:05 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:16:05 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 14:16:05 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Didn't find any instances for network info cache update. {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 14:16:05 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:16:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Acquiring lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:11 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:16:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:11 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:16:11 user nova-compute[74776]: INFO nova.compute.claims [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Claim successful on node user
Nov 22 14:16:11 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:16:11 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:16:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:11 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:16:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:16:12 user nova-compute[74776]: DEBUG nova.network.neutron [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:16:12 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:16:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:16:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:16:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:16:12 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Creating image(s)
Nov 22 14:16:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Acquiring lock "/opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "/opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "/opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e.part --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:12 user nova-compute[74776]: DEBUG nova.policy [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f57c323128d14050b648a6bd24cace89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc86266374d46f9b40654b2090067b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:16:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e.part --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:13 user nova-compute[74776]: DEBUG nova.virt.images [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] ee204558-2a75-42f8-8c03-3c76a3916fa5 was qcow2, converting to raw {{(pid=74776) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 14:16:13 user nova-compute[74776]: DEBUG nova.privsep.utils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74776) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 14:16:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e.part /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e.converted {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e.part /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e.converted" returned: 0 in 0.153s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e.converted --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e.converted --force-share --output=json" returned: 0 in 0.214s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.992s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:13 user nova-compute[74776]: INFO oslo.privsep.daemon [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpf8ez2np3/privsep.sock']
Nov 22 14:16:13 user sudo[84028]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpf8ez2np3/privsep.sock
Nov 22 14:16:13 user sudo[84028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 22 14:16:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:13 user nova-compute[74776]: DEBUG nova.compute.manager [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:16:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:16:14 user nova-compute[74776]: INFO nova.compute.claims [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Claim successful on node user
Nov 22 14:16:14 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:16:14 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:16:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:14 user nova-compute[74776]: DEBUG nova.compute.manager [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:16:14 user nova-compute[74776]: DEBUG nova.compute.manager [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:16:14 user nova-compute[74776]: DEBUG nova.network.neutron [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:16:14 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:16:14 user nova-compute[74776]: DEBUG nova.compute.manager [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:16:14 user nova-compute[74776]: DEBUG nova.policy [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84f6a2d2d72f42f1ba0ee9b623a0a9ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1b35da14434fa09c3331d9c44d63fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:16:14 user nova-compute[74776]: DEBUG nova.compute.manager [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:16:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:16:14 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Creating image(s)
Nov 22 14:16:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "/opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "/opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "/opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:14 user sudo[84028]: pam_unix(sudo:session): session closed for user root
Nov 22 14:16:14 user nova-compute[74776]: INFO oslo.privsep.daemon [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Spawned new privsep daemon via rootwrap
Nov 22 14:16:14 user nova-compute[74776]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 22 14:16:14 user nova-compute[74776]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 22 14:16:14 user nova-compute[74776]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 22 14:16:14 user nova-compute[74776]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84036
Nov 22 14:16:14 user nova-compute[74776]: WARNING oslo_privsep.priv_context [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] privsep daemon already running
Nov 22 14:16:15 user nova-compute[74776]: DEBUG nova.network.neutron [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Successfully created port: 85404a03-3785-4381-96ac-6711e81395f9 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.212s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.224s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.181s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk 1073741824" returned: 0 in 0.049s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.217s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "4629d82d-fd02-4a58-a535-b362b493e7c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "98fb9b54-c428-4a48-b1ff-a976f971b764" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.166s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG nova.network.neutron [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Successfully created port: 5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.217s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65/disk 1073741824" returned: 0 in 0.058s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:16:15 user nova-compute[74776]: INFO nova.compute.claims [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Claim successful on node user
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Cannot resize image /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Ensure instance console log exists: /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.168s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Cannot resize image /opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Ensure instance console log exists: /opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.326s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:16:16 user nova-compute[74776]: INFO nova.compute.claims [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Claim successful on node user
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:16:16 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.policy [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f703bfbe762447778429bda22b74505c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3958d7be91b4bb1b9e314d8867cd8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:16:16 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Creating image(s)
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "/opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "/opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "/opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:16:16 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.167s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:16:16 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Creating image(s)
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "/opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "/opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "/opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.198s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG nova.policy [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '385e459f09fd41d4bba0ad13430dc0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92fd48cf9c34eac867c14bf962c3a0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk 1073741824" returned: 0 in 0.048s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.188s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG nova.network.neutron [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Successfully updated port: 5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.366s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquired lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG nova.network.neutron [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.204s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk 1073741824" returned: 0 in 0.052s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Cannot resize image /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Ensure instance console log exists: /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG nova.network.neutron [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-d2b2443e-5670-45e4-a782-117bee567b0a req-67b20adf-19bc-4dad-b183-1cbefb1c63a6 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received event network-changed-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-d2b2443e-5670-45e4-a782-117bee567b0a req-67b20adf-19bc-4dad-b183-1cbefb1c63a6 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Refreshing instance network info cache due to event network-changed-5911a175-03ae-4ed9-8c40-fc54c69233b4. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2b2443e-5670-45e4-a782-117bee567b0a req-67b20adf-19bc-4dad-b183-1cbefb1c63a6 service nova] Acquiring lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.187s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Cannot resize image /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Ensure instance console log exists: /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Successfully created port: abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.network.neutron [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Updating instance_info_cache with network_info: [{"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Releasing lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.compute.manager [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Instance network_info: |[{"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2b2443e-5670-45e4-a782-117bee567b0a req-67b20adf-19bc-4dad-b183-1cbefb1c63a6 service nova] Acquired lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.network.neutron [req-d2b2443e-5670-45e4-a782-117bee567b0a req-67b20adf-19bc-4dad-b183-1cbefb1c63a6 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Refreshing network info cache for port 5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Start _get_guest_xml network_info=[{"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:16:18 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:16:18 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.privsep.utils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74776) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1644694208',display_name='tempest-ServerActionsTestOtherB-server-1644694208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1644694208',id=2,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNubZ7Gk5h0q4OD6Enksl8Cxk/zzd+sbOwMvtIBBZUt9W+DL2N76A0FAo5K8lTdtosYaw4CTfnxfM5nY6xMBLxjo0J1fnDDgRvxTybxKH1mCAazzdEjSajoOw371LIwgmw==',key_name='tempest-keypair-1933513143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba1b35da14434fa09c3331d9c44d63fb',ramdisk_id='',reservation_id='r-fmg969sn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1073417585',owner_user_name='tempest-ServerActionsTestOtherB-1073417585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84f6a2d2d72f42f1ba0ee9b623a0a9ca',uuid=e96ab1bf-6f19-4e5f-b79d-f0266988090b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Converting VIF {"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:46:f7,bridge_name='br-int',has_traffic_filtering=True,id=5911a175-03ae-4ed9-8c40-fc54c69233b4,network=Network(1287337f-aeac-4c5f-a6f0-3af84b13c33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5911a175-03') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.objects.instance [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lazy-loading 'pci_devices' on Instance uuid e96ab1bf-6f19-4e5f-b79d-f0266988090b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:16:18 user nova-compute[74776]:   <uuid>e96ab1bf-6f19-4e5f-b79d-f0266988090b</uuid>
Nov 22 14:16:18 user nova-compute[74776]:   <name>instance-00000002</name>
Nov 22 14:16:18 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:16:18 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:16:18 user nova-compute[74776]:   <metadata>
Nov 22 14:16:18 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:16:18 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:16:18 user nova-compute[74776]:       <nova:name>tempest-ServerActionsTestOtherB-server-1644694208</nova:name>
Nov 22 14:16:18 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:16:18</nova:creationTime>
Nov 22 14:16:18 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:16:18 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:16:18 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:16:18 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:16:18 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:16:18 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:16:18 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:16:18 user nova-compute[74776]:       <nova:owner>
Nov 22 14:16:18 user nova-compute[74776]:         <nova:user uuid="84f6a2d2d72f42f1ba0ee9b623a0a9ca">tempest-ServerActionsTestOtherB-1073417585-project-member</nova:user>
Nov 22 14:16:18 user nova-compute[74776]:         <nova:project uuid="ba1b35da14434fa09c3331d9c44d63fb">tempest-ServerActionsTestOtherB-1073417585</nova:project>
Nov 22 14:16:18 user nova-compute[74776]:       </nova:owner>
Nov 22 14:16:18 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:16:18 user nova-compute[74776]:       <nova:ports>
Nov 22 14:16:18 user nova-compute[74776]:         <nova:port uuid="5911a175-03ae-4ed9-8c40-fc54c69233b4">
Nov 22 14:16:18 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 22 14:16:18 user nova-compute[74776]:         </nova:port>
Nov 22 14:16:18 user nova-compute[74776]:       </nova:ports>
Nov 22 14:16:18 user nova-compute[74776]:     </nova:instance>
Nov 22 14:16:18 user nova-compute[74776]:   </metadata>
Nov 22 14:16:18 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:16:18 user nova-compute[74776]:     <system>
Nov 22 14:16:18 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:16:18 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:16:18 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:16:18 user nova-compute[74776]:       <entry name="serial">e96ab1bf-6f19-4e5f-b79d-f0266988090b</entry>
Nov 22 14:16:18 user nova-compute[74776]:       <entry name="uuid">e96ab1bf-6f19-4e5f-b79d-f0266988090b</entry>
Nov 22 14:16:18 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:16:18 user nova-compute[74776]:     </system>
Nov 22 14:16:18 user nova-compute[74776]:   </sysinfo>
Nov 22 14:16:18 user nova-compute[74776]:   <os>
Nov 22 14:16:18 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:16:18 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:16:18 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:16:18 user nova-compute[74776]:   </os>
Nov 22 14:16:18 user nova-compute[74776]:   <features>
Nov 22 14:16:18 user nova-compute[74776]:     <acpi/>
Nov 22 14:16:18 user nova-compute[74776]:     <apic/>
Nov 22 14:16:18 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:16:18 user nova-compute[74776]:   </features>
Nov 22 14:16:18 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:16:18 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:16:18 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:16:18 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:16:18 user nova-compute[74776]:   </clock>
Nov 22 14:16:18 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:16:18 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:16:18 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:16:18 user nova-compute[74776]:   </cpu>
Nov 22 14:16:18 user nova-compute[74776]:   <devices>
Nov 22 14:16:18 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:16:18 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:16:18 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk"/>
Nov 22 14:16:18 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:16:18 user nova-compute[74776]:     </disk>
Nov 22 14:16:18 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:16:18 user nova-compute[74776]:       <mac address="fa:16:3e:b6:46:f7"/>
Nov 22 14:16:18 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:16:18 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:16:18 user nova-compute[74776]:       <target dev="tap5911a175-03"/>
Nov 22 14:16:18 user nova-compute[74776]:     </interface>
Nov 22 14:16:18 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:16:18 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/console.log" append="off"/>
Nov 22 14:16:18 user nova-compute[74776]:     </serial>
Nov 22 14:16:18 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:16:18 user nova-compute[74776]:     <video>
Nov 22 14:16:18 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:16:18 user nova-compute[74776]:     </video>
Nov 22 14:16:18 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:16:18 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:16:18 user nova-compute[74776]:     </rng>
Nov 22 14:16:18 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:16:18 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:16:18 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:16:18 user nova-compute[74776]:     </memballoon>
Nov 22 14:16:18 user nova-compute[74776]:   </devices>
Nov 22 14:16:18 user nova-compute[74776]: </domain>
Nov 22 14:16:18 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1644694208',display_name='tempest-ServerActionsTestOtherB-server-1644694208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1644694208',id=2,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNubZ7Gk5h0q4OD6Enksl8Cxk/zzd+sbOwMvtIBBZUt9W+DL2N76A0FAo5K8lTdtosYaw4CTfnxfM5nY6xMBLxjo0J1fnDDgRvxTybxKH1mCAazzdEjSajoOw371LIwgmw==',key_name='tempest-keypair-1933513143',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba1b35da14434fa09c3331d9c44d63fb',ramdisk_id='',reservation_id='r-fmg969sn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1073417585',owner_user_name='tempest-ServerActionsTestOtherB-1073417585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84f6a2d2d72f42f1ba0ee9b623a0a9ca',uuid=e96ab1bf-6f19-4e5f-b79d-f0266988090b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Converting VIF {"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:46:f7,bridge_name='br-int',has_traffic_filtering=True,id=5911a175-03ae-4ed9-8c40-fc54c69233b4,network=Network(1287337f-aeac-4c5f-a6f0-3af84b13c33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5911a175-03') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG os_vif [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:46:f7,bridge_name='br-int',has_traffic_filtering=True,id=5911a175-03ae-4ed9-8c40-fc54c69233b4,network=Network(1287337f-aeac-4c5f-a6f0-3af84b13c33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5911a175-03') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Successfully created port: dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.network.neutron [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Successfully updated port: 85404a03-3785-4381-96ac-6711e81395f9 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Created schema index Interface.name {{(pid=74776) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Created schema index Port.name {{(pid=74776) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Created schema index Bridge.name {{(pid=74776) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [POLLOUT] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Acquiring lock "refresh_cache-d13dd041-8289-4a8b-93a1-bf3e491b9e65" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Acquired lock "refresh_cache-d13dd041-8289-4a8b-93a1-bf3e491b9e65" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG nova.network.neutron [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c74d6a55-b22d-59ad-82db-70b347dcfa06', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:16:18 user nova-compute[74776]: INFO oslo.privsep.daemon [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpz5a6dtmq/privsep.sock']
Nov 22 14:16:18 user sudo[84113]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpz5a6dtmq/privsep.sock
Nov 22 14:16:18 user sudo[84113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 22 14:16:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-f1487b3c-dd2e-4c94-9ef3-6bfb9b3bda80 req-7e2005b9-b171-47fd-af7f-0387f3547774 service nova] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Received event network-changed-85404a03-3785-4381-96ac-6711e81395f9 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:16:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-f1487b3c-dd2e-4c94-9ef3-6bfb9b3bda80 req-7e2005b9-b171-47fd-af7f-0387f3547774 service nova] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Refreshing instance network info cache due to event network-changed-85404a03-3785-4381-96ac-6711e81395f9. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:16:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f1487b3c-dd2e-4c94-9ef3-6bfb9b3bda80 req-7e2005b9-b171-47fd-af7f-0387f3547774 service nova] Acquiring lock "refresh_cache-d13dd041-8289-4a8b-93a1-bf3e491b9e65" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:16:19 user nova-compute[74776]: DEBUG nova.network.neutron [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:16:19 user nova-compute[74776]: DEBUG nova.network.neutron [req-d2b2443e-5670-45e4-a782-117bee567b0a req-67b20adf-19bc-4dad-b183-1cbefb1c63a6 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Updated VIF entry in instance network info cache for port 5911a175-03ae-4ed9-8c40-fc54c69233b4. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:16:19 user nova-compute[74776]: DEBUG nova.network.neutron [req-d2b2443e-5670-45e4-a782-117bee567b0a req-67b20adf-19bc-4dad-b183-1cbefb1c63a6 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Updating instance_info_cache with network_info: [{"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:16:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2b2443e-5670-45e4-a782-117bee567b0a req-67b20adf-19bc-4dad-b183-1cbefb1c63a6 service nova] Releasing lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:16:19 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Successfully updated port: abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:16:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:16:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquired lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:16:19 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:16:19 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:16:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-73ac9975-5259-427a-89f5-5abac1374e7d req-553ffde1-cd87-42a8-962d-f805b3343874 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Received event network-changed-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:16:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-73ac9975-5259-427a-89f5-5abac1374e7d req-553ffde1-cd87-42a8-962d-f805b3343874 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Refreshing instance network info cache due to event network-changed-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:16:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-73ac9975-5259-427a-89f5-5abac1374e7d req-553ffde1-cd87-42a8-962d-f805b3343874 service nova] Acquiring lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.network.neutron [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Updating instance_info_cache with network_info: [{"id": "85404a03-3785-4381-96ac-6711e81395f9", "address": "fa:16:3e:10:c7:a0", "network": {"id": "696ca276-acaf-4f2d-85b8-8afd52ce4742", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1692508702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc86266374d46f9b40654b2090067b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85404a03-37", "ovs_interfaceid": "85404a03-3785-4381-96ac-6711e81395f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Releasing lock "refresh_cache-d13dd041-8289-4a8b-93a1-bf3e491b9e65" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Instance network_info: |[{"id": "85404a03-3785-4381-96ac-6711e81395f9", "address": "fa:16:3e:10:c7:a0", "network": {"id": "696ca276-acaf-4f2d-85b8-8afd52ce4742", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1692508702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc86266374d46f9b40654b2090067b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85404a03-37", "ovs_interfaceid": "85404a03-3785-4381-96ac-6711e81395f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f1487b3c-dd2e-4c94-9ef3-6bfb9b3bda80 req-7e2005b9-b171-47fd-af7f-0387f3547774 service nova] Acquired lock "refresh_cache-d13dd041-8289-4a8b-93a1-bf3e491b9e65" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.network.neutron [req-f1487b3c-dd2e-4c94-9ef3-6bfb9b3bda80 req-7e2005b9-b171-47fd-af7f-0387f3547774 service nova] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Refreshing network info cache for port 85404a03-3785-4381-96ac-6711e81395f9 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Start _get_guest_xml network_info=[{"id": "85404a03-3785-4381-96ac-6711e81395f9", "address": "fa:16:3e:10:c7:a0", "network": {"id": "696ca276-acaf-4f2d-85b8-8afd52ce4742", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1692508702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc86266374d46f9b40654b2090067b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85404a03-37", "ovs_interfaceid": "85404a03-3785-4381-96ac-6711e81395f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Successfully updated port: dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:16:20 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:16:20 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:16:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquired lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1196876710',display_name='tempest-DeleteServersTestJSON-server-1196876710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1196876710',id=1,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bdc86266374d46f9b40654b2090067b0',ramdisk_id='',reservation_id='r-y07gkdoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-734096284',owner_user_name='tempest-DeleteServersTestJSON-734096284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:16:12Z,user_data=None,user_id='f57c323128d14050b648a6bd24cace89',uuid=d13dd041-8289-4a8b-93a1-bf3e491b9e65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85404a03-3785-4381-96ac-6711e81395f9", "address": "fa:16:3e:10:c7:a0", "network": {"id": "696ca276-acaf-4f2d-85b8-8afd52ce4742", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1692508702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc86266374d46f9b40654b2090067b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85404a03-37", "ovs_interfaceid": "85404a03-3785-4381-96ac-6711e81395f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Converting VIF {"id": "85404a03-3785-4381-96ac-6711e81395f9", "address": "fa:16:3e:10:c7:a0", "network": {"id": "696ca276-acaf-4f2d-85b8-8afd52ce4742", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1692508702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc86266374d46f9b40654b2090067b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85404a03-37", "ovs_interfaceid": "85404a03-3785-4381-96ac-6711e81395f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:c7:a0,bridge_name='br-int',has_traffic_filtering=True,id=85404a03-3785-4381-96ac-6711e81395f9,network=Network(696ca276-acaf-4f2d-85b8-8afd52ce4742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85404a03-37') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.objects.instance [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lazy-loading 'pci_devices' on Instance uuid d13dd041-8289-4a8b-93a1-bf3e491b9e65 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:16:20 user nova-compute[74776]:   <uuid>d13dd041-8289-4a8b-93a1-bf3e491b9e65</uuid>
Nov 22 14:16:20 user nova-compute[74776]:   <name>instance-00000001</name>
Nov 22 14:16:20 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:16:20 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:16:20 user nova-compute[74776]:   <metadata>
Nov 22 14:16:20 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:16:20 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:16:20 user nova-compute[74776]:       <nova:name>tempest-DeleteServersTestJSON-server-1196876710</nova:name>
Nov 22 14:16:20 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:16:20</nova:creationTime>
Nov 22 14:16:20 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:16:20 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:16:20 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:16:20 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:16:20 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:16:20 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:16:20 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:16:20 user nova-compute[74776]:       <nova:owner>
Nov 22 14:16:20 user nova-compute[74776]:         <nova:user uuid="f57c323128d14050b648a6bd24cace89">tempest-DeleteServersTestJSON-734096284-project-member</nova:user>
Nov 22 14:16:20 user nova-compute[74776]:         <nova:project uuid="bdc86266374d46f9b40654b2090067b0">tempest-DeleteServersTestJSON-734096284</nova:project>
Nov 22 14:16:20 user nova-compute[74776]:       </nova:owner>
Nov 22 14:16:20 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:16:20 user nova-compute[74776]:       <nova:ports>
Nov 22 14:16:20 user nova-compute[74776]:         <nova:port uuid="85404a03-3785-4381-96ac-6711e81395f9">
Nov 22 14:16:20 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 14:16:20 user nova-compute[74776]:         </nova:port>
Nov 22 14:16:20 user nova-compute[74776]:       </nova:ports>
Nov 22 14:16:20 user nova-compute[74776]:     </nova:instance>
Nov 22 14:16:20 user nova-compute[74776]:   </metadata>
Nov 22 14:16:20 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:16:20 user nova-compute[74776]:     <system>
Nov 22 14:16:20 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:16:20 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:16:20 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:16:20 user nova-compute[74776]:       <entry name="serial">d13dd041-8289-4a8b-93a1-bf3e491b9e65</entry>
Nov 22 14:16:20 user nova-compute[74776]:       <entry name="uuid">d13dd041-8289-4a8b-93a1-bf3e491b9e65</entry>
Nov 22 14:16:20 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:16:20 user nova-compute[74776]:     </system>
Nov 22 14:16:20 user nova-compute[74776]:   </sysinfo>
Nov 22 14:16:20 user nova-compute[74776]:   <os>
Nov 22 14:16:20 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:16:20 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:16:20 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:16:20 user nova-compute[74776]:   </os>
Nov 22 14:16:20 user nova-compute[74776]:   <features>
Nov 22 14:16:20 user nova-compute[74776]:     <acpi/>
Nov 22 14:16:20 user nova-compute[74776]:     <apic/>
Nov 22 14:16:20 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:16:20 user nova-compute[74776]:   </features>
Nov 22 14:16:20 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:16:20 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:16:20 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:16:20 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:16:20 user nova-compute[74776]:   </clock>
Nov 22 14:16:20 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:16:20 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:16:20 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:16:20 user nova-compute[74776]:   </cpu>
Nov 22 14:16:20 user nova-compute[74776]:   <devices>
Nov 22 14:16:20 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:16:20 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:16:20 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65/disk"/>
Nov 22 14:16:20 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:16:20 user nova-compute[74776]:     </disk>
Nov 22 14:16:20 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:16:20 user nova-compute[74776]:       <mac address="fa:16:3e:10:c7:a0"/>
Nov 22 14:16:20 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:16:20 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:16:20 user nova-compute[74776]:       <target dev="tap85404a03-37"/>
Nov 22 14:16:20 user nova-compute[74776]:     </interface>
Nov 22 14:16:20 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:16:20 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65/console.log" append="off"/>
Nov 22 14:16:20 user nova-compute[74776]:     </serial>
Nov 22 14:16:20 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:16:20 user nova-compute[74776]:     <video>
Nov 22 14:16:20 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:16:20 user nova-compute[74776]:     </video>
Nov 22 14:16:20 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:16:20 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:16:20 user nova-compute[74776]:     </rng>
Nov 22 14:16:20 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:16:20 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:16:20 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:16:20 user nova-compute[74776]:     </memballoon>
Nov 22 14:16:20 user nova-compute[74776]:   </devices>
Nov 22 14:16:20 user nova-compute[74776]: </domain>
Nov 22 14:16:20 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1196876710',display_name='tempest-DeleteServersTestJSON-server-1196876710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1196876710',id=1,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bdc86266374d46f9b40654b2090067b0',ramdisk_id='',reservation_id='r-y07gkdoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-734096284',owner_user_name='tempest-DeleteServersTestJSON-734096284-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:16:12Z,user_data=None,user_id='f57c323128d14050b648a6bd24cace89',uuid=d13dd041-8289-4a8b-93a1-bf3e491b9e65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85404a03-3785-4381-96ac-6711e81395f9", "address": "fa:16:3e:10:c7:a0", "network": {"id": "696ca276-acaf-4f2d-85b8-8afd52ce4742", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1692508702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc86266374d46f9b40654b2090067b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85404a03-37", "ovs_interfaceid": "85404a03-3785-4381-96ac-6711e81395f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Converting VIF {"id": "85404a03-3785-4381-96ac-6711e81395f9", "address": "fa:16:3e:10:c7:a0", "network": {"id": "696ca276-acaf-4f2d-85b8-8afd52ce4742", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1692508702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc86266374d46f9b40654b2090067b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85404a03-37", "ovs_interfaceid": "85404a03-3785-4381-96ac-6711e81395f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:c7:a0,bridge_name='br-int',has_traffic_filtering=True,id=85404a03-3785-4381-96ac-6711e81395f9,network=Network(696ca276-acaf-4f2d-85b8-8afd52ce4742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85404a03-37') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG os_vif [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:c7:a0,bridge_name='br-int',has_traffic_filtering=True,id=85404a03-3785-4381-96ac-6711e81395f9,network=Network(696ca276-acaf-4f2d-85b8-8afd52ce4742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85404a03-37') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e229c09-dd68-51c9-8375-980093955f72', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Updating instance_info_cache with network_info: [{"id": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "address": "fa:16:3e:a5:87:db", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabaa3c9b-98", "ovs_interfaceid": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Releasing lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Instance network_info: |[{"id": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "address": "fa:16:3e:a5:87:db", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabaa3c9b-98", "ovs_interfaceid": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-732a63e5-ff72-42ea-b209-1702705afab0 req-420fd055-cd7f-4cb9-91ca-52dbdbdbe95d service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received event network-changed-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-732a63e5-ff72-42ea-b209-1702705afab0 req-420fd055-cd7f-4cb9-91ca-52dbdbdbe95d service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Refreshing instance network info cache due to event network-changed-dd255982-4c19-4bf3-b01c-ba063b6f561e. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-732a63e5-ff72-42ea-b209-1702705afab0 req-420fd055-cd7f-4cb9-91ca-52dbdbdbe95d service nova] Acquiring lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-73ac9975-5259-427a-89f5-5abac1374e7d req-553ffde1-cd87-42a8-962d-f805b3343874 service nova] Acquired lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.network.neutron [req-73ac9975-5259-427a-89f5-5abac1374e7d req-553ffde1-cd87-42a8-962d-f805b3343874 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Refreshing network info cache for port abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Start _get_guest_xml network_info=[{"id": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "address": "fa:16:3e:a5:87:db", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabaa3c9b-98", "ovs_interfaceid": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:16:20 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:16:20 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:16:20 user sudo[84113]: pam_unix(sudo:session): session closed for user root
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1566459201',display_name='tempest-ServerActionsTestOtherA-server-1566459201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1566459201',id=3,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+0/ONa93QEWt5XODlWdDhT3U9g8+KkiNeYX5RdCfVnODI9hDpQVCexgtOudugmxzZAzaK3M5HeFwSkQ11sjSni+XdF+kkALoXukp/BrvBbOU8ZVGgWEOMKJnkhO9ZxRw==',key_name='tempest-keypair-1736172995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3958d7be91b4bb1b9e314d8867cd8f5',ramdisk_id='',reservation_id='r-mvhea8kj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-109524404',owner_user_name='tempest-ServerActionsTestOtherA-109524404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f703bfbe762447778429bda22b74505c',uuid=4629d82d-fd02-4a58-a535-b362b493e7c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "address": "fa:16:3e:a5:87:db", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabaa3c9b-98", "ovs_interfaceid": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converting VIF {"id": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "address": "fa:16:3e:a5:87:db", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabaa3c9b-98", "ovs_interfaceid": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:87:db,bridge_name='br-int',has_traffic_filtering=True,id=abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabaa3c9b-98') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.objects.instance [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lazy-loading 'pci_devices' on Instance uuid 4629d82d-fd02-4a58-a535-b362b493e7c0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:16:20 user nova-compute[74776]: INFO oslo.privsep.daemon [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Spawned new privsep daemon via rootwrap
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:16:20 user nova-compute[74776]:   <uuid>4629d82d-fd02-4a58-a535-b362b493e7c0</uuid>
Nov 22 14:16:20 user nova-compute[74776]:   <name>instance-00000003</name>
Nov 22 14:16:20 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:16:20 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:16:20 user nova-compute[74776]:   <metadata>
Nov 22 14:16:20 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:16:20 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:16:20 user nova-compute[74776]:       <nova:name>tempest-ServerActionsTestOtherA-server-1566459201</nova:name>
Nov 22 14:16:20 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:16:20</nova:creationTime>
Nov 22 14:16:20 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:16:20 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:16:20 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:16:20 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:16:20 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:16:20 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:16:20 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:16:20 user nova-compute[74776]:       <nova:owner>
Nov 22 14:16:20 user nova-compute[74776]:         <nova:user uuid="f703bfbe762447778429bda22b74505c">tempest-ServerActionsTestOtherA-109524404-project-member</nova:user>
Nov 22 14:16:20 user nova-compute[74776]:         <nova:project uuid="a3958d7be91b4bb1b9e314d8867cd8f5">tempest-ServerActionsTestOtherA-109524404</nova:project>
Nov 22 14:16:20 user nova-compute[74776]:       </nova:owner>
Nov 22 14:16:20 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:16:20 user nova-compute[74776]:       <nova:ports>
Nov 22 14:16:20 user nova-compute[74776]:         <nova:port uuid="abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a">
Nov 22 14:16:20 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 14:16:20 user nova-compute[74776]:         </nova:port>
Nov 22 14:16:20 user nova-compute[74776]:       </nova:ports>
Nov 22 14:16:20 user nova-compute[74776]:     </nova:instance>
Nov 22 14:16:20 user nova-compute[74776]:   </metadata>
Nov 22 14:16:20 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:16:20 user nova-compute[74776]:     <system>
Nov 22 14:16:20 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:16:20 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:16:20 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:16:20 user nova-compute[74776]:       <entry name="serial">4629d82d-fd02-4a58-a535-b362b493e7c0</entry>
Nov 22 14:16:20 user nova-compute[74776]:       <entry name="uuid">4629d82d-fd02-4a58-a535-b362b493e7c0</entry>
Nov 22 14:16:20 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:16:20 user nova-compute[74776]:     </system>
Nov 22 14:16:20 user nova-compute[74776]:   </sysinfo>
Nov 22 14:16:20 user nova-compute[74776]:   <os>
Nov 22 14:16:20 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:16:20 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:16:20 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:16:20 user nova-compute[74776]:   </os>
Nov 22 14:16:20 user nova-compute[74776]:   <features>
Nov 22 14:16:20 user nova-compute[74776]:     <acpi/>
Nov 22 14:16:20 user nova-compute[74776]:     <apic/>
Nov 22 14:16:20 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:16:20 user nova-compute[74776]:   </features>
Nov 22 14:16:20 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:16:20 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:16:20 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:16:20 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:16:20 user nova-compute[74776]:   </clock>
Nov 22 14:16:20 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:16:20 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:16:20 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:16:20 user nova-compute[74776]:   </cpu>
Nov 22 14:16:20 user nova-compute[74776]:   <devices>
Nov 22 14:16:20 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:16:20 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:16:20 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk"/>
Nov 22 14:16:20 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:16:20 user nova-compute[74776]:     </disk>
Nov 22 14:16:20 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:16:20 user nova-compute[74776]:       <mac address="fa:16:3e:a5:87:db"/>
Nov 22 14:16:20 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:16:20 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:16:20 user nova-compute[74776]:       <target dev="tapabaa3c9b-98"/>
Nov 22 14:16:20 user nova-compute[74776]:     </interface>
Nov 22 14:16:20 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:16:20 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/console.log" append="off"/>
Nov 22 14:16:20 user nova-compute[74776]:     </serial>
Nov 22 14:16:20 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:16:20 user nova-compute[74776]:     <video>
Nov 22 14:16:20 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:16:20 user nova-compute[74776]:     </video>
Nov 22 14:16:20 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:16:20 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:16:20 user nova-compute[74776]:     </rng>
Nov 22 14:16:20 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:16:20 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:16:20 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:16:20 user nova-compute[74776]:     </memballoon>
Nov 22 14:16:20 user nova-compute[74776]:   </devices>
Nov 22 14:16:20 user nova-compute[74776]: </domain>
Nov 22 14:16:20 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1566459201',display_name='tempest-ServerActionsTestOtherA-server-1566459201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1566459201',id=3,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+0/ONa93QEWt5XODlWdDhT3U9g8+KkiNeYX5RdCfVnODI9hDpQVCexgtOudugmxzZAzaK3M5HeFwSkQ11sjSni+XdF+kkALoXukp/BrvBbOU8ZVGgWEOMKJnkhO9ZxRw==',key_name='tempest-keypair-1736172995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3958d7be91b4bb1b9e314d8867cd8f5',ramdisk_id='',reservation_id='r-mvhea8kj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-109524404',owner_user_name='tempest-ServerActionsTestOtherA-109524404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f703bfbe762447778429bda22b74505c',uuid=4629d82d-fd02-4a58-a535-b362b493e7c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "address": "fa:16:3e:a5:87:db", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabaa3c9b-98", "ovs_interfaceid": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converting VIF {"id": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "address": "fa:16:3e:a5:87:db", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabaa3c9b-98", "ovs_interfaceid": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:87:db,bridge_name='br-int',has_traffic_filtering=True,id=abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabaa3c9b-98') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG os_vif [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:87:db,bridge_name='br-int',has_traffic_filtering=True,id=abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabaa3c9b-98') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:16:20 user nova-compute[74776]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 22 14:16:20 user nova-compute[74776]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 22 14:16:20 user nova-compute[74776]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 22 14:16:20 user nova-compute[74776]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84116
Nov 22 14:16:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2121c8e9-08de-5680-bf56-8403ca5ede0e', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:20 user nova-compute[74776]: WARNING oslo_privsep.priv_context [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] privsep daemon already running
Nov 22 14:16:20 user nova-compute[74776]: WARNING oslo_privsep.priv_context [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] privsep daemon already running
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.network.neutron [req-73ac9975-5259-427a-89f5-5abac1374e7d req-553ffde1-cd87-42a8-962d-f805b3343874 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Updated VIF entry in instance network info cache for port abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.network.neutron [req-73ac9975-5259-427a-89f5-5abac1374e7d req-553ffde1-cd87-42a8-962d-f805b3343874 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Updating instance_info_cache with network_info: [{"id": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "address": "fa:16:3e:a5:87:db", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabaa3c9b-98", "ovs_interfaceid": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-73ac9975-5259-427a-89f5-5abac1374e7d req-553ffde1-cd87-42a8-962d-f805b3343874 service nova] Releasing lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5911a175-03, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5911a175-03, col_values=(('qos', UUID('cdf47b0b-03ef-4c53-80aa-01c6dee1bb42')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5911a175-03, col_values=(('external_ids', {'iface-id': '5911a175-03ae-4ed9-8c40-fc54c69233b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:46:f7', 'vm-uuid': 'e96ab1bf-6f19-4e5f-b79d-f0266988090b'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:21 user nova-compute[74776]: INFO os_vif [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:46:f7,bridge_name='br-int',has_traffic_filtering=True,id=5911a175-03ae-4ed9-8c40-fc54c69233b4,network=Network(1287337f-aeac-4c5f-a6f0-3af84b13c33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5911a175-03')
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85404a03-37, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85404a03-37, col_values=(('qos', UUID('46e28774-a2a7-47a4-89c8-df564fd815e0')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85404a03-37, col_values=(('external_ids', {'iface-id': '85404a03-3785-4381-96ac-6711e81395f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:c7:a0', 'vm-uuid': 'd13dd041-8289-4a8b-93a1-bf3e491b9e65'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:21 user nova-compute[74776]: INFO os_vif [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:c7:a0,bridge_name='br-int',has_traffic_filtering=True,id=85404a03-3785-4381-96ac-6711e81395f9,network=Network(696ca276-acaf-4f2d-85b8-8afd52ce4742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85404a03-37')
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabaa3c9b-98, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapabaa3c9b-98, col_values=(('qos', UUID('0264a8d2-4325-46f8-a14c-e8bd42e324fc')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapabaa3c9b-98, col_values=(('external_ids', {'iface-id': 'abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:87:db', 'vm-uuid': '4629d82d-fd02-4a58-a535-b362b493e7c0'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:21 user nova-compute[74776]: INFO os_vif [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:87:db,bridge_name='br-int',has_traffic_filtering=True,id=abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabaa3c9b-98')
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] No VIF found with MAC fa:16:3e:b6:46:f7, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] No VIF found with MAC fa:16:3e:10:c7:a0, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] No VIF found with MAC fa:16:3e:a5:87:db, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.network.neutron [req-f1487b3c-dd2e-4c94-9ef3-6bfb9b3bda80 req-7e2005b9-b171-47fd-af7f-0387f3547774 service nova] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Updated VIF entry in instance network info cache for port 85404a03-3785-4381-96ac-6711e81395f9. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.network.neutron [req-f1487b3c-dd2e-4c94-9ef3-6bfb9b3bda80 req-7e2005b9-b171-47fd-af7f-0387f3547774 service nova] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Updating instance_info_cache with network_info: [{"id": "85404a03-3785-4381-96ac-6711e81395f9", "address": "fa:16:3e:10:c7:a0", "network": {"id": "696ca276-acaf-4f2d-85b8-8afd52ce4742", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1692508702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc86266374d46f9b40654b2090067b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85404a03-37", "ovs_interfaceid": "85404a03-3785-4381-96ac-6711e81395f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Updating instance_info_cache with network_info: [{"id": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "address": "fa:16:3e:7c:6e:68", "network": {"id": "32c8e7a3-6995-4931-ad2d-e8c3eb351538", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92fd48cf9c34eac867c14bf962c3a0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd255982-4c", "ovs_interfaceid": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f1487b3c-dd2e-4c94-9ef3-6bfb9b3bda80 req-7e2005b9-b171-47fd-af7f-0387f3547774 service nova] Releasing lock "refresh_cache-d13dd041-8289-4a8b-93a1-bf3e491b9e65" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Releasing lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Instance network_info: |[{"id": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "address": "fa:16:3e:7c:6e:68", "network": {"id": "32c8e7a3-6995-4931-ad2d-e8c3eb351538", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92fd48cf9c34eac867c14bf962c3a0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd255982-4c", "ovs_interfaceid": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-732a63e5-ff72-42ea-b209-1702705afab0 req-420fd055-cd7f-4cb9-91ca-52dbdbdbe95d service nova] Acquired lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.network.neutron [req-732a63e5-ff72-42ea-b209-1702705afab0 req-420fd055-cd7f-4cb9-91ca-52dbdbdbe95d service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Refreshing network info cache for port dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Start _get_guest_xml network_info=[{"id": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "address": "fa:16:3e:7c:6e:68", "network": {"id": "32c8e7a3-6995-4931-ad2d-e8c3eb351538", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92fd48cf9c34eac867c14bf962c3a0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd255982-4c", "ovs_interfaceid": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:21 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:16:21 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-804906559',display_name='tempest-ServerStableDeviceRescueTest-server-804906559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-804906559',id=4,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAszFWs96WQDQ4zYntrFAx3Zcw0snWwm1TTQJlxZEpXPnyU1gHlkBcEFtwU06oa8C/AZE8SlO743T94XNGt69XQf2jZZS+I5C2FccEUKDASTvZnvk1o9fr1Z+E+wPYuW1Q==',key_name='tempest-keypair-1870049157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a92fd48cf9c34eac867c14bf962c3a0c',ramdisk_id='',reservation_id='r-s4c0loch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1477734383',owner_user_name='tempest-ServerStableDeviceRescueTest-1477734383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:16:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='385e459f09fd41d4bba0ad13430dc0fd',uuid=98fb9b54-c428-4a48-b1ff-a976f971b764,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "address": "fa:16:3e:7c:6e:68", "network": {"id": "32c8e7a3-6995-4931-ad2d-e8c3eb351538", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92fd48cf9c34eac867c14bf962c3a0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd255982-4c", "ovs_interfaceid": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Converting VIF {"id": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "address": "fa:16:3e:7c:6e:68", "network": {"id": "32c8e7a3-6995-4931-ad2d-e8c3eb351538", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92fd48cf9c34eac867c14bf962c3a0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd255982-4c", "ovs_interfaceid": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6e:68,bridge_name='br-int',has_traffic_filtering=True,id=dd255982-4c19-4bf3-b01c-ba063b6f561e,network=Network(32c8e7a3-6995-4931-ad2d-e8c3eb351538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd255982-4c') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.objects.instance [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lazy-loading 'pci_devices' on Instance uuid 98fb9b54-c428-4a48-b1ff-a976f971b764 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:16:21 user nova-compute[74776]:   <uuid>98fb9b54-c428-4a48-b1ff-a976f971b764</uuid>
Nov 22 14:16:21 user nova-compute[74776]:   <name>instance-00000004</name>
Nov 22 14:16:21 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:16:21 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:16:21 user nova-compute[74776]:   <metadata>
Nov 22 14:16:21 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:16:21 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:16:21 user nova-compute[74776]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-804906559</nova:name>
Nov 22 14:16:21 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:16:21</nova:creationTime>
Nov 22 14:16:21 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:16:21 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:16:21 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:16:21 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:16:21 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:16:21 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:16:21 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:16:21 user nova-compute[74776]:       <nova:owner>
Nov 22 14:16:21 user nova-compute[74776]:         <nova:user uuid="385e459f09fd41d4bba0ad13430dc0fd">tempest-ServerStableDeviceRescueTest-1477734383-project-member</nova:user>
Nov 22 14:16:21 user nova-compute[74776]:         <nova:project uuid="a92fd48cf9c34eac867c14bf962c3a0c">tempest-ServerStableDeviceRescueTest-1477734383</nova:project>
Nov 22 14:16:21 user nova-compute[74776]:       </nova:owner>
Nov 22 14:16:21 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:16:21 user nova-compute[74776]:       <nova:ports>
Nov 22 14:16:21 user nova-compute[74776]:         <nova:port uuid="dd255982-4c19-4bf3-b01c-ba063b6f561e">
Nov 22 14:16:21 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 14:16:21 user nova-compute[74776]:         </nova:port>
Nov 22 14:16:21 user nova-compute[74776]:       </nova:ports>
Nov 22 14:16:21 user nova-compute[74776]:     </nova:instance>
Nov 22 14:16:21 user nova-compute[74776]:   </metadata>
Nov 22 14:16:21 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:16:21 user nova-compute[74776]:     <system>
Nov 22 14:16:21 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:16:21 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:16:21 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:16:21 user nova-compute[74776]:       <entry name="serial">98fb9b54-c428-4a48-b1ff-a976f971b764</entry>
Nov 22 14:16:21 user nova-compute[74776]:       <entry name="uuid">98fb9b54-c428-4a48-b1ff-a976f971b764</entry>
Nov 22 14:16:21 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:16:21 user nova-compute[74776]:     </system>
Nov 22 14:16:21 user nova-compute[74776]:   </sysinfo>
Nov 22 14:16:21 user nova-compute[74776]:   <os>
Nov 22 14:16:21 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:16:21 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:16:21 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:16:21 user nova-compute[74776]:   </os>
Nov 22 14:16:21 user nova-compute[74776]:   <features>
Nov 22 14:16:21 user nova-compute[74776]:     <acpi/>
Nov 22 14:16:21 user nova-compute[74776]:     <apic/>
Nov 22 14:16:21 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:16:21 user nova-compute[74776]:   </features>
Nov 22 14:16:21 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:16:21 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:16:21 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:16:21 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:16:21 user nova-compute[74776]:   </clock>
Nov 22 14:16:21 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:16:21 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:16:21 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:16:21 user nova-compute[74776]:   </cpu>
Nov 22 14:16:21 user nova-compute[74776]:   <devices>
Nov 22 14:16:21 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:16:21 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:16:21 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk"/>
Nov 22 14:16:21 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:16:21 user nova-compute[74776]:     </disk>
Nov 22 14:16:21 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:16:21 user nova-compute[74776]:       <mac address="fa:16:3e:7c:6e:68"/>
Nov 22 14:16:21 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:16:21 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:16:21 user nova-compute[74776]:       <target dev="tapdd255982-4c"/>
Nov 22 14:16:21 user nova-compute[74776]:     </interface>
Nov 22 14:16:21 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:16:21 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/console.log" append="off"/>
Nov 22 14:16:21 user nova-compute[74776]:     </serial>
Nov 22 14:16:21 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:16:21 user nova-compute[74776]:     <video>
Nov 22 14:16:21 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:16:21 user nova-compute[74776]:     </video>
Nov 22 14:16:21 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:16:21 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:16:21 user nova-compute[74776]:     </rng>
Nov 22 14:16:21 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:16:21 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:16:21 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:16:21 user nova-compute[74776]:     </memballoon>
Nov 22 14:16:21 user nova-compute[74776]:   </devices>
Nov 22 14:16:21 user nova-compute[74776]: </domain>
Nov 22 14:16:21 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-804906559',display_name='tempest-ServerStableDeviceRescueTest-server-804906559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-804906559',id=4,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAszFWs96WQDQ4zYntrFAx3Zcw0snWwm1TTQJlxZEpXPnyU1gHlkBcEFtwU06oa8C/AZE8SlO743T94XNGt69XQf2jZZS+I5C2FccEUKDASTvZnvk1o9fr1Z+E+wPYuW1Q==',key_name='tempest-keypair-1870049157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a92fd48cf9c34eac867c14bf962c3a0c',ramdisk_id='',reservation_id='r-s4c0loch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1477734383',owner_user_name='tempest-ServerStableDeviceRescueTest-1477734383-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:16:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='385e459f09fd41d4bba0ad13430dc0fd',uuid=98fb9b54-c428-4a48-b1ff-a976f971b764,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "address": "fa:16:3e:7c:6e:68", "network": {"id": "32c8e7a3-6995-4931-ad2d-e8c3eb351538", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92fd48cf9c34eac867c14bf962c3a0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd255982-4c", "ovs_interfaceid": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Converting VIF {"id": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "address": "fa:16:3e:7c:6e:68", "network": {"id": "32c8e7a3-6995-4931-ad2d-e8c3eb351538", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92fd48cf9c34eac867c14bf962c3a0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd255982-4c", "ovs_interfaceid": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6e:68,bridge_name='br-int',has_traffic_filtering=True,id=dd255982-4c19-4bf3-b01c-ba063b6f561e,network=Network(32c8e7a3-6995-4931-ad2d-e8c3eb351538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd255982-4c') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG os_vif [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6e:68,bridge_name='br-int',has_traffic_filtering=True,id=dd255982-4c19-4bf3-b01c-ba063b6f561e,network=Network(32c8e7a3-6995-4931-ad2d-e8c3eb351538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd255982-4c') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b8436486-e338-500d-8c5f-ed30e21b139b', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd255982-4c, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd255982-4c, col_values=(('qos', UUID('85df811a-9b0f-487f-9e94-18eeca7bfbbc')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd255982-4c, col_values=(('external_ids', {'iface-id': 'dd255982-4c19-4bf3-b01c-ba063b6f561e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:6e:68', 'vm-uuid': '98fb9b54-c428-4a48-b1ff-a976f971b764'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:21 user nova-compute[74776]: INFO os_vif [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6e:68,bridge_name='br-int',has_traffic_filtering=True,id=dd255982-4c19-4bf3-b01c-ba063b6f561e,network=Network(32c8e7a3-6995-4931-ad2d-e8c3eb351538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd255982-4c')
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] No VIF found with MAC fa:16:3e:7c:6e:68, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:16:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:22 user nova-compute[74776]: DEBUG nova.network.neutron [req-732a63e5-ff72-42ea-b209-1702705afab0 req-420fd055-cd7f-4cb9-91ca-52dbdbdbe95d service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Updated VIF entry in instance network info cache for port dd255982-4c19-4bf3-b01c-ba063b6f561e. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:16:22 user nova-compute[74776]: DEBUG nova.network.neutron [req-732a63e5-ff72-42ea-b209-1702705afab0 req-420fd055-cd7f-4cb9-91ca-52dbdbdbe95d service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Updating instance_info_cache with network_info: [{"id": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "address": "fa:16:3e:7c:6e:68", "network": {"id": "32c8e7a3-6995-4931-ad2d-e8c3eb351538", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92fd48cf9c34eac867c14bf962c3a0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd255982-4c", "ovs_interfaceid": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:16:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-732a63e5-ff72-42ea-b209-1702705afab0 req-420fd055-cd7f-4cb9-91ca-52dbdbdbe95d service nova] Releasing lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:16:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-3664250c-f7cf-4212-b072-cc3efdd247e4 req-d2fe5b95-f571-4511-82cf-b77435978560 service nova] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Received event network-vif-plugged-85404a03-3785-4381-96ac-6711e81395f9 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:16:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3664250c-f7cf-4212-b072-cc3efdd247e4 req-d2fe5b95-f571-4511-82cf-b77435978560 service nova] Acquiring lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3664250c-f7cf-4212-b072-cc3efdd247e4 req-d2fe5b95-f571-4511-82cf-b77435978560 service nova] Lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3664250c-f7cf-4212-b072-cc3efdd247e4 req-d2fe5b95-f571-4511-82cf-b77435978560 service nova] Lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-3664250c-f7cf-4212-b072-cc3efdd247e4 req-d2fe5b95-f571-4511-82cf-b77435978560 service nova] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] No waiting events found dispatching network-vif-plugged-85404a03-3785-4381-96ac-6711e81395f9 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:16:26 user nova-compute[74776]: WARNING nova.compute.manager [req-3664250c-f7cf-4212-b072-cc3efdd247e4 req-d2fe5b95-f571-4511-82cf-b77435978560 service nova] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Received unexpected event network-vif-plugged-85404a03-3785-4381-96ac-6711e81395f9 for instance with vm_state building and task_state spawning.
Nov 22 14:16:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Acquiring lock "232d8284-a99b-40c2-aa36-1de93a25729a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "232d8284-a99b-40c2-aa36-1de93a25729a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:26 user nova-compute[74776]: DEBUG nova.compute.manager [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:16:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:26 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:16:26 user nova-compute[74776]: INFO nova.compute.claims [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Claim successful on node user
Nov 22 14:16:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:27 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:16:27 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:16:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:16:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:16:27 user nova-compute[74776]: DEBUG nova.network.neutron [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:16:27 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 22 14:16:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:16:27 user nova-compute[74776]: DEBUG nova.policy [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a271783c7a5a4564815d0c837a811551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eea24586225438187a24cc3af0f800b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:16:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:16:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:16:27 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Creating image(s)
Nov 22 14:16:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Acquiring lock "/opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "/opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "/opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Acquiring lock "2b208d479aaa341ca0f705e8bcc8d48dc3c93e63" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "2b208d479aaa341ca0f705e8bcc8d48dc3c93e63" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b208d479aaa341ca0f705e8bcc8d48dc3c93e63.part --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b208d479aaa341ca0f705e8bcc8d48dc3c93e63.part --force-share --output=json" returned: 0 in 0.198s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:28 user nova-compute[74776]: DEBUG nova.virt.images [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] 1638bb8c-f36c-4d1b-ab22-67c3b2500095 was qcow2, converting to raw {{(pid=74776) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 14:16:28 user nova-compute[74776]: DEBUG nova.privsep.utils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74776) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 14:16:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2b208d479aaa341ca0f705e8bcc8d48dc3c93e63.part /opt/stack/data/nova/instances/_base/2b208d479aaa341ca0f705e8bcc8d48dc3c93e63.converted {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2b208d479aaa341ca0f705e8bcc8d48dc3c93e63.part /opt/stack/data/nova/instances/_base/2b208d479aaa341ca0f705e8bcc8d48dc3c93e63.converted" returned: 0 in 0.211s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b208d479aaa341ca0f705e8bcc8d48dc3c93e63.converted --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:28 user nova-compute[74776]: DEBUG nova.compute.manager [req-2ffa4158-d8e3-411b-ac49-58389b280bbd req-5192f289-c0f0-4c5f-aa59-eeba7366b3a8 service nova] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Received event network-vif-plugged-85404a03-3785-4381-96ac-6711e81395f9 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:16:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2ffa4158-d8e3-411b-ac49-58389b280bbd req-5192f289-c0f0-4c5f-aa59-eeba7366b3a8 service nova] Acquiring lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2ffa4158-d8e3-411b-ac49-58389b280bbd req-5192f289-c0f0-4c5f-aa59-eeba7366b3a8 service nova] Lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2ffa4158-d8e3-411b-ac49-58389b280bbd req-5192f289-c0f0-4c5f-aa59-eeba7366b3a8 service nova] Lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:28 user nova-compute[74776]: DEBUG nova.compute.manager [req-2ffa4158-d8e3-411b-ac49-58389b280bbd req-5192f289-c0f0-4c5f-aa59-eeba7366b3a8 service nova] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] No waiting events found dispatching network-vif-plugged-85404a03-3785-4381-96ac-6711e81395f9 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:16:28 user nova-compute[74776]: WARNING nova.compute.manager [req-2ffa4158-d8e3-411b-ac49-58389b280bbd req-5192f289-c0f0-4c5f-aa59-eeba7366b3a8 service nova] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Received unexpected event network-vif-plugged-85404a03-3785-4381-96ac-6711e81395f9 for instance with vm_state building and task_state spawning.
Nov 22 14:16:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b208d479aaa341ca0f705e8bcc8d48dc3c93e63.converted --force-share --output=json" returned: 0 in 0.230s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "2b208d479aaa341ca0f705e8bcc8d48dc3c93e63" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.230s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b208d479aaa341ca0f705e8bcc8d48dc3c93e63 --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:28 user nova-compute[74776]: DEBUG nova.network.neutron [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Successfully created port: b3675ad0-6dfc-4731-a999-a16801642163 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b208d479aaa341ca0f705e8bcc8d48dc3c93e63 --force-share --output=json" returned: 0 in 0.209s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Acquiring lock "2b208d479aaa341ca0f705e8bcc8d48dc3c93e63" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "2b208d479aaa341ca0f705e8bcc8d48dc3c93e63" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b208d479aaa341ca0f705e8bcc8d48dc3c93e63 --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b208d479aaa341ca0f705e8bcc8d48dc3c93e63 --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b208d479aaa341ca0f705e8bcc8d48dc3c93e63,backing_fmt=raw /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b208d479aaa341ca0f705e8bcc8d48dc3c93e63,backing_fmt=raw /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk 1073741824" returned: 0 in 0.073s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "2b208d479aaa341ca0f705e8bcc8d48dc3c93e63" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b208d479aaa341ca0f705e8bcc8d48dc3c93e63 --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b208d479aaa341ca0f705e8bcc8d48dc3c93e63 --force-share --output=json" returned: 0 in 0.212s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Checking if we can resize image /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Cannot resize image /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Ensure instance console log exists: /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:16:29 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Instance spawned successfully.
Nov 22 14:16:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG nova.network.neutron [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Successfully updated port: b3675ad0-6dfc-4731-a999-a16801642163 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Acquiring lock "refresh_cache-232d8284-a99b-40c2-aa36-1de93a25729a" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Acquired lock "refresh_cache-232d8284-a99b-40c2-aa36-1de93a25729a" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:16:29 user nova-compute[74776]: DEBUG nova.network.neutron [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:16:29 user nova-compute[74776]: INFO nova.compute.manager [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Took 17.58 seconds to spawn the instance on the hypervisor.
Nov 22 14:16:29 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.compute.manager [req-043a52a6-4341-4bd6-bf8d-315058e8c4b6 req-4da8833f-1971-4cdc-90b9-6c8de20c37c0 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Received event network-changed-b3675ad0-6dfc-4731-a999-a16801642163 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.compute.manager [req-043a52a6-4341-4bd6-bf8d-315058e8c4b6 req-4da8833f-1971-4cdc-90b9-6c8de20c37c0 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Refreshing instance network info cache due to event network-changed-b3675ad0-6dfc-4731-a999-a16801642163. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-043a52a6-4341-4bd6-bf8d-315058e8c4b6 req-4da8833f-1971-4cdc-90b9-6c8de20c37c0 service nova] Acquiring lock "refresh_cache-232d8284-a99b-40c2-aa36-1de93a25729a" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.network.neutron [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:16:30 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Instance spawned successfully.
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.compute.manager [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:16:30 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Instance spawned successfully.
Nov 22 14:16:30 user nova-compute[74776]: INFO nova.compute.manager [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Took 18.80 seconds to build instance.
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:30 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Instance spawned successfully.
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a3415010-b6e6-452f-96d1-402d26dfcf39 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.450s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.network.neutron [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Updating instance_info_cache with network_info: [{"id": "b3675ad0-6dfc-4731-a999-a16801642163", "address": "fa:16:3e:01:f2:5e", "network": {"id": "18a7dc3b-d85c-457d-81d2-0a49599e45ac", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-704035334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4eea24586225438187a24cc3af0f800b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3675ad0-6d", "ovs_interfaceid": "b3675ad0-6dfc-4731-a999-a16801642163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Releasing lock "refresh_cache-232d8284-a99b-40c2-aa36-1de93a25729a" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.compute.manager [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Instance network_info: |[{"id": "b3675ad0-6dfc-4731-a999-a16801642163", "address": "fa:16:3e:01:f2:5e", "network": {"id": "18a7dc3b-d85c-457d-81d2-0a49599e45ac", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-704035334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4eea24586225438187a24cc3af0f800b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3675ad0-6d", "ovs_interfaceid": "b3675ad0-6dfc-4731-a999-a16801642163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-043a52a6-4341-4bd6-bf8d-315058e8c4b6 req-4da8833f-1971-4cdc-90b9-6c8de20c37c0 service nova] Acquired lock "refresh_cache-232d8284-a99b-40c2-aa36-1de93a25729a" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.network.neutron [req-043a52a6-4341-4bd6-bf8d-315058e8c4b6 req-4da8833f-1971-4cdc-90b9-6c8de20c37c0 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Refreshing network info cache for port b3675ad0-6dfc-4731-a999-a16801642163 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Start _get_guest_xml network_info=[{"id": "b3675ad0-6dfc-4731-a999-a16801642163", "address": "fa:16:3e:01:f2:5e", "network": {"id": "18a7dc3b-d85c-457d-81d2-0a49599e45ac", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-704035334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4eea24586225438187a24cc3af0f800b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3675ad0-6d", "ovs_interfaceid": "b3675ad0-6dfc-4731-a999-a16801642163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:16:19Z,direct_url=<?>,disk_format='qcow2',id=1638bb8c-f36c-4d1b-ab22-67c3b2500095,min_disk=0,min_ram=0,name='',owner='ef28594565f94b39ad1e0cce226622d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:16:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '1638bb8c-f36c-4d1b-ab22-67c3b2500095'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:16:30 user nova-compute[74776]: INFO nova.compute.manager [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Took 14.02 seconds to spawn the instance on the hypervisor.
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:16:30 user nova-compute[74776]: INFO nova.compute.manager [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Took 15.96 seconds to spawn the instance on the hypervisor.
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.compute.manager [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:16:30 user nova-compute[74776]: INFO nova.compute.manager [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Took 13.80 seconds to spawn the instance on the hypervisor.
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:16:30 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:16:30 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:16:19Z,direct_url=<?>,disk_format='qcow2',id=1638bb8c-f36c-4d1b-ab22-67c3b2500095,min_disk=0,min_ram=0,name='',owner='ef28594565f94b39ad1e0cce226622d9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:16:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-331917364',display_name='tempest-AttachSCSIVolumeTestJSON-server-331917364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-331917364',id=5,image_ref='1638bb8c-f36c-4d1b-ab22-67c3b2500095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM03DEyNjAHttoQ0r+wlU4uKjwYHyIFVNlSo1JXiwIEAKK1no5H+fnR1WKHvch3FiM7sN22LyNxFK0dMMU6lkhZpwDMNlhWOONYuUezddU2Fv3eabuUiuNHj8Ar2SDW3SQ==',key_name='tempest-keypair-977328427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4eea24586225438187a24cc3af0f800b',ramdisk_id='',reservation_id='r-ngn8ht0i',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1638bb8c-f36c-4d1b-ab22-67c3b2500095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-933096826',owner_user_name='tempest-AttachSCSIVolumeTestJSON-933096826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:16:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a271783c7a5a4564815d0c837a811551',uuid=232d8284-a99b-40c2-aa36-1de93a25729a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3675ad0-6dfc-4731-a999-a16801642163", "address": "fa:16:3e:01:f2:5e", "network": {"id": "18a7dc3b-d85c-457d-81d2-0a49599e45ac", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-704035334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4eea24586225438187a24cc3af0f800b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3675ad0-6d", "ovs_interfaceid": "b3675ad0-6dfc-4731-a999-a16801642163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Converting VIF {"id": "b3675ad0-6dfc-4731-a999-a16801642163", "address": "fa:16:3e:01:f2:5e", "network": {"id": "18a7dc3b-d85c-457d-81d2-0a49599e45ac", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-704035334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4eea24586225438187a24cc3af0f800b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3675ad0-6d", "ovs_interfaceid": "b3675ad0-6dfc-4731-a999-a16801642163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:f2:5e,bridge_name='br-int',has_traffic_filtering=True,id=b3675ad0-6dfc-4731-a999-a16801642163,network=Network(18a7dc3b-d85c-457d-81d2-0a49599e45ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3675ad0-6d') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.objects.instance [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lazy-loading 'pci_devices' on Instance uuid 232d8284-a99b-40c2-aa36-1de93a25729a {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:16:30 user nova-compute[74776]:   <uuid>232d8284-a99b-40c2-aa36-1de93a25729a</uuid>
Nov 22 14:16:30 user nova-compute[74776]:   <name>instance-00000005</name>
Nov 22 14:16:30 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:16:30 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:16:30 user nova-compute[74776]:   <metadata>
Nov 22 14:16:30 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:16:30 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:16:30 user nova-compute[74776]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-331917364</nova:name>
Nov 22 14:16:30 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:16:30</nova:creationTime>
Nov 22 14:16:30 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:16:30 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:16:30 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:16:30 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:16:30 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:16:30 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:16:30 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:16:30 user nova-compute[74776]:       <nova:owner>
Nov 22 14:16:30 user nova-compute[74776]:         <nova:user uuid="a271783c7a5a4564815d0c837a811551">tempest-AttachSCSIVolumeTestJSON-933096826-project-member</nova:user>
Nov 22 14:16:30 user nova-compute[74776]:         <nova:project uuid="4eea24586225438187a24cc3af0f800b">tempest-AttachSCSIVolumeTestJSON-933096826</nova:project>
Nov 22 14:16:30 user nova-compute[74776]:       </nova:owner>
Nov 22 14:16:30 user nova-compute[74776]:       <nova:root type="image" uuid="1638bb8c-f36c-4d1b-ab22-67c3b2500095"/>
Nov 22 14:16:30 user nova-compute[74776]:       <nova:ports>
Nov 22 14:16:30 user nova-compute[74776]:         <nova:port uuid="b3675ad0-6dfc-4731-a999-a16801642163">
Nov 22 14:16:30 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 22 14:16:30 user nova-compute[74776]:         </nova:port>
Nov 22 14:16:30 user nova-compute[74776]:       </nova:ports>
Nov 22 14:16:30 user nova-compute[74776]:     </nova:instance>
Nov 22 14:16:30 user nova-compute[74776]:   </metadata>
Nov 22 14:16:30 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:16:30 user nova-compute[74776]:     <system>
Nov 22 14:16:30 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:16:30 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:16:30 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:16:30 user nova-compute[74776]:       <entry name="serial">232d8284-a99b-40c2-aa36-1de93a25729a</entry>
Nov 22 14:16:30 user nova-compute[74776]:       <entry name="uuid">232d8284-a99b-40c2-aa36-1de93a25729a</entry>
Nov 22 14:16:30 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:16:30 user nova-compute[74776]:     </system>
Nov 22 14:16:30 user nova-compute[74776]:   </sysinfo>
Nov 22 14:16:30 user nova-compute[74776]:   <os>
Nov 22 14:16:30 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:16:30 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:16:30 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:16:30 user nova-compute[74776]:   </os>
Nov 22 14:16:30 user nova-compute[74776]:   <features>
Nov 22 14:16:30 user nova-compute[74776]:     <acpi/>
Nov 22 14:16:30 user nova-compute[74776]:     <apic/>
Nov 22 14:16:30 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:16:30 user nova-compute[74776]:   </features>
Nov 22 14:16:30 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:16:30 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:16:30 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:16:30 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:16:30 user nova-compute[74776]:   </clock>
Nov 22 14:16:30 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:16:30 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:16:30 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:16:30 user nova-compute[74776]:   </cpu>
Nov 22 14:16:30 user nova-compute[74776]:   <devices>
Nov 22 14:16:30 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:16:30 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:16:30 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk"/>
Nov 22 14:16:30 user nova-compute[74776]:       <target dev="sda" bus="scsi"/>
Nov 22 14:16:30 user nova-compute[74776]:       <address type="drive" controller="0" unit="0"/>
Nov 22 14:16:30 user nova-compute[74776]:     </disk>
Nov 22 14:16:30 user nova-compute[74776]:     <disk type="file" device="cdrom">
Nov 22 14:16:30 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none"/>
Nov 22 14:16:30 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk.config"/>
Nov 22 14:16:30 user nova-compute[74776]:       <target dev="sdb" bus="scsi"/>
Nov 22 14:16:30 user nova-compute[74776]:       <address type="drive" controller="0" unit="1"/>
Nov 22 14:16:30 user nova-compute[74776]:     </disk>
Nov 22 14:16:30 user nova-compute[74776]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 22 14:16:30 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:16:30 user nova-compute[74776]:       <mac address="fa:16:3e:01:f2:5e"/>
Nov 22 14:16:30 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:16:30 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:16:30 user nova-compute[74776]:       <target dev="tapb3675ad0-6d"/>
Nov 22 14:16:30 user nova-compute[74776]:     </interface>
Nov 22 14:16:30 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:16:30 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/console.log" append="off"/>
Nov 22 14:16:30 user nova-compute[74776]:     </serial>
Nov 22 14:16:30 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:16:30 user nova-compute[74776]:     <video>
Nov 22 14:16:30 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:16:30 user nova-compute[74776]:     </video>
Nov 22 14:16:30 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:16:30 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:16:30 user nova-compute[74776]:     </rng>
Nov 22 14:16:30 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:16:30 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:16:30 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:16:30 user nova-compute[74776]:     </memballoon>
Nov 22 14:16:30 user nova-compute[74776]:   </devices>
Nov 22 14:16:30 user nova-compute[74776]: </domain>
Nov 22 14:16:30 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-331917364',display_name='tempest-AttachSCSIVolumeTestJSON-server-331917364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-331917364',id=5,image_ref='1638bb8c-f36c-4d1b-ab22-67c3b2500095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM03DEyNjAHttoQ0r+wlU4uKjwYHyIFVNlSo1JXiwIEAKK1no5H+fnR1WKHvch3FiM7sN22LyNxFK0dMMU6lkhZpwDMNlhWOONYuUezddU2Fv3eabuUiuNHj8Ar2SDW3SQ==',key_name='tempest-keypair-977328427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4eea24586225438187a24cc3af0f800b',ramdisk_id='',reservation_id='r-ngn8ht0i',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1638bb8c-f36c-4d1b-ab22-67c3b2500095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-933096826',owner_user_name='tempest-AttachSCSIVolumeTestJSON-933096826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:16:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a271783c7a5a4564815d0c837a811551',uuid=232d8284-a99b-40c2-aa36-1de93a25729a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3675ad0-6dfc-4731-a999-a16801642163", "address": "fa:16:3e:01:f2:5e", "network": {"id": "18a7dc3b-d85c-457d-81d2-0a49599e45ac", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-704035334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4eea24586225438187a24cc3af0f800b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3675ad0-6d", "ovs_interfaceid": "b3675ad0-6dfc-4731-a999-a16801642163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Converting VIF {"id": "b3675ad0-6dfc-4731-a999-a16801642163", "address": "fa:16:3e:01:f2:5e", "network": {"id": "18a7dc3b-d85c-457d-81d2-0a49599e45ac", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-704035334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4eea24586225438187a24cc3af0f800b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3675ad0-6d", "ovs_interfaceid": "b3675ad0-6dfc-4731-a999-a16801642163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:f2:5e,bridge_name='br-int',has_traffic_filtering=True,id=b3675ad0-6dfc-4731-a999-a16801642163,network=Network(18a7dc3b-d85c-457d-81d2-0a49599e45ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3675ad0-6d') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG os_vif [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:f2:5e,bridge_name='br-int',has_traffic_filtering=True,id=b3675ad0-6dfc-4731-a999-a16801642163,network=Network(18a7dc3b-d85c-457d-81d2-0a49599e45ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3675ad0-6d') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:16:30 user nova-compute[74776]: INFO nova.compute.manager [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Took 16.90 seconds to build instance.
Nov 22 14:16:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc61c09a-5661-502b-a9ca-b8e38f8e8012', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:30 user nova-compute[74776]: INFO nova.compute.manager [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Took 15.16 seconds to build instance.
Nov 22 14:16:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:16:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42a116f2-3141-4d30-ab9b-b69f86b169a5 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.074s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:31 user nova-compute[74776]: INFO nova.compute.manager [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Took 15.14 seconds to build instance.
Nov 22 14:16:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3675ad0-6d, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3675ad0-6d, col_values=(('qos', UUID('c4637a04-5de1-4784-b696-5f0d407fc1a6')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3675ad0-6d, col_values=(('external_ids', {'iface-id': 'b3675ad0-6dfc-4731-a999-a16801642163', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:f2:5e', 'vm-uuid': '232d8284-a99b-40c2-aa36-1de93a25729a'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:31 user nova-compute[74776]: INFO os_vif [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:f2:5e,bridge_name='br-int',has_traffic_filtering=True,id=b3675ad0-6dfc-4731-a999-a16801642163,network=Network(18a7dc3b-d85c-457d-81d2-0a49599e45ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3675ad0-6d')
Nov 22 14:16:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f33819b-82bf-4409-9e52-37da360988db tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.367s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0726b2a6-77a6-4dd3-8cb8-6e5cf3792961 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.366s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] No BDM found with device name sda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:16:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:16:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] No VIF found with MAC fa:16:3e:01:f2:5e, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:16:31 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Using config drive
Nov 22 14:16:31 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Creating config drive at /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk.config
Nov 22 14:16:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzld7l784 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzld7l784" returned: 0 in 0.074s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:32 user nova-compute[74776]: DEBUG nova.network.neutron [req-043a52a6-4341-4bd6-bf8d-315058e8c4b6 req-4da8833f-1971-4cdc-90b9-6c8de20c37c0 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Updated VIF entry in instance network info cache for port b3675ad0-6dfc-4731-a999-a16801642163. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:16:32 user nova-compute[74776]: DEBUG nova.network.neutron [req-043a52a6-4341-4bd6-bf8d-315058e8c4b6 req-4da8833f-1971-4cdc-90b9-6c8de20c37c0 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Updating instance_info_cache with network_info: [{"id": "b3675ad0-6dfc-4731-a999-a16801642163", "address": "fa:16:3e:01:f2:5e", "network": {"id": "18a7dc3b-d85c-457d-81d2-0a49599e45ac", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-704035334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4eea24586225438187a24cc3af0f800b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3675ad0-6d", "ovs_interfaceid": "b3675ad0-6dfc-4731-a999-a16801642163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:16:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-043a52a6-4341-4bd6-bf8d-315058e8c4b6 req-4da8833f-1971-4cdc-90b9-6c8de20c37c0 service nova] Releasing lock "refresh_cache-232d8284-a99b-40c2-aa36-1de93a25729a" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:16:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "25deabe8-8cfc-4d40-a734-755d4097baf5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "25deabe8-8cfc-4d40-a734-755d4097baf5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:34 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:16:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:34 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:16:34 user nova-compute[74776]: INFO nova.compute.claims [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Claim successful on node user
Nov 22 14:16:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:34 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:16:35 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:16:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.790s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:35 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:16:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:35 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:16:35 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:16:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:35 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:16:35 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:16:35 user nova-compute[74776]: DEBUG nova.policy [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d30d915576746b0a9f38789a2e74f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f31ee687a47558c74cf007bd17175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:16:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:35 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:16:35 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:16:35 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Creating image(s)
Nov 22 14:16:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "/opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "/opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "/opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.281s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.250s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk 1073741824" returned: 0 in 0.075s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Acquiring lock "62461965-8bbb-4497-81e7-d9237832f190" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "62461965-8bbb-4497-81e7-d9237832f190" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.334s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:16:36 user nova-compute[74776]: INFO nova.compute.claims [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Claim successful on node user
Nov 22 14:16:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:37 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Cannot resize image /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:16:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:16:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Ensure instance console log exists: /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:16:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:37 user nova-compute[74776]: DEBUG nova.compute.manager [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:16:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:16:37 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Instance spawned successfully.
Nov 22 14:16:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:16:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:37 user nova-compute[74776]: INFO nova.compute.manager [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Took 9.85 seconds to spawn the instance on the hypervisor.
Nov 22 14:16:37 user nova-compute[74776]: DEBUG nova.compute.manager [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:16:37 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Successfully created port: 08471f51-9b29-4d1f-9c06-3006abae8ff1 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:16:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:37 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:16:37 user nova-compute[74776]: INFO nova.compute.manager [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Took 10.97 seconds to build instance.
Nov 22 14:16:37 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:16:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b82d02e7-30e6-44c9-9386-74724a756657 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "232d8284-a99b-40c2-aa36-1de93a25729a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.108s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.925s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:37 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:16:37 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:16:37 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:16:37 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:16:38 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:16:38 user nova-compute[74776]: DEBUG nova.policy [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1deee15758534e7894574ba7e5e583fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91bafa921c884ef4bf2928492c58c0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:16:38 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:16:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:16:38 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Creating image(s)
Nov 22 14:16:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Acquiring lock "/opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "/opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "/opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.243s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.363s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk 1073741824" returned: 0 in 0.079s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.452s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.283s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:39 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:16:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:39 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Cannot resize image /opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:16:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:16:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Ensure instance console log exists: /opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:16:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.013s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:39 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Successfully updated port: 08471f51-9b29-4d1f-9c06-3006abae8ff1 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:16:39 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Successfully created port: fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:16:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "refresh_cache-25deabe8-8cfc-4d40-a734-755d4097baf5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:16:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquired lock "refresh_cache-25deabe8-8cfc-4d40-a734-755d4097baf5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:16:39 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:16:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-7b4fe9e5-9615-407d-b7a8-2ad3b0b0b3fa req-b168f126-93c0-4b0d-bf5c-572d71357c9d service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Received event network-changed-08471f51-9b29-4d1f-9c06-3006abae8ff1 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:16:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-7b4fe9e5-9615-407d-b7a8-2ad3b0b0b3fa req-b168f126-93c0-4b0d-bf5c-572d71357c9d service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Refreshing instance network info cache due to event network-changed-08471f51-9b29-4d1f-9c06-3006abae8ff1. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:16:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b4fe9e5-9615-407d-b7a8-2ad3b0b0b3fa req-b168f126-93c0-4b0d-bf5c-572d71357c9d service nova] Acquiring lock "refresh_cache-25deabe8-8cfc-4d40-a734-755d4097baf5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:16:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:39 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Updating instance_info_cache with network_info: [{"id": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "address": "fa:16:3e:98:ce:04", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08471f51-9b", "ovs_interfaceid": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Releasing lock "refresh_cache-25deabe8-8cfc-4d40-a734-755d4097baf5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Instance network_info: |[{"id": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "address": "fa:16:3e:98:ce:04", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08471f51-9b", "ovs_interfaceid": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b4fe9e5-9615-407d-b7a8-2ad3b0b0b3fa req-b168f126-93c0-4b0d-bf5c-572d71357c9d service nova] Acquired lock "refresh_cache-25deabe8-8cfc-4d40-a734-755d4097baf5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.network.neutron [req-7b4fe9e5-9615-407d-b7a8-2ad3b0b0b3fa req-b168f126-93c0-4b0d-bf5c-572d71357c9d service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Refreshing network info cache for port 08471f51-9b29-4d1f-9c06-3006abae8ff1 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Start _get_guest_xml network_info=[{"id": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "address": "fa:16:3e:98:ce:04", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08471f51-9b", "ovs_interfaceid": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:16:40 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:16:40 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-221678284',display_name='tempest-VolumesAdminNegativeTest-server-221678284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-221678284',id=6,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7x2qjoHC8BWrj2Byhutl6d7bc2RSC/A4Hs4S4Yj8xexGyuGpoqWKkoPIZ1qZDosY3ovqXe0RTce8tRNzRbTOgFPc7JnwJMN7ISPQOONjqpb6BTQz7wH8u8Y3pBAODUYA==',key_name='tempest-keypair-666513585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e84f31ee687a47558c74cf007bd17175',ramdisk_id='',reservation_id='r-h0dpsmw1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1815512001',owner_user_name='tempest-VolumesAdminNegativeTest-1815512001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:16:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d30d915576746b0a9f38789a2e74f03',uuid=25deabe8-8cfc-4d40-a734-755d4097baf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "address": "fa:16:3e:98:ce:04", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08471f51-9b", "ovs_interfaceid": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Converting VIF {"id": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "address": "fa:16:3e:98:ce:04", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08471f51-9b", "ovs_interfaceid": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:ce:04,bridge_name='br-int',has_traffic_filtering=True,id=08471f51-9b29-4d1f-9c06-3006abae8ff1,network=Network(59cbde16-cdcd-4761-9c50-b31b4f2387b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08471f51-9b') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lazy-loading 'pci_devices' on Instance uuid 25deabe8-8cfc-4d40-a734-755d4097baf5 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:16:40 user nova-compute[74776]:   <uuid>25deabe8-8cfc-4d40-a734-755d4097baf5</uuid>
Nov 22 14:16:40 user nova-compute[74776]:   <name>instance-00000006</name>
Nov 22 14:16:40 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:16:40 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:16:40 user nova-compute[74776]:   <metadata>
Nov 22 14:16:40 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:16:40 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:16:40 user nova-compute[74776]:       <nova:name>tempest-VolumesAdminNegativeTest-server-221678284</nova:name>
Nov 22 14:16:40 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:16:40</nova:creationTime>
Nov 22 14:16:40 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:16:40 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:16:40 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:16:40 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:16:40 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:16:40 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:16:40 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:16:40 user nova-compute[74776]:       <nova:owner>
Nov 22 14:16:40 user nova-compute[74776]:         <nova:user uuid="3d30d915576746b0a9f38789a2e74f03">tempest-VolumesAdminNegativeTest-1815512001-project-member</nova:user>
Nov 22 14:16:40 user nova-compute[74776]:         <nova:project uuid="e84f31ee687a47558c74cf007bd17175">tempest-VolumesAdminNegativeTest-1815512001</nova:project>
Nov 22 14:16:40 user nova-compute[74776]:       </nova:owner>
Nov 22 14:16:40 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:16:40 user nova-compute[74776]:       <nova:ports>
Nov 22 14:16:40 user nova-compute[74776]:         <nova:port uuid="08471f51-9b29-4d1f-9c06-3006abae8ff1">
Nov 22 14:16:40 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 22 14:16:40 user nova-compute[74776]:         </nova:port>
Nov 22 14:16:40 user nova-compute[74776]:       </nova:ports>
Nov 22 14:16:40 user nova-compute[74776]:     </nova:instance>
Nov 22 14:16:40 user nova-compute[74776]:   </metadata>
Nov 22 14:16:40 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:16:40 user nova-compute[74776]:     <system>
Nov 22 14:16:40 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:16:40 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:16:40 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:16:40 user nova-compute[74776]:       <entry name="serial">25deabe8-8cfc-4d40-a734-755d4097baf5</entry>
Nov 22 14:16:40 user nova-compute[74776]:       <entry name="uuid">25deabe8-8cfc-4d40-a734-755d4097baf5</entry>
Nov 22 14:16:40 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:16:40 user nova-compute[74776]:     </system>
Nov 22 14:16:40 user nova-compute[74776]:   </sysinfo>
Nov 22 14:16:40 user nova-compute[74776]:   <os>
Nov 22 14:16:40 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:16:40 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:16:40 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:16:40 user nova-compute[74776]:   </os>
Nov 22 14:16:40 user nova-compute[74776]:   <features>
Nov 22 14:16:40 user nova-compute[74776]:     <acpi/>
Nov 22 14:16:40 user nova-compute[74776]:     <apic/>
Nov 22 14:16:40 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:16:40 user nova-compute[74776]:   </features>
Nov 22 14:16:40 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:16:40 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:16:40 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:16:40 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:16:40 user nova-compute[74776]:   </clock>
Nov 22 14:16:40 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:16:40 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:16:40 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:16:40 user nova-compute[74776]:   </cpu>
Nov 22 14:16:40 user nova-compute[74776]:   <devices>
Nov 22 14:16:40 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:16:40 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:16:40 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk"/>
Nov 22 14:16:40 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:16:40 user nova-compute[74776]:     </disk>
Nov 22 14:16:40 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:16:40 user nova-compute[74776]:       <mac address="fa:16:3e:98:ce:04"/>
Nov 22 14:16:40 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:16:40 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:16:40 user nova-compute[74776]:       <target dev="tap08471f51-9b"/>
Nov 22 14:16:40 user nova-compute[74776]:     </interface>
Nov 22 14:16:40 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:16:40 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/console.log" append="off"/>
Nov 22 14:16:40 user nova-compute[74776]:     </serial>
Nov 22 14:16:40 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:16:40 user nova-compute[74776]:     <video>
Nov 22 14:16:40 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:16:40 user nova-compute[74776]:     </video>
Nov 22 14:16:40 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:16:40 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:16:40 user nova-compute[74776]:     </rng>
Nov 22 14:16:40 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:16:40 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:16:40 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:16:40 user nova-compute[74776]:     </memballoon>
Nov 22 14:16:40 user nova-compute[74776]:   </devices>
Nov 22 14:16:40 user nova-compute[74776]: </domain>
Nov 22 14:16:40 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-221678284',display_name='tempest-VolumesAdminNegativeTest-server-221678284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-221678284',id=6,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7x2qjoHC8BWrj2Byhutl6d7bc2RSC/A4Hs4S4Yj8xexGyuGpoqWKkoPIZ1qZDosY3ovqXe0RTce8tRNzRbTOgFPc7JnwJMN7ISPQOONjqpb6BTQz7wH8u8Y3pBAODUYA==',key_name='tempest-keypair-666513585',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e84f31ee687a47558c74cf007bd17175',ramdisk_id='',reservation_id='r-h0dpsmw1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1815512001',owner_user_name='tempest-VolumesAdminNegativeTest-1815512001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:16:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d30d915576746b0a9f38789a2e74f03',uuid=25deabe8-8cfc-4d40-a734-755d4097baf5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "address": "fa:16:3e:98:ce:04", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08471f51-9b", "ovs_interfaceid": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Converting VIF {"id": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "address": "fa:16:3e:98:ce:04", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08471f51-9b", "ovs_interfaceid": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:ce:04,bridge_name='br-int',has_traffic_filtering=True,id=08471f51-9b29-4d1f-9c06-3006abae8ff1,network=Network(59cbde16-cdcd-4761-9c50-b31b4f2387b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08471f51-9b') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG os_vif [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:ce:04,bridge_name='br-int',has_traffic_filtering=True,id=08471f51-9b29-4d1f-9c06-3006abae8ff1,network=Network(59cbde16-cdcd-4761-9c50-b31b4f2387b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08471f51-9b') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e481f9a5-071a-5620-bb5b-ed7c858b2690', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08471f51-9b, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08471f51-9b, col_values=(('qos', UUID('db921947-4281-4499-82d4-0ab89b78abd7')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08471f51-9b, col_values=(('external_ids', {'iface-id': '08471f51-9b29-4d1f-9c06-3006abae8ff1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:ce:04', 'vm-uuid': '25deabe8-8cfc-4d40-a734-755d4097baf5'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:40 user nova-compute[74776]: INFO os_vif [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:ce:04,bridge_name='br-int',has_traffic_filtering=True,id=08471f51-9b29-4d1f-9c06-3006abae8ff1,network=Network(59cbde16-cdcd-4761-9c50-b31b4f2387b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08471f51-9b')
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] No VIF found with MAC fa:16:3e:98:ce:04, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Successfully updated port: fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Acquiring lock "refresh_cache-62461965-8bbb-4497-81e7-d9237832f190" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Acquired lock "refresh_cache-62461965-8bbb-4497-81e7-d9237832f190" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.compute.manager [req-9781ff0a-74cd-4020-9cff-6c59b564d010 req-c116b736-2dbf-405e-8d15-ff448aac4548 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Received event network-changed-fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG nova.compute.manager [req-9781ff0a-74cd-4020-9cff-6c59b564d010 req-c116b736-2dbf-405e-8d15-ff448aac4548 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Refreshing instance network info cache due to event network-changed-fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:16:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9781ff0a-74cd-4020-9cff-6c59b564d010 req-c116b736-2dbf-405e-8d15-ff448aac4548 service nova] Acquiring lock "refresh_cache-62461965-8bbb-4497-81e7-d9237832f190" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Updating instance_info_cache with network_info: [{"id": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "address": "fa:16:3e:88:e5:06", "network": {"id": "27ef6736-2e02-4129-9a99-808e36b78c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2032983723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91bafa921c884ef4bf2928492c58c0d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf7b87c-b8", "ovs_interfaceid": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Releasing lock "refresh_cache-62461965-8bbb-4497-81e7-d9237832f190" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Instance network_info: |[{"id": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "address": "fa:16:3e:88:e5:06", "network": {"id": "27ef6736-2e02-4129-9a99-808e36b78c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2032983723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91bafa921c884ef4bf2928492c58c0d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf7b87c-b8", "ovs_interfaceid": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9781ff0a-74cd-4020-9cff-6c59b564d010 req-c116b736-2dbf-405e-8d15-ff448aac4548 service nova] Acquired lock "refresh_cache-62461965-8bbb-4497-81e7-d9237832f190" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.network.neutron [req-9781ff0a-74cd-4020-9cff-6c59b564d010 req-c116b736-2dbf-405e-8d15-ff448aac4548 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Refreshing network info cache for port fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Start _get_guest_xml network_info=[{"id": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "address": "fa:16:3e:88:e5:06", "network": {"id": "27ef6736-2e02-4129-9a99-808e36b78c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2032983723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91bafa921c884ef4bf2928492c58c0d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf7b87c-b8", "ovs_interfaceid": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:16:41 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:16:41 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.network.neutron [req-7b4fe9e5-9615-407d-b7a8-2ad3b0b0b3fa req-b168f126-93c0-4b0d-bf5c-572d71357c9d service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Updated VIF entry in instance network info cache for port 08471f51-9b29-4d1f-9c06-3006abae8ff1. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.network.neutron [req-7b4fe9e5-9615-407d-b7a8-2ad3b0b0b3fa req-b168f126-93c0-4b0d-bf5c-572d71357c9d service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Updating instance_info_cache with network_info: [{"id": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "address": "fa:16:3e:98:ce:04", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08471f51-9b", "ovs_interfaceid": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1315674234',display_name='tempest-TestVolumeSwap-server-1315674234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1315674234',id=7,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcEvqPUPhT4nIqn42VKV6sZXQhgNAMZ4E6hBxOakWQ5e1l2QXF2BCfDTm11500G4oKXQwTOX4eeuP35JNRDD9EPfNkuY8vdi00SJkHr+y7IBhb0E3FJ5aPwGWMs7DEt3Q==',key_name='tempest-keypair-1732866307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91bafa921c884ef4bf2928492c58c0d6',ramdisk_id='',reservation_id='r-100vj9ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1684556967',owner_user_name='tempest-TestVolumeSwap-1684556967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:16:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1deee15758534e7894574ba7e5e583fc',uuid=62461965-8bbb-4497-81e7-d9237832f190,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "address": "fa:16:3e:88:e5:06", "network": {"id": "27ef6736-2e02-4129-9a99-808e36b78c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2032983723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91bafa921c884ef4bf2928492c58c0d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf7b87c-b8", "ovs_interfaceid": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Converting VIF {"id": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "address": "fa:16:3e:88:e5:06", "network": {"id": "27ef6736-2e02-4129-9a99-808e36b78c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2032983723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91bafa921c884ef4bf2928492c58c0d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf7b87c-b8", "ovs_interfaceid": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:e5:06,bridge_name='br-int',has_traffic_filtering=True,id=fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c,network=Network(27ef6736-2e02-4129-9a99-808e36b78c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf7b87c-b8') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.objects.instance [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lazy-loading 'pci_devices' on Instance uuid 62461965-8bbb-4497-81e7-d9237832f190 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b4fe9e5-9615-407d-b7a8-2ad3b0b0b3fa req-b168f126-93c0-4b0d-bf5c-572d71357c9d service nova] Releasing lock "refresh_cache-25deabe8-8cfc-4d40-a734-755d4097baf5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:16:41 user nova-compute[74776]:   <uuid>62461965-8bbb-4497-81e7-d9237832f190</uuid>
Nov 22 14:16:41 user nova-compute[74776]:   <name>instance-00000007</name>
Nov 22 14:16:41 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:16:41 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:16:41 user nova-compute[74776]:   <metadata>
Nov 22 14:16:41 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:16:41 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:16:41 user nova-compute[74776]:       <nova:name>tempest-TestVolumeSwap-server-1315674234</nova:name>
Nov 22 14:16:41 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:16:41</nova:creationTime>
Nov 22 14:16:41 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:16:41 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:16:41 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:16:41 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:16:41 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:16:41 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:16:41 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:16:41 user nova-compute[74776]:       <nova:owner>
Nov 22 14:16:41 user nova-compute[74776]:         <nova:user uuid="1deee15758534e7894574ba7e5e583fc">tempest-TestVolumeSwap-1684556967-project-member</nova:user>
Nov 22 14:16:41 user nova-compute[74776]:         <nova:project uuid="91bafa921c884ef4bf2928492c58c0d6">tempest-TestVolumeSwap-1684556967</nova:project>
Nov 22 14:16:41 user nova-compute[74776]:       </nova:owner>
Nov 22 14:16:41 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:16:41 user nova-compute[74776]:       <nova:ports>
Nov 22 14:16:41 user nova-compute[74776]:         <nova:port uuid="fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c">
Nov 22 14:16:41 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 22 14:16:41 user nova-compute[74776]:         </nova:port>
Nov 22 14:16:41 user nova-compute[74776]:       </nova:ports>
Nov 22 14:16:41 user nova-compute[74776]:     </nova:instance>
Nov 22 14:16:41 user nova-compute[74776]:   </metadata>
Nov 22 14:16:41 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:16:41 user nova-compute[74776]:     <system>
Nov 22 14:16:41 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:16:41 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:16:41 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:16:41 user nova-compute[74776]:       <entry name="serial">62461965-8bbb-4497-81e7-d9237832f190</entry>
Nov 22 14:16:41 user nova-compute[74776]:       <entry name="uuid">62461965-8bbb-4497-81e7-d9237832f190</entry>
Nov 22 14:16:41 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:16:41 user nova-compute[74776]:     </system>
Nov 22 14:16:41 user nova-compute[74776]:   </sysinfo>
Nov 22 14:16:41 user nova-compute[74776]:   <os>
Nov 22 14:16:41 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:16:41 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:16:41 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:16:41 user nova-compute[74776]:   </os>
Nov 22 14:16:41 user nova-compute[74776]:   <features>
Nov 22 14:16:41 user nova-compute[74776]:     <acpi/>
Nov 22 14:16:41 user nova-compute[74776]:     <apic/>
Nov 22 14:16:41 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:16:41 user nova-compute[74776]:   </features>
Nov 22 14:16:41 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:16:41 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:16:41 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:16:41 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:16:41 user nova-compute[74776]:   </clock>
Nov 22 14:16:41 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:16:41 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:16:41 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:16:41 user nova-compute[74776]:   </cpu>
Nov 22 14:16:41 user nova-compute[74776]:   <devices>
Nov 22 14:16:41 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:16:41 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:16:41 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk"/>
Nov 22 14:16:41 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:16:41 user nova-compute[74776]:     </disk>
Nov 22 14:16:41 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:16:41 user nova-compute[74776]:       <mac address="fa:16:3e:88:e5:06"/>
Nov 22 14:16:41 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:16:41 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:16:41 user nova-compute[74776]:       <target dev="tapfcf7b87c-b8"/>
Nov 22 14:16:41 user nova-compute[74776]:     </interface>
Nov 22 14:16:41 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:16:41 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/console.log" append="off"/>
Nov 22 14:16:41 user nova-compute[74776]:     </serial>
Nov 22 14:16:41 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:16:41 user nova-compute[74776]:     <video>
Nov 22 14:16:41 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:16:41 user nova-compute[74776]:     </video>
Nov 22 14:16:41 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:16:41 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:16:41 user nova-compute[74776]:     </rng>
Nov 22 14:16:41 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:16:41 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:16:41 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:16:41 user nova-compute[74776]:     </memballoon>
Nov 22 14:16:41 user nova-compute[74776]:   </devices>
Nov 22 14:16:41 user nova-compute[74776]: </domain>
Nov 22 14:16:41 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1315674234',display_name='tempest-TestVolumeSwap-server-1315674234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1315674234',id=7,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcEvqPUPhT4nIqn42VKV6sZXQhgNAMZ4E6hBxOakWQ5e1l2QXF2BCfDTm11500G4oKXQwTOX4eeuP35JNRDD9EPfNkuY8vdi00SJkHr+y7IBhb0E3FJ5aPwGWMs7DEt3Q==',key_name='tempest-keypair-1732866307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='91bafa921c884ef4bf2928492c58c0d6',ramdisk_id='',reservation_id='r-100vj9ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1684556967',owner_user_name='tempest-TestVolumeSwap-1684556967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:16:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1deee15758534e7894574ba7e5e583fc',uuid=62461965-8bbb-4497-81e7-d9237832f190,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "address": "fa:16:3e:88:e5:06", "network": {"id": "27ef6736-2e02-4129-9a99-808e36b78c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2032983723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91bafa921c884ef4bf2928492c58c0d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf7b87c-b8", "ovs_interfaceid": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Converting VIF {"id": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "address": "fa:16:3e:88:e5:06", "network": {"id": "27ef6736-2e02-4129-9a99-808e36b78c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2032983723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91bafa921c884ef4bf2928492c58c0d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf7b87c-b8", "ovs_interfaceid": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:e5:06,bridge_name='br-int',has_traffic_filtering=True,id=fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c,network=Network(27ef6736-2e02-4129-9a99-808e36b78c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf7b87c-b8') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG os_vif [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:e5:06,bridge_name='br-int',has_traffic_filtering=True,id=fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c,network=Network(27ef6736-2e02-4129-9a99-808e36b78c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf7b87c-b8') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10e8bd77-fb6f-5902-9dcc-f08b70aecf21', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcf7b87c-b8, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfcf7b87c-b8, col_values=(('qos', UUID('55ba2e52-80fc-413d-9a71-920906e31a8a')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfcf7b87c-b8, col_values=(('external_ids', {'iface-id': 'fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:e5:06', 'vm-uuid': '62461965-8bbb-4497-81e7-d9237832f190'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:41 user nova-compute[74776]: INFO os_vif [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:e5:06,bridge_name='br-int',has_traffic_filtering=True,id=fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c,network=Network(27ef6736-2e02-4129-9a99-808e36b78c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf7b87c-b8')
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:16:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] No VIF found with MAC fa:16:3e:88:e5:06, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:16:42 user nova-compute[74776]: DEBUG nova.network.neutron [req-9781ff0a-74cd-4020-9cff-6c59b564d010 req-c116b736-2dbf-405e-8d15-ff448aac4548 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Updated VIF entry in instance network info cache for port fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:16:42 user nova-compute[74776]: DEBUG nova.network.neutron [req-9781ff0a-74cd-4020-9cff-6c59b564d010 req-c116b736-2dbf-405e-8d15-ff448aac4548 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Updating instance_info_cache with network_info: [{"id": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "address": "fa:16:3e:88:e5:06", "network": {"id": "27ef6736-2e02-4129-9a99-808e36b78c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2032983723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91bafa921c884ef4bf2928492c58c0d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf7b87c-b8", "ovs_interfaceid": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:16:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9781ff0a-74cd-4020-9cff-6c59b564d010 req-c116b736-2dbf-405e-8d15-ff448aac4548 service nova] Releasing lock "refresh_cache-62461965-8bbb-4497-81e7-d9237832f190" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:16:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:43 user nova-compute[74776]: DEBUG nova.compute.manager [req-c38e7267-58cb-4e1f-9c4e-513c7f1d6eed req-74ad4ef6-3afd-4fc9-aff6-5bf178656c8e service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Received event network-vif-plugged-08471f51-9b29-4d1f-9c06-3006abae8ff1 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:16:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c38e7267-58cb-4e1f-9c4e-513c7f1d6eed req-74ad4ef6-3afd-4fc9-aff6-5bf178656c8e service nova] Acquiring lock "25deabe8-8cfc-4d40-a734-755d4097baf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c38e7267-58cb-4e1f-9c4e-513c7f1d6eed req-74ad4ef6-3afd-4fc9-aff6-5bf178656c8e service nova] Lock "25deabe8-8cfc-4d40-a734-755d4097baf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c38e7267-58cb-4e1f-9c4e-513c7f1d6eed req-74ad4ef6-3afd-4fc9-aff6-5bf178656c8e service nova] Lock "25deabe8-8cfc-4d40-a734-755d4097baf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:43 user nova-compute[74776]: DEBUG nova.compute.manager [req-c38e7267-58cb-4e1f-9c4e-513c7f1d6eed req-74ad4ef6-3afd-4fc9-aff6-5bf178656c8e service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] No waiting events found dispatching network-vif-plugged-08471f51-9b29-4d1f-9c06-3006abae8ff1 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:16:43 user nova-compute[74776]: WARNING nova.compute.manager [req-c38e7267-58cb-4e1f-9c4e-513c7f1d6eed req-74ad4ef6-3afd-4fc9-aff6-5bf178656c8e service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Received unexpected event network-vif-plugged-08471f51-9b29-4d1f-9c06-3006abae8ff1 for instance with vm_state building and task_state spawning.
Nov 22 14:16:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:45 user nova-compute[74776]: DEBUG nova.compute.manager [req-5658f79a-93ac-4e07-8c1b-3fe49e68310e req-ae7a795d-0f52-4e96-8687-ff1994ee9eb2 service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Received event network-vif-plugged-08471f51-9b29-4d1f-9c06-3006abae8ff1 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:16:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5658f79a-93ac-4e07-8c1b-3fe49e68310e req-ae7a795d-0f52-4e96-8687-ff1994ee9eb2 service nova] Acquiring lock "25deabe8-8cfc-4d40-a734-755d4097baf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5658f79a-93ac-4e07-8c1b-3fe49e68310e req-ae7a795d-0f52-4e96-8687-ff1994ee9eb2 service nova] Lock "25deabe8-8cfc-4d40-a734-755d4097baf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5658f79a-93ac-4e07-8c1b-3fe49e68310e req-ae7a795d-0f52-4e96-8687-ff1994ee9eb2 service nova] Lock "25deabe8-8cfc-4d40-a734-755d4097baf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:45 user nova-compute[74776]: DEBUG nova.compute.manager [req-5658f79a-93ac-4e07-8c1b-3fe49e68310e req-ae7a795d-0f52-4e96-8687-ff1994ee9eb2 service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] No waiting events found dispatching network-vif-plugged-08471f51-9b29-4d1f-9c06-3006abae8ff1 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:16:45 user nova-compute[74776]: WARNING nova.compute.manager [req-5658f79a-93ac-4e07-8c1b-3fe49e68310e req-ae7a795d-0f52-4e96-8687-ff1994ee9eb2 service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Received unexpected event network-vif-plugged-08471f51-9b29-4d1f-9c06-3006abae8ff1 for instance with vm_state building and task_state spawning.
Nov 22 14:16:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:46 user nova-compute[74776]: DEBUG nova.compute.manager [req-793f32f5-608b-47c3-8231-3b6f73fbccf7 req-c2f5d321-c4e1-4a8c-b46e-7f031d1db321 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Received event network-vif-plugged-fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:16:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-793f32f5-608b-47c3-8231-3b6f73fbccf7 req-c2f5d321-c4e1-4a8c-b46e-7f031d1db321 service nova] Acquiring lock "62461965-8bbb-4497-81e7-d9237832f190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-793f32f5-608b-47c3-8231-3b6f73fbccf7 req-c2f5d321-c4e1-4a8c-b46e-7f031d1db321 service nova] Lock "62461965-8bbb-4497-81e7-d9237832f190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-793f32f5-608b-47c3-8231-3b6f73fbccf7 req-c2f5d321-c4e1-4a8c-b46e-7f031d1db321 service nova] Lock "62461965-8bbb-4497-81e7-d9237832f190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:46 user nova-compute[74776]: DEBUG nova.compute.manager [req-793f32f5-608b-47c3-8231-3b6f73fbccf7 req-c2f5d321-c4e1-4a8c-b46e-7f031d1db321 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] No waiting events found dispatching network-vif-plugged-fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:16:46 user nova-compute[74776]: WARNING nova.compute.manager [req-793f32f5-608b-47c3-8231-3b6f73fbccf7 req-c2f5d321-c4e1-4a8c-b46e-7f031d1db321 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Received unexpected event network-vif-plugged-fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c for instance with vm_state building and task_state spawning.
Nov 22 14:16:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:47 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:16:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:16:47 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:16:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:16:47 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Instance spawned successfully.
Nov 22 14:16:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:16:47 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Instance spawned successfully.
Nov 22 14:16:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:16:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:47 user nova-compute[74776]: INFO nova.compute.manager [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Took 9.65 seconds to spawn the instance on the hypervisor.
Nov 22 14:16:47 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:16:47 user nova-compute[74776]: INFO nova.compute.manager [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Took 12.05 seconds to spawn the instance on the hypervisor.
Nov 22 14:16:47 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:16:48 user nova-compute[74776]: INFO nova.compute.manager [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Took 11.28 seconds to build instance.
Nov 22 14:16:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f904ca5b-71e8-401c-affb-59eb9a46b6d1 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "62461965-8bbb-4497-81e7-d9237832f190" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.546s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:48 user nova-compute[74776]: INFO nova.compute.manager [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Took 13.83 seconds to build instance.
Nov 22 14:16:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7dd182ba-5ab8-4b47-80b3-0798cb0ac5c1 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "25deabe8-8cfc-4d40-a734-755d4097baf5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.058s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:48 user nova-compute[74776]: DEBUG nova.compute.manager [req-ad5bb0d9-f78f-4e37-89c3-08b078446026 req-57a4d926-9ca2-47b6-a9df-f00e0e7c9681 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Received event network-vif-plugged-fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:16:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ad5bb0d9-f78f-4e37-89c3-08b078446026 req-57a4d926-9ca2-47b6-a9df-f00e0e7c9681 service nova] Acquiring lock "62461965-8bbb-4497-81e7-d9237832f190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ad5bb0d9-f78f-4e37-89c3-08b078446026 req-57a4d926-9ca2-47b6-a9df-f00e0e7c9681 service nova] Lock "62461965-8bbb-4497-81e7-d9237832f190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ad5bb0d9-f78f-4e37-89c3-08b078446026 req-57a4d926-9ca2-47b6-a9df-f00e0e7c9681 service nova] Lock "62461965-8bbb-4497-81e7-d9237832f190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:48 user nova-compute[74776]: DEBUG nova.compute.manager [req-ad5bb0d9-f78f-4e37-89c3-08b078446026 req-57a4d926-9ca2-47b6-a9df-f00e0e7c9681 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] No waiting events found dispatching network-vif-plugged-fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:16:48 user nova-compute[74776]: WARNING nova.compute.manager [req-ad5bb0d9-f78f-4e37-89c3-08b078446026 req-57a4d926-9ca2-47b6-a9df-f00e0e7c9681 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Received unexpected event network-vif-plugged-fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c for instance with vm_state active and task_state None.
Nov 22 14:16:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Acquiring lock "fb5def2c-c757-4a3c-a832-142bf8c61413" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Lock "fb5def2c-c757-4a3c-a832-142bf8c61413" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:50 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:16:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:50 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:16:50 user nova-compute[74776]: INFO nova.compute.claims [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Claim successful on node user
Nov 22 14:16:51 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:16:51 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:16:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:51 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:16:51 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:16:51 user nova-compute[74776]: DEBUG nova.network.neutron [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:16:51 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:16:51 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:16:51 user nova-compute[74776]: DEBUG nova.policy [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c56716b9718b451891b0c598480bf278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f11960384544c3e935913363bdb1a07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:16:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:51 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:16:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:16:51 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Creating image(s)
Nov 22 14:16:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Lock "/opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Lock "/opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.301s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.278s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk 1073741824" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.478s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.245s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:52 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:16:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:16:52 user nova-compute[74776]: DEBUG nova.network.neutron [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Successfully created port: 5ac74f62-5924-4561-9764-37baf7fb4a76 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:16:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:16:52 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Cannot resize image /opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:16:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:16:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Ensure instance console log exists: /opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:16:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:53 user nova-compute[74776]: DEBUG nova.network.neutron [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Successfully updated port: 5ac74f62-5924-4561-9764-37baf7fb4a76 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:16:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Acquiring lock "refresh_cache-fb5def2c-c757-4a3c-a832-142bf8c61413" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:16:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Acquired lock "refresh_cache-fb5def2c-c757-4a3c-a832-142bf8c61413" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:16:53 user nova-compute[74776]: DEBUG nova.network.neutron [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:16:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-fa916b40-4efe-4594-8199-48efe30528ab req-bfe23c37-9f47-479c-acf3-fc8aceebaa1f service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Received event network-changed-5ac74f62-5924-4561-9764-37baf7fb4a76 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:16:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-fa916b40-4efe-4594-8199-48efe30528ab req-bfe23c37-9f47-479c-acf3-fc8aceebaa1f service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Refreshing instance network info cache due to event network-changed-5ac74f62-5924-4561-9764-37baf7fb4a76. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:16:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-fa916b40-4efe-4594-8199-48efe30528ab req-bfe23c37-9f47-479c-acf3-fc8aceebaa1f service nova] Acquiring lock "refresh_cache-fb5def2c-c757-4a3c-a832-142bf8c61413" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:16:53 user nova-compute[74776]: DEBUG nova.network.neutron [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.network.neutron [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Updating instance_info_cache with network_info: [{"id": "5ac74f62-5924-4561-9764-37baf7fb4a76", "address": "fa:16:3e:98:f8:b7", "network": {"id": "53d2e1ea-b878-4276-94e0-8cd654e520d8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1299382333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f11960384544c3e935913363bdb1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ac74f62-59", "ovs_interfaceid": "5ac74f62-5924-4561-9764-37baf7fb4a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Releasing lock "refresh_cache-fb5def2c-c757-4a3c-a832-142bf8c61413" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Instance network_info: |[{"id": "5ac74f62-5924-4561-9764-37baf7fb4a76", "address": "fa:16:3e:98:f8:b7", "network": {"id": "53d2e1ea-b878-4276-94e0-8cd654e520d8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1299382333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f11960384544c3e935913363bdb1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ac74f62-59", "ovs_interfaceid": "5ac74f62-5924-4561-9764-37baf7fb4a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-fa916b40-4efe-4594-8199-48efe30528ab req-bfe23c37-9f47-479c-acf3-fc8aceebaa1f service nova] Acquired lock "refresh_cache-fb5def2c-c757-4a3c-a832-142bf8c61413" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.network.neutron [req-fa916b40-4efe-4594-8199-48efe30528ab req-bfe23c37-9f47-479c-acf3-fc8aceebaa1f service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Refreshing network info cache for port 5ac74f62-5924-4561-9764-37baf7fb4a76 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Start _get_guest_xml network_info=[{"id": "5ac74f62-5924-4561-9764-37baf7fb4a76", "address": "fa:16:3e:98:f8:b7", "network": {"id": "53d2e1ea-b878-4276-94e0-8cd654e520d8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1299382333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f11960384544c3e935913363bdb1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ac74f62-59", "ovs_interfaceid": "5ac74f62-5924-4561-9764-37baf7fb4a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:16:54 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:16:54 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1354942648',display_name='tempest-VolumesAssistedSnapshotsTest-server-1354942648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1354942648',id=8,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVpHkWub86FarFRjFCm857KS6EipDOTPTX/Hpyiz3SUT0Zzh2xYQkykAKH3UiiPPGteAEzrNP3UnwJRg/9Wg2YOh9HMxWqMY+wKZ/NVh/3XLvNXUd0Q2VwN5qwyK2Rfow==',key_name='tempest-keypair-703456416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f11960384544c3e935913363bdb1a07',ramdisk_id='',reservation_id='r-39qdve1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1302421890',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1302421890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:16:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c56716b9718b451891b0c598480bf278',uuid=fb5def2c-c757-4a3c-a832-142bf8c61413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ac74f62-5924-4561-9764-37baf7fb4a76", "address": "fa:16:3e:98:f8:b7", "network": {"id": "53d2e1ea-b878-4276-94e0-8cd654e520d8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1299382333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f11960384544c3e935913363bdb1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ac74f62-59", "ovs_interfaceid": "5ac74f62-5924-4561-9764-37baf7fb4a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Converting VIF {"id": "5ac74f62-5924-4561-9764-37baf7fb4a76", "address": "fa:16:3e:98:f8:b7", "network": {"id": "53d2e1ea-b878-4276-94e0-8cd654e520d8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1299382333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f11960384544c3e935913363bdb1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ac74f62-59", "ovs_interfaceid": "5ac74f62-5924-4561-9764-37baf7fb4a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:f8:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ac74f62-5924-4561-9764-37baf7fb4a76,network=Network(53d2e1ea-b878-4276-94e0-8cd654e520d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ac74f62-59') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.objects.instance [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Lazy-loading 'pci_devices' on Instance uuid fb5def2c-c757-4a3c-a832-142bf8c61413 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:16:54 user nova-compute[74776]:   <uuid>fb5def2c-c757-4a3c-a832-142bf8c61413</uuid>
Nov 22 14:16:54 user nova-compute[74776]:   <name>instance-00000008</name>
Nov 22 14:16:54 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:16:54 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:16:54 user nova-compute[74776]:   <metadata>
Nov 22 14:16:54 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:16:54 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:16:54 user nova-compute[74776]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1354942648</nova:name>
Nov 22 14:16:54 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:16:54</nova:creationTime>
Nov 22 14:16:54 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:16:54 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:16:54 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:16:54 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:16:54 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:16:54 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:16:54 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:16:54 user nova-compute[74776]:       <nova:owner>
Nov 22 14:16:54 user nova-compute[74776]:         <nova:user uuid="c56716b9718b451891b0c598480bf278">tempest-VolumesAssistedSnapshotsTest-1302421890-project-member</nova:user>
Nov 22 14:16:54 user nova-compute[74776]:         <nova:project uuid="5f11960384544c3e935913363bdb1a07">tempest-VolumesAssistedSnapshotsTest-1302421890</nova:project>
Nov 22 14:16:54 user nova-compute[74776]:       </nova:owner>
Nov 22 14:16:54 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:16:54 user nova-compute[74776]:       <nova:ports>
Nov 22 14:16:54 user nova-compute[74776]:         <nova:port uuid="5ac74f62-5924-4561-9764-37baf7fb4a76">
Nov 22 14:16:54 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 22 14:16:54 user nova-compute[74776]:         </nova:port>
Nov 22 14:16:54 user nova-compute[74776]:       </nova:ports>
Nov 22 14:16:54 user nova-compute[74776]:     </nova:instance>
Nov 22 14:16:54 user nova-compute[74776]:   </metadata>
Nov 22 14:16:54 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:16:54 user nova-compute[74776]:     <system>
Nov 22 14:16:54 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:16:54 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:16:54 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:16:54 user nova-compute[74776]:       <entry name="serial">fb5def2c-c757-4a3c-a832-142bf8c61413</entry>
Nov 22 14:16:54 user nova-compute[74776]:       <entry name="uuid">fb5def2c-c757-4a3c-a832-142bf8c61413</entry>
Nov 22 14:16:54 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:16:54 user nova-compute[74776]:     </system>
Nov 22 14:16:54 user nova-compute[74776]:   </sysinfo>
Nov 22 14:16:54 user nova-compute[74776]:   <os>
Nov 22 14:16:54 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:16:54 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:16:54 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:16:54 user nova-compute[74776]:   </os>
Nov 22 14:16:54 user nova-compute[74776]:   <features>
Nov 22 14:16:54 user nova-compute[74776]:     <acpi/>
Nov 22 14:16:54 user nova-compute[74776]:     <apic/>
Nov 22 14:16:54 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:16:54 user nova-compute[74776]:   </features>
Nov 22 14:16:54 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:16:54 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:16:54 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:16:54 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:16:54 user nova-compute[74776]:   </clock>
Nov 22 14:16:54 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:16:54 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:16:54 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:16:54 user nova-compute[74776]:   </cpu>
Nov 22 14:16:54 user nova-compute[74776]:   <devices>
Nov 22 14:16:54 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:16:54 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:16:54 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk"/>
Nov 22 14:16:54 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:16:54 user nova-compute[74776]:     </disk>
Nov 22 14:16:54 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:16:54 user nova-compute[74776]:       <mac address="fa:16:3e:98:f8:b7"/>
Nov 22 14:16:54 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:16:54 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:16:54 user nova-compute[74776]:       <target dev="tap5ac74f62-59"/>
Nov 22 14:16:54 user nova-compute[74776]:     </interface>
Nov 22 14:16:54 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:16:54 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/console.log" append="off"/>
Nov 22 14:16:54 user nova-compute[74776]:     </serial>
Nov 22 14:16:54 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:16:54 user nova-compute[74776]:     <video>
Nov 22 14:16:54 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:16:54 user nova-compute[74776]:     </video>
Nov 22 14:16:54 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:16:54 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:16:54 user nova-compute[74776]:     </rng>
Nov 22 14:16:54 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:16:54 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:16:54 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:16:54 user nova-compute[74776]:     </memballoon>
Nov 22 14:16:54 user nova-compute[74776]:   </devices>
Nov 22 14:16:54 user nova-compute[74776]: </domain>
Nov 22 14:16:54 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1354942648',display_name='tempest-VolumesAssistedSnapshotsTest-server-1354942648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1354942648',id=8,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVpHkWub86FarFRjFCm857KS6EipDOTPTX/Hpyiz3SUT0Zzh2xYQkykAKH3UiiPPGteAEzrNP3UnwJRg/9Wg2YOh9HMxWqMY+wKZ/NVh/3XLvNXUd0Q2VwN5qwyK2Rfow==',key_name='tempest-keypair-703456416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f11960384544c3e935913363bdb1a07',ramdisk_id='',reservation_id='r-39qdve1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1302421890',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1302421890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:16:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c56716b9718b451891b0c598480bf278',uuid=fb5def2c-c757-4a3c-a832-142bf8c61413,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ac74f62-5924-4561-9764-37baf7fb4a76", "address": "fa:16:3e:98:f8:b7", "network": {"id": "53d2e1ea-b878-4276-94e0-8cd654e520d8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1299382333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f11960384544c3e935913363bdb1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ac74f62-59", "ovs_interfaceid": "5ac74f62-5924-4561-9764-37baf7fb4a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Converting VIF {"id": "5ac74f62-5924-4561-9764-37baf7fb4a76", "address": "fa:16:3e:98:f8:b7", "network": {"id": "53d2e1ea-b878-4276-94e0-8cd654e520d8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1299382333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f11960384544c3e935913363bdb1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ac74f62-59", "ovs_interfaceid": "5ac74f62-5924-4561-9764-37baf7fb4a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:f8:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ac74f62-5924-4561-9764-37baf7fb4a76,network=Network(53d2e1ea-b878-4276-94e0-8cd654e520d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ac74f62-59') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG os_vif [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:f8:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ac74f62-5924-4561-9764-37baf7fb4a76,network=Network(53d2e1ea-b878-4276-94e0-8cd654e520d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ac74f62-59') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '70ba0ae4-af4a-5612-a951-5db5fc6cffd7', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ac74f62-59, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ac74f62-59, col_values=(('qos', UUID('cdbedb70-2ca6-4fa3-ab30-df85f03d8276')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ac74f62-59, col_values=(('external_ids', {'iface-id': '5ac74f62-5924-4561-9764-37baf7fb4a76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:f8:b7', 'vm-uuid': 'fb5def2c-c757-4a3c-a832-142bf8c61413'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:54 user nova-compute[74776]: INFO os_vif [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:f8:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ac74f62-5924-4561-9764-37baf7fb4a76,network=Network(53d2e1ea-b878-4276-94e0-8cd654e520d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ac74f62-59')
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] No VIF found with MAC fa:16:3e:98:f8:b7, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.network.neutron [req-fa916b40-4efe-4594-8199-48efe30528ab req-bfe23c37-9f47-479c-acf3-fc8aceebaa1f service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Updated VIF entry in instance network info cache for port 5ac74f62-5924-4561-9764-37baf7fb4a76. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:16:54 user nova-compute[74776]: DEBUG nova.network.neutron [req-fa916b40-4efe-4594-8199-48efe30528ab req-bfe23c37-9f47-479c-acf3-fc8aceebaa1f service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Updating instance_info_cache with network_info: [{"id": "5ac74f62-5924-4561-9764-37baf7fb4a76", "address": "fa:16:3e:98:f8:b7", "network": {"id": "53d2e1ea-b878-4276-94e0-8cd654e520d8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1299382333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f11960384544c3e935913363bdb1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ac74f62-59", "ovs_interfaceid": "5ac74f62-5924-4561-9764-37baf7fb4a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:16:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-fa916b40-4efe-4594-8199-48efe30528ab req-bfe23c37-9f47-479c-acf3-fc8aceebaa1f service nova] Releasing lock "refresh_cache-fb5def2c-c757-4a3c-a832-142bf8c61413" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:16:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:59 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:16:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:16:59 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Instance spawned successfully.
Nov 22 14:16:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:16:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:16:59 user nova-compute[74776]: DEBUG nova.compute.manager [req-893c6996-6b38-445a-b1cd-47d758f56d9c req-1b387287-0c23-46d4-b311-48c57cb13b50 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Received event network-vif-plugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:16:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-893c6996-6b38-445a-b1cd-47d758f56d9c req-1b387287-0c23-46d4-b311-48c57cb13b50 service nova] Acquiring lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:16:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-893c6996-6b38-445a-b1cd-47d758f56d9c req-1b387287-0c23-46d4-b311-48c57cb13b50 service nova] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:16:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-893c6996-6b38-445a-b1cd-47d758f56d9c req-1b387287-0c23-46d4-b311-48c57cb13b50 service nova] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:59 user nova-compute[74776]: DEBUG nova.compute.manager [req-893c6996-6b38-445a-b1cd-47d758f56d9c req-1b387287-0c23-46d4-b311-48c57cb13b50 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] No waiting events found dispatching network-vif-plugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:16:59 user nova-compute[74776]: WARNING nova.compute.manager [req-893c6996-6b38-445a-b1cd-47d758f56d9c req-1b387287-0c23-46d4-b311-48c57cb13b50 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Received unexpected event network-vif-plugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a for instance with vm_state active and task_state None.
Nov 22 14:16:59 user nova-compute[74776]: INFO nova.compute.manager [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Took 7.79 seconds to spawn the instance on the hypervisor.
Nov 22 14:16:59 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:16:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:16:59 user nova-compute[74776]: INFO nova.compute.manager [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Took 9.29 seconds to build instance.
Nov 22 14:16:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ddf45d09-d790-4320-becf-1813ce4c8117 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Lock "fb5def2c-c757-4a3c-a832-142bf8c61413" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.610s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:16:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:00 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:17:00 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 14:17:00 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] There are 0 instances to clean {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 14:17:00 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:17:00 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74776) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 14:17:00 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:17:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:01 user nova-compute[74776]: DEBUG nova.compute.manager [req-1be0fdbc-b2e5-425d-98c5-7f81ac471d22 req-9a14a4bc-13a1-4888-bfdf-7483284886a5 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Received event network-vif-plugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1be0fdbc-b2e5-425d-98c5-7f81ac471d22 req-9a14a4bc-13a1-4888-bfdf-7483284886a5 service nova] Acquiring lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1be0fdbc-b2e5-425d-98c5-7f81ac471d22 req-9a14a4bc-13a1-4888-bfdf-7483284886a5 service nova] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1be0fdbc-b2e5-425d-98c5-7f81ac471d22 req-9a14a4bc-13a1-4888-bfdf-7483284886a5 service nova] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:01 user nova-compute[74776]: DEBUG nova.compute.manager [req-1be0fdbc-b2e5-425d-98c5-7f81ac471d22 req-9a14a4bc-13a1-4888-bfdf-7483284886a5 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] No waiting events found dispatching network-vif-plugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:01 user nova-compute[74776]: WARNING nova.compute.manager [req-1be0fdbc-b2e5-425d-98c5-7f81ac471d22 req-9a14a4bc-13a1-4888-bfdf-7483284886a5 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Received unexpected event network-vif-plugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a for instance with vm_state active and task_state None.
Nov 22 14:17:02 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:17:02 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:17:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:02 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:17:03 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:03 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65/disk --force-share --output=json" returned: 0 in 0.375s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:03 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:03 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:03 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-d1a7a42c-f3e7-44ef-9f7e-a3f850e0ee12 req-3448d02d-601c-4d79-be2c-37b8cb4ea5a9 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received event network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d1a7a42c-f3e7-44ef-9f7e-a3f850e0ee12 req-3448d02d-601c-4d79-be2c-37b8cb4ea5a9 service nova] Acquiring lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d1a7a42c-f3e7-44ef-9f7e-a3f850e0ee12 req-3448d02d-601c-4d79-be2c-37b8cb4ea5a9 service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d1a7a42c-f3e7-44ef-9f7e-a3f850e0ee12 req-3448d02d-601c-4d79-be2c-37b8cb4ea5a9 service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-d1a7a42c-f3e7-44ef-9f7e-a3f850e0ee12 req-3448d02d-601c-4d79-be2c-37b8cb4ea5a9 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] No waiting events found dispatching network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:06 user nova-compute[74776]: WARNING nova.compute.manager [req-d1a7a42c-f3e7-44ef-9f7e-a3f850e0ee12 req-3448d02d-601c-4d79-be2c-37b8cb4ea5a9 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received unexpected event network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e for instance with vm_state active and task_state None.
Nov 22 14:17:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:07 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:17:07 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:17:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=7561MB free_disk=25.62582778930664GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:17:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 232d8284-a99b-40c2-aa36-1de93a25729a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:17:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance fb5def2c-c757-4a3c-a832-142bf8c61413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:17:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 62461965-8bbb-4497-81e7-d9237832f190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:17:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4629d82d-fd02-4a58-a535-b362b493e7c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:17:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 98fb9b54-c428-4a48-b1ff-a976f971b764 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:17:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance e96ab1bf-6f19-4e5f-b79d-f0266988090b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:17:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance d13dd041-8289-4a8b-93a1-bf3e491b9e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:17:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 25deabe8-8cfc-4d40-a734-755d4097baf5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:17:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:17:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.622s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received event network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] Acquiring lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] No waiting events found dispatching network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:08 user nova-compute[74776]: WARNING nova.compute.manager [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received unexpected event network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e for instance with vm_state active and task_state None.
Nov 22 14:17:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] No waiting events found dispatching network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:08 user nova-compute[74776]: WARNING nova.compute.manager [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received unexpected event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 for instance with vm_state active and task_state None.
Nov 22 14:17:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] No waiting events found dispatching network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:08 user nova-compute[74776]: WARNING nova.compute.manager [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received unexpected event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 for instance with vm_state active and task_state None.
Nov 22 14:17:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Received event network-vif-plugged-b3675ad0-6dfc-4731-a999-a16801642163 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] Acquiring lock "232d8284-a99b-40c2-aa36-1de93a25729a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] Lock "232d8284-a99b-40c2-aa36-1de93a25729a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] Lock "232d8284-a99b-40c2-aa36-1de93a25729a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] No waiting events found dispatching network-vif-plugged-b3675ad0-6dfc-4731-a999-a16801642163 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:08 user nova-compute[74776]: WARNING nova.compute.manager [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Received unexpected event network-vif-plugged-b3675ad0-6dfc-4731-a999-a16801642163 for instance with vm_state active and task_state None.
Nov 22 14:17:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Received event network-vif-plugged-b3675ad0-6dfc-4731-a999-a16801642163 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] Acquiring lock "232d8284-a99b-40c2-aa36-1de93a25729a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] Lock "232d8284-a99b-40c2-aa36-1de93a25729a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] Lock "232d8284-a99b-40c2-aa36-1de93a25729a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] No waiting events found dispatching network-vif-plugged-b3675ad0-6dfc-4731-a999-a16801642163 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:08 user nova-compute[74776]: WARNING nova.compute.manager [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Received unexpected event network-vif-plugged-b3675ad0-6dfc-4731-a999-a16801642163 for instance with vm_state active and task_state None.
Nov 22 14:17:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Received event network-vif-plugged-5ac74f62-5924-4561-9764-37baf7fb4a76 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] Acquiring lock "fb5def2c-c757-4a3c-a832-142bf8c61413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] Lock "fb5def2c-c757-4a3c-a832-142bf8c61413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] Lock "fb5def2c-c757-4a3c-a832-142bf8c61413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] No waiting events found dispatching network-vif-plugged-5ac74f62-5924-4561-9764-37baf7fb4a76 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:08 user nova-compute[74776]: WARNING nova.compute.manager [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Received unexpected event network-vif-plugged-5ac74f62-5924-4561-9764-37baf7fb4a76 for instance with vm_state active and task_state None.
Nov 22 14:17:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Received event network-vif-plugged-5ac74f62-5924-4561-9764-37baf7fb4a76 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] Acquiring lock "fb5def2c-c757-4a3c-a832-142bf8c61413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] Lock "fb5def2c-c757-4a3c-a832-142bf8c61413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] Lock "fb5def2c-c757-4a3c-a832-142bf8c61413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] No waiting events found dispatching network-vif-plugged-5ac74f62-5924-4561-9764-37baf7fb4a76 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:08 user nova-compute[74776]: WARNING nova.compute.manager [req-78f6686c-193b-435b-a82b-19d8d45cbeab req-f56922b3-553e-4d16-b733-de993d27e644 service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Received unexpected event network-vif-plugged-5ac74f62-5924-4561-9764-37baf7fb4a76 for instance with vm_state active and task_state None.
Nov 22 14:17:09 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:17:09 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:17:09 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:17:09 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 14:17:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-d13dd041-8289-4a8b-93a1-bf3e491b9e65" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:17:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-d13dd041-8289-4a8b-93a1-bf3e491b9e65" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:17:09 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:17:09 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid d13dd041-8289-4a8b-93a1-bf3e491b9e65 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:17:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:10 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Updating instance_info_cache with network_info: [{"id": "85404a03-3785-4381-96ac-6711e81395f9", "address": "fa:16:3e:10:c7:a0", "network": {"id": "696ca276-acaf-4f2d-85b8-8afd52ce4742", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1692508702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc86266374d46f9b40654b2090067b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85404a03-37", "ovs_interfaceid": "85404a03-3785-4381-96ac-6711e81395f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:17:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-d13dd041-8289-4a8b-93a1-bf3e491b9e65" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:17:10 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:17:10 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:17:10 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:17:10 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:17:10 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:17:10 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:17:10 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:17:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "42b00137-df98-47d9-9d02-29b4707fed30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "42b00137-df98-47d9-9d02-29b4707fed30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:15 user nova-compute[74776]: DEBUG nova.compute.manager [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:17:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:15 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:17:15 user nova-compute[74776]: INFO nova.compute.claims [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Claim successful on node user
Nov 22 14:17:15 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Refreshing inventories for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 14:17:15 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Updating ProviderTree inventory for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 14:17:15 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Updating inventory in ProviderTree for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 14:17:15 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Refreshing aggregate associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, aggregates: None {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 14:17:15 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Refreshing trait associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.651s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG nova.network.neutron [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:17:16 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:17:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG nova.policy [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bdc62f686c7b496cb093b91dcd2d7e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396c01f7adaa4f2dbc6963bd855597f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:17:16 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Creating image(s)
Nov 22 14:17:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "/opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "/opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "/opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.223s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:17:16 user nova-compute[74776]: INFO nova.compute.claims [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Claim successful on node user
Nov 22 14:17:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.195s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk 1073741824" returned: 0 in 0.054s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.197s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:17 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:17:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:17 user nova-compute[74776]: DEBUG nova.network.neutron [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Successfully created port: 1c7ec696-a871-442f-aec4-902014c6ea9a {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:17:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:17 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Cannot resize image /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:17:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:17:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Ensure instance console log exists: /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:17:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:17 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:17:17 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:17:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.679s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:17 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:17:17 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:17:17 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:17:17 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:17:17 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:17:17 user nova-compute[74776]: INFO nova.virt.block_device [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Booting with volume aa29ed11-be21-4eae-9105-ff2d767a3900 at /dev/vda
Nov 22 14:17:17 user nova-compute[74776]: DEBUG nova.policy [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6362afe7c4a4c67b9dca81a3cb21a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d667cb9927d4d5b9a44139c04e035b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:17:17 user nova-compute[74776]: DEBUG os_brick.utils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:17:17 user nova-compute[74776]: INFO oslo.privsep.daemon [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpbd3ra9s9/privsep.sock']
Nov 22 14:17:17 user sudo[85780]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpbd3ra9s9/privsep.sock
Nov 22 14:17:17 user sudo[85780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.network.neutron [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Successfully updated port: 1c7ec696-a871-442f-aec4-902014c6ea9a {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "refresh_cache-42b00137-df98-47d9-9d02-29b4707fed30" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquired lock "refresh_cache-42b00137-df98-47d9-9d02-29b4707fed30" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.network.neutron [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-caf1be19-97e1-4e4d-ac4e-c5366f1cd7fe req-e1a56a6a-6972-4cba-95e8-8f0b7e311e50 service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Received event network-changed-1c7ec696-a871-442f-aec4-902014c6ea9a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-caf1be19-97e1-4e4d-ac4e-c5366f1cd7fe req-e1a56a6a-6972-4cba-95e8-8f0b7e311e50 service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Refreshing instance network info cache due to event network-changed-1c7ec696-a871-442f-aec4-902014c6ea9a. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-caf1be19-97e1-4e4d-ac4e-c5366f1cd7fe req-e1a56a6a-6972-4cba-95e8-8f0b7e311e50 service nova] Acquiring lock "refresh_cache-42b00137-df98-47d9-9d02-29b4707fed30" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.network.neutron [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Successfully created port: b494f667-97c7-4e1e-94c8-9072d1b85d33 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.network.neutron [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Updating instance_info_cache with network_info: [{"id": "1c7ec696-a871-442f-aec4-902014c6ea9a", "address": "fa:16:3e:03:d6:8f", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7ec696-a8", "ovs_interfaceid": "1c7ec696-a871-442f-aec4-902014c6ea9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Releasing lock "refresh_cache-42b00137-df98-47d9-9d02-29b4707fed30" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.compute.manager [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Instance network_info: |[{"id": "1c7ec696-a871-442f-aec4-902014c6ea9a", "address": "fa:16:3e:03:d6:8f", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7ec696-a8", "ovs_interfaceid": "1c7ec696-a871-442f-aec4-902014c6ea9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-caf1be19-97e1-4e4d-ac4e-c5366f1cd7fe req-e1a56a6a-6972-4cba-95e8-8f0b7e311e50 service nova] Acquired lock "refresh_cache-42b00137-df98-47d9-9d02-29b4707fed30" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.network.neutron [req-caf1be19-97e1-4e4d-ac4e-c5366f1cd7fe req-e1a56a6a-6972-4cba-95e8-8f0b7e311e50 service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Refreshing network info cache for port 1c7ec696-a871-442f-aec4-902014c6ea9a {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Start _get_guest_xml network_info=[{"id": "1c7ec696-a871-442f-aec4-902014c6ea9a", "address": "fa:16:3e:03:d6:8f", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7ec696-a8", "ovs_interfaceid": "1c7ec696-a871-442f-aec4-902014c6ea9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:17:18 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:17:18 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:17:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1730019454',display_name='tempest-TestStampPattern-server-1730019454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1730019454',id=9,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwcdcEEHtV9OzSZWCbIN6wDgtlsxdHeeQue3/BMNcqHGBrCc/qx2sDq1Kmpv63TRxJ4I9ODFDrCABhThEkbpTezW8oRAjWlGjr+Las3LmrBBrpcK0n2dEwRuG9SNI1g0w==',key_name='tempest-TestStampPattern-1537282025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='396c01f7adaa4f2dbc6963bd855597f3',ramdisk_id='',reservation_id='r-bmnk9nnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-19907094',owner_user_name='tempest-TestStampPattern-19907094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:17:16Z,user_data=None,user_id='bdc62f686c7b496cb093b91dcd2d7e02',uuid=42b00137-df98-47d9-9d02-29b4707fed30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c7ec696-a871-442f-aec4-902014c6ea9a", "address": "fa:16:3e:03:d6:8f", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7ec696-a8", "ovs_interfaceid": "1c7ec696-a871-442f-aec4-902014c6ea9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Converting VIF {"id": "1c7ec696-a871-442f-aec4-902014c6ea9a", "address": "fa:16:3e:03:d6:8f", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7ec696-a8", "ovs_interfaceid": "1c7ec696-a871-442f-aec4-902014c6ea9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:d6:8f,bridge_name='br-int',has_traffic_filtering=True,id=1c7ec696-a871-442f-aec4-902014c6ea9a,network=Network(d8fe5b03-bd5e-42d1-b634-8150f8a9f32b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c7ec696-a8') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.objects.instance [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lazy-loading 'pci_devices' on Instance uuid 42b00137-df98-47d9-9d02-29b4707fed30 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:17:18 user nova-compute[74776]:   <uuid>42b00137-df98-47d9-9d02-29b4707fed30</uuid>
Nov 22 14:17:18 user nova-compute[74776]:   <name>instance-00000009</name>
Nov 22 14:17:18 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:17:18 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:17:18 user nova-compute[74776]:   <metadata>
Nov 22 14:17:18 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:17:18 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:17:18 user nova-compute[74776]:       <nova:name>tempest-TestStampPattern-server-1730019454</nova:name>
Nov 22 14:17:18 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:17:18</nova:creationTime>
Nov 22 14:17:18 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:17:18 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:17:18 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:17:18 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:17:18 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:17:18 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:17:18 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:17:18 user nova-compute[74776]:       <nova:owner>
Nov 22 14:17:18 user nova-compute[74776]:         <nova:user uuid="bdc62f686c7b496cb093b91dcd2d7e02">tempest-TestStampPattern-19907094-project-member</nova:user>
Nov 22 14:17:18 user nova-compute[74776]:         <nova:project uuid="396c01f7adaa4f2dbc6963bd855597f3">tempest-TestStampPattern-19907094</nova:project>
Nov 22 14:17:18 user nova-compute[74776]:       </nova:owner>
Nov 22 14:17:18 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:17:18 user nova-compute[74776]:       <nova:ports>
Nov 22 14:17:18 user nova-compute[74776]:         <nova:port uuid="1c7ec696-a871-442f-aec4-902014c6ea9a">
Nov 22 14:17:18 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 22 14:17:18 user nova-compute[74776]:         </nova:port>
Nov 22 14:17:18 user nova-compute[74776]:       </nova:ports>
Nov 22 14:17:18 user nova-compute[74776]:     </nova:instance>
Nov 22 14:17:18 user nova-compute[74776]:   </metadata>
Nov 22 14:17:18 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:17:18 user nova-compute[74776]:     <system>
Nov 22 14:17:18 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:17:18 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:17:18 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:17:18 user nova-compute[74776]:       <entry name="serial">42b00137-df98-47d9-9d02-29b4707fed30</entry>
Nov 22 14:17:18 user nova-compute[74776]:       <entry name="uuid">42b00137-df98-47d9-9d02-29b4707fed30</entry>
Nov 22 14:17:18 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:17:18 user nova-compute[74776]:     </system>
Nov 22 14:17:18 user nova-compute[74776]:   </sysinfo>
Nov 22 14:17:18 user nova-compute[74776]:   <os>
Nov 22 14:17:18 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:17:18 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:17:18 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:17:18 user nova-compute[74776]:   </os>
Nov 22 14:17:18 user nova-compute[74776]:   <features>
Nov 22 14:17:18 user nova-compute[74776]:     <acpi/>
Nov 22 14:17:18 user nova-compute[74776]:     <apic/>
Nov 22 14:17:18 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:17:18 user nova-compute[74776]:   </features>
Nov 22 14:17:18 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:17:18 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:17:18 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:17:18 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:17:18 user nova-compute[74776]:   </clock>
Nov 22 14:17:18 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:17:18 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:17:18 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:17:18 user nova-compute[74776]:   </cpu>
Nov 22 14:17:18 user nova-compute[74776]:   <devices>
Nov 22 14:17:18 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:17:18 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:17:18 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk"/>
Nov 22 14:17:18 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:17:18 user nova-compute[74776]:     </disk>
Nov 22 14:17:18 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:17:18 user nova-compute[74776]:       <mac address="fa:16:3e:03:d6:8f"/>
Nov 22 14:17:18 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:17:18 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:17:18 user nova-compute[74776]:       <target dev="tap1c7ec696-a8"/>
Nov 22 14:17:18 user nova-compute[74776]:     </interface>
Nov 22 14:17:18 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:17:18 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/console.log" append="off"/>
Nov 22 14:17:18 user nova-compute[74776]:     </serial>
Nov 22 14:17:18 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:17:18 user nova-compute[74776]:     <video>
Nov 22 14:17:18 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:17:18 user nova-compute[74776]:     </video>
Nov 22 14:17:18 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:17:18 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:17:18 user nova-compute[74776]:     </rng>
Nov 22 14:17:18 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:17:18 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:17:18 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:17:18 user nova-compute[74776]:     </memballoon>
Nov 22 14:17:18 user nova-compute[74776]:   </devices>
Nov 22 14:17:18 user nova-compute[74776]: </domain>
Nov 22 14:17:18 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:17:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1730019454',display_name='tempest-TestStampPattern-server-1730019454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1730019454',id=9,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwcdcEEHtV9OzSZWCbIN6wDgtlsxdHeeQue3/BMNcqHGBrCc/qx2sDq1Kmpv63TRxJ4I9ODFDrCABhThEkbpTezW8oRAjWlGjr+Las3LmrBBrpcK0n2dEwRuG9SNI1g0w==',key_name='tempest-TestStampPattern-1537282025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='396c01f7adaa4f2dbc6963bd855597f3',ramdisk_id='',reservation_id='r-bmnk9nnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-19907094',owner_user_name='tempest-TestStampPattern-19907094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:17:16Z,user_data=None,user_id='bdc62f686c7b496cb093b91dcd2d7e02',uuid=42b00137-df98-47d9-9d02-29b4707fed30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c7ec696-a871-442f-aec4-902014c6ea9a", "address": "fa:16:3e:03:d6:8f", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7ec696-a8", "ovs_interfaceid": "1c7ec696-a871-442f-aec4-902014c6ea9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Converting VIF {"id": "1c7ec696-a871-442f-aec4-902014c6ea9a", "address": "fa:16:3e:03:d6:8f", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7ec696-a8", "ovs_interfaceid": "1c7ec696-a871-442f-aec4-902014c6ea9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:d6:8f,bridge_name='br-int',has_traffic_filtering=True,id=1c7ec696-a871-442f-aec4-902014c6ea9a,network=Network(d8fe5b03-bd5e-42d1-b634-8150f8a9f32b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c7ec696-a8') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG os_vif [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:d6:8f,bridge_name='br-int',has_traffic_filtering=True,id=1c7ec696-a871-442f-aec4-902014c6ea9a,network=Network(d8fe5b03-bd5e-42d1-b634-8150f8a9f32b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c7ec696-a8') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7191aac3-7044-5148-8ce2-51ea9b8ce729', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c7ec696-a8, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c7ec696-a8, col_values=(('qos', UUID('51e62663-ef74-451c-9dc6-100ed2f3c903')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c7ec696-a8, col_values=(('external_ids', {'iface-id': '1c7ec696-a871-442f-aec4-902014c6ea9a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:d6:8f', 'vm-uuid': '42b00137-df98-47d9-9d02-29b4707fed30'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:18 user nova-compute[74776]: INFO os_vif [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:d6:8f,bridge_name='br-int',has_traffic_filtering=True,id=1c7ec696-a871-442f-aec4-902014c6ea9a,network=Network(d8fe5b03-bd5e-42d1-b634-8150f8a9f32b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c7ec696-a8')
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:17:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] No VIF found with MAC fa:16:3e:03:d6:8f, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG nova.network.neutron [req-caf1be19-97e1-4e4d-ac4e-c5366f1cd7fe req-e1a56a6a-6972-4cba-95e8-8f0b7e311e50 service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Updated VIF entry in instance network info cache for port 1c7ec696-a871-442f-aec4-902014c6ea9a. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG nova.network.neutron [req-caf1be19-97e1-4e4d-ac4e-c5366f1cd7fe req-e1a56a6a-6972-4cba-95e8-8f0b7e311e50 service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Updating instance_info_cache with network_info: [{"id": "1c7ec696-a871-442f-aec4-902014c6ea9a", "address": "fa:16:3e:03:d6:8f", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7ec696-a8", "ovs_interfaceid": "1c7ec696-a871-442f-aec4-902014c6ea9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-caf1be19-97e1-4e4d-ac4e-c5366f1cd7fe req-e1a56a6a-6972-4cba-95e8-8f0b7e311e50 service nova] Releasing lock "refresh_cache-42b00137-df98-47d9-9d02-29b4707fed30" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Successfully created port: 217aeb80-f22d-4b93-919a-af8856de5865 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:17:19 user nova-compute[74776]: INFO oslo.privsep.daemon [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Spawned new privsep daemon via rootwrap
Nov 22 14:17:19 user nova-compute[74776]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 22 14:17:19 user nova-compute[74776]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 22 14:17:19 user nova-compute[74776]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 22 14:17:19 user nova-compute[74776]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85789
Nov 22 14:17:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a55c62-ed3d-478d-b5be-eb782044c405]: (2,) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:19 user sudo[85780]: pam_unix(sudo:session): session closed for user root
Nov 22 14:17:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[61148798-b315-4f33-954f-d170d416d20d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:19 user nova-compute[74776]: WARNING os_brick.initiator.connectors.nvmeof [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 22 14:17:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04b34db-b7bd-48ab-98ab-1ab9bfe34313]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b9e389-a5ef-4e2e-b7c5-60a301ce46e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0731576-dffe-437f-8beb-f97b404bca9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:17:19 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:17:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64f6ef1-2e49-449a-b10e-7a3c749775a8]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG os_brick.utils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] <== get_connector_properties: return (1838ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Updating existing volume attachment record: 9264b7d1-1fcb-488c-a061-b9ca9383af6f {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:19 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Successfully created port: 0e366f70-4640-4479-b132-93b103c747f4 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:17:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-cefab7f6-0e64-4622-8202-6127e81e33ab req-3486443f-4b8d-46c0-8b71-50b99c8d7bd9 service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Received event network-vif-plugged-1c7ec696-a871-442f-aec4-902014c6ea9a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cefab7f6-0e64-4622-8202-6127e81e33ab req-3486443f-4b8d-46c0-8b71-50b99c8d7bd9 service nova] Acquiring lock "42b00137-df98-47d9-9d02-29b4707fed30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cefab7f6-0e64-4622-8202-6127e81e33ab req-3486443f-4b8d-46c0-8b71-50b99c8d7bd9 service nova] Lock "42b00137-df98-47d9-9d02-29b4707fed30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cefab7f6-0e64-4622-8202-6127e81e33ab req-3486443f-4b8d-46c0-8b71-50b99c8d7bd9 service nova] Lock "42b00137-df98-47d9-9d02-29b4707fed30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-cefab7f6-0e64-4622-8202-6127e81e33ab req-3486443f-4b8d-46c0-8b71-50b99c8d7bd9 service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] No waiting events found dispatching network-vif-plugged-1c7ec696-a871-442f-aec4-902014c6ea9a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:20 user nova-compute[74776]: WARNING nova.compute.manager [req-cefab7f6-0e64-4622-8202-6127e81e33ab req-3486443f-4b8d-46c0-8b71-50b99c8d7bd9 service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Received unexpected event network-vif-plugged-1c7ec696-a871-442f-aec4-902014c6ea9a for instance with vm_state building and task_state spawning.
Nov 22 14:17:20 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Successfully created port: d3d8dde0-2448-43f6-a03f-f619b90cc56a {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:17:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:21 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Successfully created port: b6190aa4-f199-434a-9953-88ca35f2b483 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:17:21 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Successfully updated port: b494f667-97c7-4e1e-94c8-9072d1b85d33 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:17:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-72dc851c-3145-480a-8737-33d0a8a1ba4d req-14a0fac6-e801-4d2a-9e1c-a293c6ae7769 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-changed-b494f667-97c7-4e1e-94c8-9072d1b85d33 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-72dc851c-3145-480a-8737-33d0a8a1ba4d req-14a0fac6-e801-4d2a-9e1c-a293c6ae7769 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Refreshing instance network info cache due to event network-changed-b494f667-97c7-4e1e-94c8-9072d1b85d33. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:17:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-72dc851c-3145-480a-8737-33d0a8a1ba4d req-14a0fac6-e801-4d2a-9e1c-a293c6ae7769 service nova] Acquiring lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:17:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-72dc851c-3145-480a-8737-33d0a8a1ba4d req-14a0fac6-e801-4d2a-9e1c-a293c6ae7769 service nova] Acquired lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:17:21 user nova-compute[74776]: DEBUG nova.network.neutron [req-72dc851c-3145-480a-8737-33d0a8a1ba4d req-14a0fac6-e801-4d2a-9e1c-a293c6ae7769 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Refreshing network info cache for port b494f667-97c7-4e1e-94c8-9072d1b85d33 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:17:22 user nova-compute[74776]: DEBUG nova.network.neutron [req-72dc851c-3145-480a-8737-33d0a8a1ba4d req-14a0fac6-e801-4d2a-9e1c-a293c6ae7769 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:17:22 user nova-compute[74776]: DEBUG nova.network.neutron [req-72dc851c-3145-480a-8737-33d0a8a1ba4d req-14a0fac6-e801-4d2a-9e1c-a293c6ae7769 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:17:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-72dc851c-3145-480a-8737-33d0a8a1ba4d req-14a0fac6-e801-4d2a-9e1c-a293c6ae7769 service nova] Releasing lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:17:22 user nova-compute[74776]: DEBUG nova.compute.manager [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:17:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:17:22 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Instance spawned successfully.
Nov 22 14:17:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:17:22 user nova-compute[74776]: DEBUG nova.compute.manager [req-c8fba3d9-a7e0-4c9d-a410-1bb477916d3e req-9a630b32-882c-4dee-a971-54aa5b47a51f service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Received event network-vif-plugged-1c7ec696-a871-442f-aec4-902014c6ea9a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c8fba3d9-a7e0-4c9d-a410-1bb477916d3e req-9a630b32-882c-4dee-a971-54aa5b47a51f service nova] Acquiring lock "42b00137-df98-47d9-9d02-29b4707fed30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c8fba3d9-a7e0-4c9d-a410-1bb477916d3e req-9a630b32-882c-4dee-a971-54aa5b47a51f service nova] Lock "42b00137-df98-47d9-9d02-29b4707fed30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c8fba3d9-a7e0-4c9d-a410-1bb477916d3e req-9a630b32-882c-4dee-a971-54aa5b47a51f service nova] Lock "42b00137-df98-47d9-9d02-29b4707fed30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:22 user nova-compute[74776]: DEBUG nova.compute.manager [req-c8fba3d9-a7e0-4c9d-a410-1bb477916d3e req-9a630b32-882c-4dee-a971-54aa5b47a51f service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] No waiting events found dispatching network-vif-plugged-1c7ec696-a871-442f-aec4-902014c6ea9a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:22 user nova-compute[74776]: WARNING nova.compute.manager [req-c8fba3d9-a7e0-4c9d-a410-1bb477916d3e req-9a630b32-882c-4dee-a971-54aa5b47a51f service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Received unexpected event network-vif-plugged-1c7ec696-a871-442f-aec4-902014c6ea9a for instance with vm_state building and task_state spawning.
Nov 22 14:17:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:17:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:17:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:17:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:17:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:17:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:17:22 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Successfully updated port: 67c21334-fae7-424e-8612-ae7727f6c999 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:17:22 user nova-compute[74776]: INFO nova.compute.manager [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Took 6.11 seconds to spawn the instance on the hypervisor.
Nov 22 14:17:22 user nova-compute[74776]: DEBUG nova.compute.manager [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:17:22 user nova-compute[74776]: INFO nova.compute.manager [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Took 7.33 seconds to build instance.
Nov 22 14:17:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-15fd2a85-4c75-494d-abaf-3688f421a84d tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "42b00137-df98-47d9-9d02-29b4707fed30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.470s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:23 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Successfully updated port: 116116d9-ff23-4e79-ac3c-c8744dd13158 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:17:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:23 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Successfully updated port: 217aeb80-f22d-4b93-919a-af8856de5865 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:17:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-750cffcd-12fb-42ec-98e4-e83f0a030b72 req-42db07f0-d3ab-41ce-ab6c-f1145f7099f1 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-changed-67c21334-fae7-424e-8612-ae7727f6c999 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-750cffcd-12fb-42ec-98e4-e83f0a030b72 req-42db07f0-d3ab-41ce-ab6c-f1145f7099f1 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Refreshing instance network info cache due to event network-changed-67c21334-fae7-424e-8612-ae7727f6c999. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:17:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-750cffcd-12fb-42ec-98e4-e83f0a030b72 req-42db07f0-d3ab-41ce-ab6c-f1145f7099f1 service nova] Acquiring lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:17:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-750cffcd-12fb-42ec-98e4-e83f0a030b72 req-42db07f0-d3ab-41ce-ab6c-f1145f7099f1 service nova] Acquired lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:17:23 user nova-compute[74776]: DEBUG nova.network.neutron [req-750cffcd-12fb-42ec-98e4-e83f0a030b72 req-42db07f0-d3ab-41ce-ab6c-f1145f7099f1 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Refreshing network info cache for port 67c21334-fae7-424e-8612-ae7727f6c999 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:17:24 user nova-compute[74776]: DEBUG nova.network.neutron [req-750cffcd-12fb-42ec-98e4-e83f0a030b72 req-42db07f0-d3ab-41ce-ab6c-f1145f7099f1 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:17:24 user nova-compute[74776]: DEBUG nova.network.neutron [req-750cffcd-12fb-42ec-98e4-e83f0a030b72 req-42db07f0-d3ab-41ce-ab6c-f1145f7099f1 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:17:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-750cffcd-12fb-42ec-98e4-e83f0a030b72 req-42db07f0-d3ab-41ce-ab6c-f1145f7099f1 service nova] Releasing lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:17:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-750cffcd-12fb-42ec-98e4-e83f0a030b72 req-42db07f0-d3ab-41ce-ab6c-f1145f7099f1 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-changed-116116d9-ff23-4e79-ac3c-c8744dd13158 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-750cffcd-12fb-42ec-98e4-e83f0a030b72 req-42db07f0-d3ab-41ce-ab6c-f1145f7099f1 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Refreshing instance network info cache due to event network-changed-116116d9-ff23-4e79-ac3c-c8744dd13158. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:17:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-750cffcd-12fb-42ec-98e4-e83f0a030b72 req-42db07f0-d3ab-41ce-ab6c-f1145f7099f1 service nova] Acquiring lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:17:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-750cffcd-12fb-42ec-98e4-e83f0a030b72 req-42db07f0-d3ab-41ce-ab6c-f1145f7099f1 service nova] Acquired lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:17:24 user nova-compute[74776]: DEBUG nova.network.neutron [req-750cffcd-12fb-42ec-98e4-e83f0a030b72 req-42db07f0-d3ab-41ce-ab6c-f1145f7099f1 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Refreshing network info cache for port 116116d9-ff23-4e79-ac3c-c8744dd13158 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:17:24 user nova-compute[74776]: DEBUG nova.network.neutron [req-750cffcd-12fb-42ec-98e4-e83f0a030b72 req-42db07f0-d3ab-41ce-ab6c-f1145f7099f1 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:17:24 user nova-compute[74776]: DEBUG nova.network.neutron [req-750cffcd-12fb-42ec-98e4-e83f0a030b72 req-42db07f0-d3ab-41ce-ab6c-f1145f7099f1 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:17:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-750cffcd-12fb-42ec-98e4-e83f0a030b72 req-42db07f0-d3ab-41ce-ab6c-f1145f7099f1 service nova] Releasing lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:17:24 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Successfully updated port: 0e366f70-4640-4479-b132-93b103c747f4 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:17:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:25 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Successfully updated port: d3d8dde0-2448-43f6-a03f-f619b90cc56a {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Successfully updated port: b6190aa4-f199-434a-9953-88ca35f2b483 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-changed-217aeb80-f22d-4b93-919a-af8856de5865 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Refreshing instance network info cache due to event network-changed-217aeb80-f22d-4b93-919a-af8856de5865. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] Acquiring lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] Acquired lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG nova.network.neutron [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Refreshing network info cache for port 217aeb80-f22d-4b93-919a-af8856de5865 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Acquiring lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG nova.network.neutron [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:17:26 user nova-compute[74776]: INFO nova.virt.block_device [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Booting with volume 10ff42dd-0151-4e1c-9ec4-c36af0f80618 at /dev/vdb
Nov 22 14:17:26 user nova-compute[74776]: DEBUG os_brick.utils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3112fb-e7fb-4c0c-a590-38c6178b4882]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fef0e02-3068-418f-88e2-e8c0be204432]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3be3649-82bd-43dd-ad5d-085d28baed1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f050227-6e42-44b5-ad51-1688aa2e06ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG nova.network.neutron [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] Releasing lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-changed-0e366f70-4640-4479-b132-93b103c747f4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Refreshing instance network info cache due to event network-changed-0e366f70-4640-4479-b132-93b103c747f4. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] Acquiring lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] Acquired lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG nova.network.neutron [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Refreshing network info cache for port 0e366f70-4640-4479-b132-93b103c747f4 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:17:26 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bca9610-978a-468d-8fc0-f92ddce62291]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG os_brick.utils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Updating existing volume attachment record: fb05b019-0ae2-4d03-b110-b6fcd1965271 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG nova.network.neutron [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG nova.network.neutron [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] Releasing lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-changed-d3d8dde0-2448-43f6-a03f-f619b90cc56a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Refreshing instance network info cache due to event network-changed-d3d8dde0-2448-43f6-a03f-f619b90cc56a. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] Acquiring lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] Acquired lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG nova.network.neutron [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Refreshing network info cache for port d3d8dde0-2448-43f6-a03f-f619b90cc56a {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:17:26 user nova-compute[74776]: DEBUG nova.network.neutron [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:17:27 user nova-compute[74776]: DEBUG nova.network.neutron [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:17:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-faa801fe-5a9f-4498-b058-3f4fa0c49a95 req-7ed10d4a-28ba-4e7a-87ee-13d006a36d4f service nova] Releasing lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:17:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Acquired lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:17:27 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:17:27 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:17:28 user nova-compute[74776]: DEBUG nova.compute.manager [req-7bfdbd36-08b8-4143-be79-c5689ed2c64d req-089d9efb-b87d-4ae7-b1bc-9ec8e28a5310 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-changed-b6190aa4-f199-434a-9953-88ca35f2b483 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:28 user nova-compute[74776]: DEBUG nova.compute.manager [req-7bfdbd36-08b8-4143-be79-c5689ed2c64d req-089d9efb-b87d-4ae7-b1bc-9ec8e28a5310 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Refreshing instance network info cache due to event network-changed-b6190aa4-f199-434a-9953-88ca35f2b483. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:17:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7bfdbd36-08b8-4143-be79-c5689ed2c64d req-089d9efb-b87d-4ae7-b1bc-9ec8e28a5310 service nova] Acquiring lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:17:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:29 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Updating instance_info_cache with network_info: [{"id": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "address": "fa:16:3e:d0:0e:24", "network": {"id": "80ca7997-9b10-4a5f-a42a-4bbbde2937b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-773521062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb494f667-97", "ovs_interfaceid": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67c21334-fae7-424e-8612-ae7727f6c999", "address": "fa:16:3e:76:a6:88", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c21334-fa", "ovs_interfaceid": "67c21334-fae7-424e-8612-ae7727f6c999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "116116d9-ff23-4e79-ac3c-c8744dd13158", "address": "fa:16:3e:73:5e:dc", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116116d9-ff", "ovs_interfaceid": "116116d9-ff23-4e79-ac3c-c8744dd13158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "217aeb80-f22d-4b93-919a-af8856de5865", "address": "fa:16:3e:89:09:5e", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217aeb80-f2", "ovs_interfaceid": "217aeb80-f22d-4b93-919a-af8856de5865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e366f70-4640-4479-b132-93b103c747f4", "address": "fa:16:3e:f7:15:56", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e366f70-46", "ovs_interfaceid": "0e366f70-4640-4479-b132-93b103c747f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "address": "fa:16:3e:f2:77:1c", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d8dde0-24", "ovs_interfaceid": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6190aa4-f199-434a-9953-88ca35f2b483", "address": "fa:16:3e:b8:a3:a0", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6190aa4-f1", "ovs_interfaceid": "b6190aa4-f199-434a-9953-88ca35f2b483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:17:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Releasing lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:17:29 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Instance network_info: |[{"id": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "address": "fa:16:3e:d0:0e:24", "network": {"id": "80ca7997-9b10-4a5f-a42a-4bbbde2937b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-773521062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb494f667-97", "ovs_interfaceid": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67c21334-fae7-424e-8612-ae7727f6c999", "address": "fa:16:3e:76:a6:88", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c21334-fa", "ovs_interfaceid": "67c21334-fae7-424e-8612-ae7727f6c999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "116116d9-ff23-4e79-ac3c-c8744dd13158", "address": "fa:16:3e:73:5e:dc", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116116d9-ff", "ovs_interfaceid": "116116d9-ff23-4e79-ac3c-c8744dd13158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "217aeb80-f22d-4b93-919a-af8856de5865", "address": "fa:16:3e:89:09:5e", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217aeb80-f2", "ovs_interfaceid": "217aeb80-f22d-4b93-919a-af8856de5865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e366f70-4640-4479-b132-93b103c747f4", "address": "fa:16:3e:f7:15:56", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e366f70-46", "ovs_interfaceid": "0e366f70-4640-4479-b132-93b103c747f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "address": "fa:16:3e:f2:77:1c", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d8dde0-24", "ovs_interfaceid": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6190aa4-f199-434a-9953-88ca35f2b483", "address": "fa:16:3e:b8:a3:a0", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6190aa4-f1", "ovs_interfaceid": "b6190aa4-f199-434a-9953-88ca35f2b483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:17:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7bfdbd36-08b8-4143-be79-c5689ed2c64d req-089d9efb-b87d-4ae7-b1bc-9ec8e28a5310 service nova] Acquired lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:17:29 user nova-compute[74776]: DEBUG nova.network.neutron [req-7bfdbd36-08b8-4143-be79-c5689ed2c64d req-089d9efb-b87d-4ae7-b1bc-9ec8e28a5310 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Refreshing network info cache for port b6190aa4-f199-434a-9953-88ca35f2b483 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:17:29 user nova-compute[74776]: DEBUG nova.network.neutron [req-7bfdbd36-08b8-4143-be79-c5689ed2c64d req-089d9efb-b87d-4ae7-b1bc-9ec8e28a5310 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Updated VIF entry in instance network info cache for port b6190aa4-f199-434a-9953-88ca35f2b483. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:17:29 user nova-compute[74776]: DEBUG nova.network.neutron [req-7bfdbd36-08b8-4143-be79-c5689ed2c64d req-089d9efb-b87d-4ae7-b1bc-9ec8e28a5310 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Updating instance_info_cache with network_info: [{"id": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "address": "fa:16:3e:d0:0e:24", "network": {"id": "80ca7997-9b10-4a5f-a42a-4bbbde2937b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-773521062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb494f667-97", "ovs_interfaceid": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67c21334-fae7-424e-8612-ae7727f6c999", "address": "fa:16:3e:76:a6:88", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c21334-fa", "ovs_interfaceid": "67c21334-fae7-424e-8612-ae7727f6c999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "116116d9-ff23-4e79-ac3c-c8744dd13158", "address": "fa:16:3e:73:5e:dc", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116116d9-ff", "ovs_interfaceid": "116116d9-ff23-4e79-ac3c-c8744dd13158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "217aeb80-f22d-4b93-919a-af8856de5865", "address": "fa:16:3e:89:09:5e", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217aeb80-f2", "ovs_interfaceid": "217aeb80-f22d-4b93-919a-af8856de5865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e366f70-4640-4479-b132-93b103c747f4", "address": "fa:16:3e:f7:15:56", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e366f70-46", "ovs_interfaceid": "0e366f70-4640-4479-b132-93b103c747f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "address": "fa:16:3e:f2:77:1c", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d8dde0-24", "ovs_interfaceid": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6190aa4-f199-434a-9953-88ca35f2b483", "address": "fa:16:3e:b8:a3:a0", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6190aa4-f1", "ovs_interfaceid": "b6190aa4-f199-434a-9953-88ca35f2b483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:17:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7bfdbd36-08b8-4143-be79-c5689ed2c64d req-089d9efb-b87d-4ae7-b1bc-9ec8e28a5310 service nova] Releasing lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:17:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:37 user nova-compute[74776]: INFO nova.virt.block_device [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Booting with volume e6ae6271-8e40-4f31-af64-c86afa4cf2ab at /dev/vdc
Nov 22 14:17:37 user nova-compute[74776]: DEBUG os_brick.utils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:17:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2661c07-0028-4c1c-adba-7408a227ea8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7e7491-5e6a-4fd9-80dd-fd178e6de353]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b196b08-4f84-4e18-b017-871071bca637]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b541613-f794-4510-be75-99f005e0305c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:17:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:17:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:17:37 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:17:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[48242a75-b2c9-4203-b2ae-af61d72abe89]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:17:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:17:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:17:37 user nova-compute[74776]: DEBUG os_brick.utils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:17:37 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Updating existing volume attachment record: 5dc6f12b-5c37-4209-a4c1-2af9ee87aef8 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:17:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:17:46 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Creating image(s)
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Did not create local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Ensure instance console log exists: /opt/stack/data/nova/instances/67bb65da-d976-40da-9568-2c1e3930fb7f/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Start _get_guest_xml network_info=[{"id": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "address": "fa:16:3e:d0:0e:24", "network": {"id": "80ca7997-9b10-4a5f-a42a-4bbbde2937b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-773521062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb494f667-97", "ovs_interfaceid": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67c21334-fae7-424e-8612-ae7727f6c999", "address": "fa:16:3e:76:a6:88", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c21334-fa", "ovs_interfaceid": "67c21334-fae7-424e-8612-ae7727f6c999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "116116d9-ff23-4e79-ac3c-c8744dd13158", "address": "fa:16:3e:73:5e:dc", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116116d9-ff", "ovs_interfaceid": "116116d9-ff23-4e79-ac3c-c8744dd13158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "217aeb80-f22d-4b93-919a-af8856de5865", "address": "fa:16:3e:89:09:5e", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217aeb80-f2", "ovs_interfaceid": "217aeb80-f22d-4b93-919a-af8856de5865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e366f70-4640-4479-b132-93b103c747f4", "address": "fa:16:3e:f7:15:56", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e366f70-46", "ovs_interfaceid": "0e366f70-4640-4479-b132-93b103c747f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "address": "fa:16:3e:f2:77:1c", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d8dde0-24", "ovs_interfaceid": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6190aa4-f199-434a-9953-88ca35f2b483", "address": "fa:16:3e:b8:a3:a0", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6190aa4-f1", "ovs_interfaceid": "b6190aa4-f199-434a-9953-88ca35f2b483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9264b7d1-1fcb-488c-a061-b9ca9383af6f', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaGRgOnx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '67bb65da-d976-40da-9568-2c1e3930fb7f', 'attached_at': '', 'detached_at': '', 'volume_id': 'aa29ed11-be21-4eae-9105-ff2d767a3900', 'serial': 'aa29ed11-be21-4eae-9105-ff2d767a3900'}, 'boot_index': 0, 'volume_type': None}, {'attachment_id': 'fb05b019-0ae2-4d03-b110-b6fcd1965271', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqHFlNCm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '67bb65da-d976-40da-9568-2c1e3930fb7f', 'attached_at': '', 'detached_at': '', 'volume_id': '10ff42dd-0151-4e1c-9ec4-c36af0f80618', 'serial': '10ff42dd-0151-4e1c-9ec4-c36af0f80618'}, 'boot_index': 1, 'volume_type': None}, {'attachment_id': '5dc6f12b-5c37-4209-a4c1-2af9ee87aef8', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrMqpECs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '67bb65da-d976-40da-9568-2c1e3930fb7f', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6ae6271-8e40-4f31-af64-c86afa4cf2ab', 'serial': 'e6ae6271-8e40-4f31-af64-c86afa4cf2ab'}, 'boot_index': 2, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:17:46 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:17:46 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG os_brick.initiator.connector [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Factory for ISCSI on None {{(pid=74776) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaGRgOnx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:17:46 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:17:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:17:46 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:17:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:17:46 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3d5cd3-0c9a-40ee-bd71-bd88e86d944d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:17:46 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[571db727-344b-4830-b95f-bbcbe211808d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900] added
Nov 22 14:17:46 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0522a094-074e-4ae0-b2a8-bac207f67b99]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5670f59-2c5d-4968-9ac3-178fbf328a99]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XaGRgOnx {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XaGRgOnx" returned: 0 in 0.032s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ac0839-4349-40a5-875d-213561288bcb]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XaGRgOnx'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b4a5ba-6c61-43b9-9b0a-e4d31cb360ba]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[81144d5b-4701-4b58-b0f7-34a9bd98362d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 14:17:47 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 14:17:47 user nova-compute[74776]:  {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:17:47 user nova-compute[74776]: WARNING os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 14:17:47 user nova-compute[74776]: 
Nov 22 14:17:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ae2bce-e372-4f20-ac6a-6797acb7c437]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900, portal: 172.16.0.220,3260]
Nov 22 14:17:47 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900, portal: 172.16.0.220,3260] successful.
Nov 22 14:17:47 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a376bf-70ec-46c5-a15f-ebf9045c3bb7]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6e9bde-b46e-46b2-a863-5066ea5ef076]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:17:47 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:17:47 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f211c02-a216-40a4-a6fc-87a6e0020953]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:17:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaGRgOnx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26139663630306665', 'path': '/dev/sdb'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139663630306665', 'path': '/dev/sdb'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqHFlNCm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:17:48 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:17:48 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:17:48 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0a3dec-8272-4a62-bc0a-9d8bdc427393]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:17:48 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e51efa-cdb4-4d15-a27e-94de0123761e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618] added
Nov 22 14:17:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0044e8-187c-4f58-b34f-b5a96b032771]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cca9aba-f030-4501-8ba8-2a93a24d6463]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fqHFlNCm {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fqHFlNCm" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4748fc93-9a9f-4a85-b8ca-d623f5e1a1f4]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fqHFlNCm'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[62de21a3-5c1c-4dbe-a321-24668b83e8a1]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[033f20ad-91dc-4ceb-9df5-38da23841dcb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:17:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:17:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[698e76e0-b320-404a-808a-83352284d968]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618, portal: 172.16.0.220,3260]
Nov 22 14:17:48 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618, portal: 172.16.0.220,3260] successful.
Nov 22 14:17:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[538410a0-8973-4061-b0f1-3a1bc99869d0]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ed8feb-2fb2-4d1a-af47-f0034918158f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:17:48 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:17:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:17:48 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:17:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe60e52f-561e-4ceb-8536-232a63503ec8]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqHFlNCm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:17:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26533613766326634', 'path': '/dev/sdc'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533613766326634', 'path': '/dev/sdc'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrMqpECs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:17:49 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:17:49 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:17:49 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0992d2e-0208-41bb-8997-1162c91705b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:17:49 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6920cd50-d4e2-4fec-8424-d0dcbb5d0310]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab] added
Nov 22 14:17:49 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbb3fea-2f5c-4a65-bd91-03b5ccf0e087]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb606974-97f9-4ea0-8774-402efda83131]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrMqpECs {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrMqpECs" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd62d1af-f1da-4ad9-b710-582f4ff75280]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wrMqpECs'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4878f896-5f49-46a1-b5d9-8ed32395d405]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe3851c-0114-47cf-a99c-6b04a43dc5e7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:17:49 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:17:49 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:17:49 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:17:49 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[11db2ecf-97c1-4721-ba8c-355b3205a679]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab, portal: 172.16.0.220,3260]
Nov 22 14:17:49 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab, portal: 172.16.0.220,3260] successful.
Nov 22 14:17:49 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[190ff67a-dfa1-464e-88fa-02e002521638]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b80364-371a-4857-b91a-18cc47155bf4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:17:49 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:17:49 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:17:49 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:17:49 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:17:49 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:17:49 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1563fb-286d-4a47-9a0b-c774253feac8]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrMqpECs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:17:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23438376534623031', 'path': '/dev/sdd'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438376534623031', 'path': '/dev/sdd'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-225287415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-225287415',id=10,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFAE2muYctKQ5lA2KDuTvrad/Zh8vGOeEN7ZZ/jC2h1qv/x7tvIDFYvTC96h8AMspYnkoKKy6/U8CI0G+VpnDmPKl1G9/7zLdmaOLWoBHF3EF4jlJrYBSOMjPvuXiKwFg==',key_name='tempest-keypair-84908803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d667cb9927d4d5b9a44139c04e035b2',ramdisk_id='',reservation_id='r-rofrtvr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-144853562',owner_user_name='tempest-TaggedBootDevicesTest_v242-144853562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6362afe7c4a4c67b9dca81a3cb21a06',uuid=67bb65da-d976-40da-9568-2c1e3930fb7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "address": "fa:16:3e:d0:0e:24", "network": {"id": "80ca7997-9b10-4a5f-a42a-4bbbde2937b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-773521062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb494f667-97", "ovs_interfaceid": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converting VIF {"id": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "address": "fa:16:3e:d0:0e:24", "network": {"id": "80ca7997-9b10-4a5f-a42a-4bbbde2937b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-773521062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb494f667-97", "ovs_interfaceid": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:0e:24,bridge_name='br-int',has_traffic_filtering=True,id=b494f667-97c7-4e1e-94c8-9072d1b85d33,network=Network(80ca7997-9b10-4a5f-a42a-4bbbde2937b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb494f667-97') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-225287415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-225287415',id=10,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFAE2muYctKQ5lA2KDuTvrad/Zh8vGOeEN7ZZ/jC2h1qv/x7tvIDFYvTC96h8AMspYnkoKKy6/U8CI0G+VpnDmPKl1G9/7zLdmaOLWoBHF3EF4jlJrYBSOMjPvuXiKwFg==',key_name='tempest-keypair-84908803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d667cb9927d4d5b9a44139c04e035b2',ramdisk_id='',reservation_id='r-rofrtvr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-144853562',owner_user_name='tempest-TaggedBootDevicesTest_v242-144853562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6362afe7c4a4c67b9dca81a3cb21a06',uuid=67bb65da-d976-40da-9568-2c1e3930fb7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67c21334-fae7-424e-8612-ae7727f6c999", "address": "fa:16:3e:76:a6:88", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c21334-fa", "ovs_interfaceid": "67c21334-fae7-424e-8612-ae7727f6c999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converting VIF {"id": "67c21334-fae7-424e-8612-ae7727f6c999", "address": "fa:16:3e:76:a6:88", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c21334-fa", "ovs_interfaceid": "67c21334-fae7-424e-8612-ae7727f6c999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=67c21334-fae7-424e-8612-ae7727f6c999,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap67c21334-fa') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-225287415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-225287415',id=10,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFAE2muYctKQ5lA2KDuTvrad/Zh8vGOeEN7ZZ/jC2h1qv/x7tvIDFYvTC96h8AMspYnkoKKy6/U8CI0G+VpnDmPKl1G9/7zLdmaOLWoBHF3EF4jlJrYBSOMjPvuXiKwFg==',key_name='tempest-keypair-84908803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d667cb9927d4d5b9a44139c04e035b2',ramdisk_id='',reservation_id='r-rofrtvr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-144853562',owner_user_name='tempest-TaggedBootDevicesTest_v242-144853562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6362afe7c4a4c67b9dca81a3cb21a06',uuid=67bb65da-d976-40da-9568-2c1e3930fb7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "116116d9-ff23-4e79-ac3c-c8744dd13158", "address": "fa:16:3e:73:5e:dc", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116116d9-ff", "ovs_interfaceid": "116116d9-ff23-4e79-ac3c-c8744dd13158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converting VIF {"id": "116116d9-ff23-4e79-ac3c-c8744dd13158", "address": "fa:16:3e:73:5e:dc", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116116d9-ff", "ovs_interfaceid": "116116d9-ff23-4e79-ac3c-c8744dd13158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:5e:dc,bridge_name='br-int',has_traffic_filtering=True,id=116116d9-ff23-4e79-ac3c-c8744dd13158,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap116116d9-ff') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-225287415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-225287415',id=10,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFAE2muYctKQ5lA2KDuTvrad/Zh8vGOeEN7ZZ/jC2h1qv/x7tvIDFYvTC96h8AMspYnkoKKy6/U8CI0G+VpnDmPKl1G9/7zLdmaOLWoBHF3EF4jlJrYBSOMjPvuXiKwFg==',key_name='tempest-keypair-84908803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d667cb9927d4d5b9a44139c04e035b2',ramdisk_id='',reservation_id='r-rofrtvr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-144853562',owner_user_name='tempest-TaggedBootDevicesTest_v242-144853562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6362afe7c4a4c67b9dca81a3cb21a06',uuid=67bb65da-d976-40da-9568-2c1e3930fb7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "217aeb80-f22d-4b93-919a-af8856de5865", "address": "fa:16:3e:89:09:5e", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217aeb80-f2", "ovs_interfaceid": "217aeb80-f22d-4b93-919a-af8856de5865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converting VIF {"id": "217aeb80-f22d-4b93-919a-af8856de5865", "address": "fa:16:3e:89:09:5e", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217aeb80-f2", "ovs_interfaceid": "217aeb80-f22d-4b93-919a-af8856de5865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:09:5e,bridge_name='br-int',has_traffic_filtering=True,id=217aeb80-f22d-4b93-919a-af8856de5865,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217aeb80-f2') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-225287415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-225287415',id=10,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFAE2muYctKQ5lA2KDuTvrad/Zh8vGOeEN7ZZ/jC2h1qv/x7tvIDFYvTC96h8AMspYnkoKKy6/U8CI0G+VpnDmPKl1G9/7zLdmaOLWoBHF3EF4jlJrYBSOMjPvuXiKwFg==',key_name='tempest-keypair-84908803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d667cb9927d4d5b9a44139c04e035b2',ramdisk_id='',reservation_id='r-rofrtvr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-144853562',owner_user_name='tempest-TaggedBootDevicesTest_v242-144853562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6362afe7c4a4c67b9dca81a3cb21a06',uuid=67bb65da-d976-40da-9568-2c1e3930fb7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e366f70-4640-4479-b132-93b103c747f4", "address": "fa:16:3e:f7:15:56", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e366f70-46", "ovs_interfaceid": "0e366f70-4640-4479-b132-93b103c747f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converting VIF {"id": "0e366f70-4640-4479-b132-93b103c747f4", "address": "fa:16:3e:f7:15:56", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e366f70-46", "ovs_interfaceid": "0e366f70-4640-4479-b132-93b103c747f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:15:56,bridge_name='br-int',has_traffic_filtering=True,id=0e366f70-4640-4479-b132-93b103c747f4,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e366f70-46') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-225287415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-225287415',id=10,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFAE2muYctKQ5lA2KDuTvrad/Zh8vGOeEN7ZZ/jC2h1qv/x7tvIDFYvTC96h8AMspYnkoKKy6/U8CI0G+VpnDmPKl1G9/7zLdmaOLWoBHF3EF4jlJrYBSOMjPvuXiKwFg==',key_name='tempest-keypair-84908803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d667cb9927d4d5b9a44139c04e035b2',ramdisk_id='',reservation_id='r-rofrtvr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-144853562',owner_user_name='tempest-TaggedBootDevicesTest_v242-144853562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6362afe7c4a4c67b9dca81a3cb21a06',uuid=67bb65da-d976-40da-9568-2c1e3930fb7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "address": "fa:16:3e:f2:77:1c", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d8dde0-24", "ovs_interfaceid": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converting VIF {"id": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "address": "fa:16:3e:f2:77:1c", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d8dde0-24", "ovs_interfaceid": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:77:1c,bridge_name='br-int',has_traffic_filtering=True,id=d3d8dde0-2448-43f6-a03f-f619b90cc56a,network=Network(364a210c-05af-4b9d-8a55-f703d7db277d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d8dde0-24') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-225287415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-225287415',id=10,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFAE2muYctKQ5lA2KDuTvrad/Zh8vGOeEN7ZZ/jC2h1qv/x7tvIDFYvTC96h8AMspYnkoKKy6/U8CI0G+VpnDmPKl1G9/7zLdmaOLWoBHF3EF4jlJrYBSOMjPvuXiKwFg==',key_name='tempest-keypair-84908803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d667cb9927d4d5b9a44139c04e035b2',ramdisk_id='',reservation_id='r-rofrtvr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-144853562',owner_user_name='tempest-TaggedBootDevicesTest_v242-144853562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6362afe7c4a4c67b9dca81a3cb21a06',uuid=67bb65da-d976-40da-9568-2c1e3930fb7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6190aa4-f199-434a-9953-88ca35f2b483", "address": "fa:16:3e:b8:a3:a0", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6190aa4-f1", "ovs_interfaceid": "b6190aa4-f199-434a-9953-88ca35f2b483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converting VIF {"id": "b6190aa4-f199-434a-9953-88ca35f2b483", "address": "fa:16:3e:b8:a3:a0", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6190aa4-f1", "ovs_interfaceid": "b6190aa4-f199-434a-9953-88ca35f2b483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a3:a0,bridge_name='br-int',has_traffic_filtering=True,id=b6190aa4-f199-434a-9953-88ca35f2b483,network=Network(364a210c-05af-4b9d-8a55-f703d7db277d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6190aa4-f1') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.objects.instance [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lazy-loading 'pci_devices' on Instance uuid 67bb65da-d976-40da-9568-2c1e3930fb7f {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:17:50 user nova-compute[74776]:   <uuid>67bb65da-d976-40da-9568-2c1e3930fb7f</uuid>
Nov 22 14:17:50 user nova-compute[74776]:   <name>instance-0000000a</name>
Nov 22 14:17:50 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:17:50 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:17:50 user nova-compute[74776]:   <metadata>
Nov 22 14:17:50 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:17:50 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:17:50 user nova-compute[74776]:       <nova:name>tempest-device-tagging-server-225287415</nova:name>
Nov 22 14:17:50 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:17:46</nova:creationTime>
Nov 22 14:17:50 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:17:50 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:17:50 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:17:50 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:17:50 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:17:50 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:17:50 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:17:50 user nova-compute[74776]:       <nova:owner>
Nov 22 14:17:50 user nova-compute[74776]:         <nova:user uuid="a6362afe7c4a4c67b9dca81a3cb21a06">tempest-TaggedBootDevicesTest_v242-144853562-project-member</nova:user>
Nov 22 14:17:50 user nova-compute[74776]:         <nova:project uuid="2d667cb9927d4d5b9a44139c04e035b2">tempest-TaggedBootDevicesTest_v242-144853562</nova:project>
Nov 22 14:17:50 user nova-compute[74776]:       </nova:owner>
Nov 22 14:17:50 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:17:50 user nova-compute[74776]:       <nova:ports>
Nov 22 14:17:50 user nova-compute[74776]:         <nova:port uuid="b494f667-97c7-4e1e-94c8-9072d1b85d33">
Nov 22 14:17:50 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 22 14:17:50 user nova-compute[74776]:         </nova:port>
Nov 22 14:17:50 user nova-compute[74776]:         <nova:port uuid="67c21334-fae7-424e-8612-ae7727f6c999">
Nov 22 14:17:50 user nova-compute[74776]:           <nova:ip type="fixed" address="10.1.1.154" ipVersion="4"/>
Nov 22 14:17:50 user nova-compute[74776]:         </nova:port>
Nov 22 14:17:50 user nova-compute[74776]:         <nova:port uuid="116116d9-ff23-4e79-ac3c-c8744dd13158">
Nov 22 14:17:50 user nova-compute[74776]:           <nova:ip type="fixed" address="10.1.1.157" ipVersion="4"/>
Nov 22 14:17:50 user nova-compute[74776]:         </nova:port>
Nov 22 14:17:50 user nova-compute[74776]:         <nova:port uuid="217aeb80-f22d-4b93-919a-af8856de5865">
Nov 22 14:17:50 user nova-compute[74776]:           <nova:ip type="fixed" address="10.1.1.155" ipVersion="4"/>
Nov 22 14:17:50 user nova-compute[74776]:         </nova:port>
Nov 22 14:17:50 user nova-compute[74776]:         <nova:port uuid="0e366f70-4640-4479-b132-93b103c747f4">
Nov 22 14:17:50 user nova-compute[74776]:           <nova:ip type="fixed" address="10.1.1.16" ipVersion="4"/>
Nov 22 14:17:50 user nova-compute[74776]:         </nova:port>
Nov 22 14:17:50 user nova-compute[74776]:         <nova:port uuid="d3d8dde0-2448-43f6-a03f-f619b90cc56a">
Nov 22 14:17:50 user nova-compute[74776]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 22 14:17:50 user nova-compute[74776]:         </nova:port>
Nov 22 14:17:50 user nova-compute[74776]:         <nova:port uuid="b6190aa4-f199-434a-9953-88ca35f2b483">
Nov 22 14:17:50 user nova-compute[74776]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 22 14:17:50 user nova-compute[74776]:         </nova:port>
Nov 22 14:17:50 user nova-compute[74776]:       </nova:ports>
Nov 22 14:17:50 user nova-compute[74776]:     </nova:instance>
Nov 22 14:17:50 user nova-compute[74776]:   </metadata>
Nov 22 14:17:50 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:17:50 user nova-compute[74776]:     <system>
Nov 22 14:17:50 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:17:50 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:17:50 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:17:50 user nova-compute[74776]:       <entry name="serial">67bb65da-d976-40da-9568-2c1e3930fb7f</entry>
Nov 22 14:17:50 user nova-compute[74776]:       <entry name="uuid">67bb65da-d976-40da-9568-2c1e3930fb7f</entry>
Nov 22 14:17:50 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:17:50 user nova-compute[74776]:     </system>
Nov 22 14:17:50 user nova-compute[74776]:   </sysinfo>
Nov 22 14:17:50 user nova-compute[74776]:   <os>
Nov 22 14:17:50 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:17:50 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:17:50 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:17:50 user nova-compute[74776]:   </os>
Nov 22 14:17:50 user nova-compute[74776]:   <features>
Nov 22 14:17:50 user nova-compute[74776]:     <acpi/>
Nov 22 14:17:50 user nova-compute[74776]:     <apic/>
Nov 22 14:17:50 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:17:50 user nova-compute[74776]:   </features>
Nov 22 14:17:50 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:17:50 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:17:50 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:17:50 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:17:50 user nova-compute[74776]:   </clock>
Nov 22 14:17:50 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:17:50 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:17:50 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:17:50 user nova-compute[74776]:   </cpu>
Nov 22 14:17:50 user nova-compute[74776]:   <devices>
Nov 22 14:17:50 user nova-compute[74776]:     <disk type="file" device="cdrom">
Nov 22 14:17:50 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none"/>
Nov 22 14:17:50 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/67bb65da-d976-40da-9568-2c1e3930fb7f/disk.config"/>
Nov 22 14:17:50 user nova-compute[74776]:       <target dev="hda" bus="ide"/>
Nov 22 14:17:50 user nova-compute[74776]:     </disk>
Nov 22 14:17:50 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:17:50 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:17:50 user nova-compute[74776]:       <source dev="/dev/sdb"/>
Nov 22 14:17:50 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:17:50 user nova-compute[74776]:       <serial>aa29ed11-be21-4eae-9105-ff2d767a3900</serial>
Nov 22 14:17:50 user nova-compute[74776]:     </disk>
Nov 22 14:17:50 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:17:50 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:17:50 user nova-compute[74776]:       <source dev="/dev/sdc"/>
Nov 22 14:17:50 user nova-compute[74776]:       <target dev="vdb" bus="virtio"/>
Nov 22 14:17:50 user nova-compute[74776]:       <serial>10ff42dd-0151-4e1c-9ec4-c36af0f80618</serial>
Nov 22 14:17:50 user nova-compute[74776]:     </disk>
Nov 22 14:17:50 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:17:50 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:17:50 user nova-compute[74776]:       <source dev="/dev/sdd"/>
Nov 22 14:17:50 user nova-compute[74776]:       <target dev="vdc" bus="virtio"/>
Nov 22 14:17:50 user nova-compute[74776]:       <serial>e6ae6271-8e40-4f31-af64-c86afa4cf2ab</serial>
Nov 22 14:17:50 user nova-compute[74776]:     </disk>
Nov 22 14:17:50 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:17:50 user nova-compute[74776]:       <mac address="fa:16:3e:d0:0e:24"/>
Nov 22 14:17:50 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:17:50 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:17:50 user nova-compute[74776]:       <target dev="tapb494f667-97"/>
Nov 22 14:17:50 user nova-compute[74776]:     </interface>
Nov 22 14:17:50 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:17:50 user nova-compute[74776]:       <mac address="fa:16:3e:76:a6:88"/>
Nov 22 14:17:50 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:17:50 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:17:50 user nova-compute[74776]:       <target dev="tap67c21334-fa"/>
Nov 22 14:17:50 user nova-compute[74776]:     </interface>
Nov 22 14:17:50 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:17:50 user nova-compute[74776]:       <mac address="fa:16:3e:73:5e:dc"/>
Nov 22 14:17:50 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:17:50 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:17:50 user nova-compute[74776]:       <target dev="tap116116d9-ff"/>
Nov 22 14:17:50 user nova-compute[74776]:     </interface>
Nov 22 14:17:50 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:17:50 user nova-compute[74776]:       <mac address="fa:16:3e:89:09:5e"/>
Nov 22 14:17:50 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:17:50 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:17:50 user nova-compute[74776]:       <target dev="tap217aeb80-f2"/>
Nov 22 14:17:50 user nova-compute[74776]:     </interface>
Nov 22 14:17:50 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:17:50 user nova-compute[74776]:       <mac address="fa:16:3e:f7:15:56"/>
Nov 22 14:17:50 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:17:50 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:17:50 user nova-compute[74776]:       <target dev="tap0e366f70-46"/>
Nov 22 14:17:50 user nova-compute[74776]:     </interface>
Nov 22 14:17:50 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:17:50 user nova-compute[74776]:       <mac address="fa:16:3e:f2:77:1c"/>
Nov 22 14:17:50 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:17:50 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:17:50 user nova-compute[74776]:       <target dev="tapd3d8dde0-24"/>
Nov 22 14:17:50 user nova-compute[74776]:     </interface>
Nov 22 14:17:50 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:17:50 user nova-compute[74776]:       <mac address="fa:16:3e:b8:a3:a0"/>
Nov 22 14:17:50 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:17:50 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:17:50 user nova-compute[74776]:       <target dev="tapb6190aa4-f1"/>
Nov 22 14:17:50 user nova-compute[74776]:     </interface>
Nov 22 14:17:50 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:17:50 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/67bb65da-d976-40da-9568-2c1e3930fb7f/console.log" append="off"/>
Nov 22 14:17:50 user nova-compute[74776]:     </serial>
Nov 22 14:17:50 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:17:50 user nova-compute[74776]:     <video>
Nov 22 14:17:50 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:17:50 user nova-compute[74776]:     </video>
Nov 22 14:17:50 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:17:50 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:17:50 user nova-compute[74776]:     </rng>
Nov 22 14:17:50 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:17:50 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:17:50 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:17:50 user nova-compute[74776]:     </memballoon>
Nov 22 14:17:50 user nova-compute[74776]:   </devices>
Nov 22 14:17:50 user nova-compute[74776]: </domain>
Nov 22 14:17:50 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-225287415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-225287415',id=10,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFAE2muYctKQ5lA2KDuTvrad/Zh8vGOeEN7ZZ/jC2h1qv/x7tvIDFYvTC96h8AMspYnkoKKy6/U8CI0G+VpnDmPKl1G9/7zLdmaOLWoBHF3EF4jlJrYBSOMjPvuXiKwFg==',key_name='tempest-keypair-84908803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d667cb9927d4d5b9a44139c04e035b2',ramdisk_id='',reservation_id='r-rofrtvr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-144853562',owner_user_name='tempest-TaggedBootDevicesTest_v242-144853562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6362afe7c4a4c67b9dca81a3cb21a06',uuid=67bb65da-d976-40da-9568-2c1e3930fb7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "address": "fa:16:3e:d0:0e:24", "network": {"id": "80ca7997-9b10-4a5f-a42a-4bbbde2937b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-773521062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb494f667-97", "ovs_interfaceid": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converting VIF {"id": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "address": "fa:16:3e:d0:0e:24", "network": {"id": "80ca7997-9b10-4a5f-a42a-4bbbde2937b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-773521062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb494f667-97", "ovs_interfaceid": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:0e:24,bridge_name='br-int',has_traffic_filtering=True,id=b494f667-97c7-4e1e-94c8-9072d1b85d33,network=Network(80ca7997-9b10-4a5f-a42a-4bbbde2937b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb494f667-97') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG os_vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:0e:24,bridge_name='br-int',has_traffic_filtering=True,id=b494f667-97c7-4e1e-94c8-9072d1b85d33,network=Network(80ca7997-9b10-4a5f-a42a-4bbbde2937b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb494f667-97') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dca8665e-1cf3-5be3-9c62-fd6c370a3ef4', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb494f667-97, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb494f667-97, col_values=(('qos', UUID('ee3d25e0-86a5-46c1-b0e6-a65b78517577')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb494f667-97, col_values=(('external_ids', {'iface-id': 'b494f667-97c7-4e1e-94c8-9072d1b85d33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:0e:24', 'vm-uuid': '67bb65da-d976-40da-9568-2c1e3930fb7f'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:50 user nova-compute[74776]: INFO os_vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:0e:24,bridge_name='br-int',has_traffic_filtering=True,id=b494f667-97c7-4e1e-94c8-9072d1b85d33,network=Network(80ca7997-9b10-4a5f-a42a-4bbbde2937b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb494f667-97')
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-225287415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-225287415',id=10,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFAE2muYctKQ5lA2KDuTvrad/Zh8vGOeEN7ZZ/jC2h1qv/x7tvIDFYvTC96h8AMspYnkoKKy6/U8CI0G+VpnDmPKl1G9/7zLdmaOLWoBHF3EF4jlJrYBSOMjPvuXiKwFg==',key_name='tempest-keypair-84908803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d667cb9927d4d5b9a44139c04e035b2',ramdisk_id='',reservation_id='r-rofrtvr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-144853562',owner_user_name='tempest-TaggedBootDevicesTest_v242-144853562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6362afe7c4a4c67b9dca81a3cb21a06',uuid=67bb65da-d976-40da-9568-2c1e3930fb7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67c21334-fae7-424e-8612-ae7727f6c999", "address": "fa:16:3e:76:a6:88", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c21334-fa", "ovs_interfaceid": "67c21334-fae7-424e-8612-ae7727f6c999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converting VIF {"id": "67c21334-fae7-424e-8612-ae7727f6c999", "address": "fa:16:3e:76:a6:88", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c21334-fa", "ovs_interfaceid": "67c21334-fae7-424e-8612-ae7727f6c999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=67c21334-fae7-424e-8612-ae7727f6c999,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap67c21334-fa') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG os_vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=67c21334-fae7-424e-8612-ae7727f6c999,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap67c21334-fa') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b195d0f9-a660-5c6b-b198-5a525548d962', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67c21334-fa, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67c21334-fa, col_values=(('qos', UUID('40f66bb5-6488-4a7f-8074-5771e6130c32')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67c21334-fa, col_values=(('external_ids', {'iface-id': '67c21334-fae7-424e-8612-ae7727f6c999', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:a6:88', 'vm-uuid': '67bb65da-d976-40da-9568-2c1e3930fb7f'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:50 user nova-compute[74776]: INFO os_vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=67c21334-fae7-424e-8612-ae7727f6c999,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap67c21334-fa')
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-225287415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-225287415',id=10,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFAE2muYctKQ5lA2KDuTvrad/Zh8vGOeEN7ZZ/jC2h1qv/x7tvIDFYvTC96h8AMspYnkoKKy6/U8CI0G+VpnDmPKl1G9/7zLdmaOLWoBHF3EF4jlJrYBSOMjPvuXiKwFg==',key_name='tempest-keypair-84908803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d667cb9927d4d5b9a44139c04e035b2',ramdisk_id='',reservation_id='r-rofrtvr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-144853562',owner_user_name='tempest-TaggedBootDevicesTest_v242-144853562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6362afe7c4a4c67b9dca81a3cb21a06',uuid=67bb65da-d976-40da-9568-2c1e3930fb7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "116116d9-ff23-4e79-ac3c-c8744dd13158", "address": "fa:16:3e:73:5e:dc", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116116d9-ff", "ovs_interfaceid": "116116d9-ff23-4e79-ac3c-c8744dd13158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converting VIF {"id": "116116d9-ff23-4e79-ac3c-c8744dd13158", "address": "fa:16:3e:73:5e:dc", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116116d9-ff", "ovs_interfaceid": "116116d9-ff23-4e79-ac3c-c8744dd13158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:5e:dc,bridge_name='br-int',has_traffic_filtering=True,id=116116d9-ff23-4e79-ac3c-c8744dd13158,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap116116d9-ff') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG os_vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:5e:dc,bridge_name='br-int',has_traffic_filtering=True,id=116116d9-ff23-4e79-ac3c-c8744dd13158,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap116116d9-ff') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c0e5e48-9598-553c-a6ff-aca9e38e6130', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap116116d9-ff, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap116116d9-ff, col_values=(('qos', UUID('913df32e-44a3-47e2-9681-c7c54af8e070')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap116116d9-ff, col_values=(('external_ids', {'iface-id': '116116d9-ff23-4e79-ac3c-c8744dd13158', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:5e:dc', 'vm-uuid': '67bb65da-d976-40da-9568-2c1e3930fb7f'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: INFO os_vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:5e:dc,bridge_name='br-int',has_traffic_filtering=True,id=116116d9-ff23-4e79-ac3c-c8744dd13158,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap116116d9-ff')
Nov 22 14:17:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-225287415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-225287415',id=10,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFAE2muYctKQ5lA2KDuTvrad/Zh8vGOeEN7ZZ/jC2h1qv/x7tvIDFYvTC96h8AMspYnkoKKy6/U8CI0G+VpnDmPKl1G9/7zLdmaOLWoBHF3EF4jlJrYBSOMjPvuXiKwFg==',key_name='tempest-keypair-84908803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d667cb9927d4d5b9a44139c04e035b2',ramdisk_id='',reservation_id='r-rofrtvr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-144853562',owner_user_name='tempest-TaggedBootDevicesTest_v242-144853562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6362afe7c4a4c67b9dca81a3cb21a06',uuid=67bb65da-d976-40da-9568-2c1e3930fb7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "217aeb80-f22d-4b93-919a-af8856de5865", "address": "fa:16:3e:89:09:5e", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217aeb80-f2", "ovs_interfaceid": "217aeb80-f22d-4b93-919a-af8856de5865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converting VIF {"id": "217aeb80-f22d-4b93-919a-af8856de5865", "address": "fa:16:3e:89:09:5e", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217aeb80-f2", "ovs_interfaceid": "217aeb80-f22d-4b93-919a-af8856de5865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:09:5e,bridge_name='br-int',has_traffic_filtering=True,id=217aeb80-f22d-4b93-919a-af8856de5865,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217aeb80-f2') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG os_vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:09:5e,bridge_name='br-int',has_traffic_filtering=True,id=217aeb80-f22d-4b93-919a-af8856de5865,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217aeb80-f2') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1e09f59-a6d1-5e73-89c2-169700c7cbb9', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap217aeb80-f2, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap217aeb80-f2, col_values=(('qos', UUID('126fc054-d251-4047-8fd6-88cf4ac0c18b')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap217aeb80-f2, col_values=(('external_ids', {'iface-id': '217aeb80-f22d-4b93-919a-af8856de5865', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:09:5e', 'vm-uuid': '67bb65da-d976-40da-9568-2c1e3930fb7f'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: INFO os_vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:09:5e,bridge_name='br-int',has_traffic_filtering=True,id=217aeb80-f22d-4b93-919a-af8856de5865,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217aeb80-f2')
Nov 22 14:17:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-225287415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-225287415',id=10,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFAE2muYctKQ5lA2KDuTvrad/Zh8vGOeEN7ZZ/jC2h1qv/x7tvIDFYvTC96h8AMspYnkoKKy6/U8CI0G+VpnDmPKl1G9/7zLdmaOLWoBHF3EF4jlJrYBSOMjPvuXiKwFg==',key_name='tempest-keypair-84908803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d667cb9927d4d5b9a44139c04e035b2',ramdisk_id='',reservation_id='r-rofrtvr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-144853562',owner_user_name='tempest-TaggedBootDevicesTest_v242-144853562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6362afe7c4a4c67b9dca81a3cb21a06',uuid=67bb65da-d976-40da-9568-2c1e3930fb7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e366f70-4640-4479-b132-93b103c747f4", "address": "fa:16:3e:f7:15:56", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e366f70-46", "ovs_interfaceid": "0e366f70-4640-4479-b132-93b103c747f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converting VIF {"id": "0e366f70-4640-4479-b132-93b103c747f4", "address": "fa:16:3e:f7:15:56", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e366f70-46", "ovs_interfaceid": "0e366f70-4640-4479-b132-93b103c747f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:15:56,bridge_name='br-int',has_traffic_filtering=True,id=0e366f70-4640-4479-b132-93b103c747f4,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e366f70-46') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG os_vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:15:56,bridge_name='br-int',has_traffic_filtering=True,id=0e366f70-4640-4479-b132-93b103c747f4,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e366f70-46') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c081155c-9149-5cf6-b3aa-4dc728aa4e8e', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e366f70-46, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e366f70-46, col_values=(('qos', UUID('1f582baa-ff24-42aa-a6fc-a253df204c1c')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e366f70-46, col_values=(('external_ids', {'iface-id': '0e366f70-4640-4479-b132-93b103c747f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:15:56', 'vm-uuid': '67bb65da-d976-40da-9568-2c1e3930fb7f'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: INFO os_vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:15:56,bridge_name='br-int',has_traffic_filtering=True,id=0e366f70-4640-4479-b132-93b103c747f4,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e366f70-46')
Nov 22 14:17:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-225287415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-225287415',id=10,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFAE2muYctKQ5lA2KDuTvrad/Zh8vGOeEN7ZZ/jC2h1qv/x7tvIDFYvTC96h8AMspYnkoKKy6/U8CI0G+VpnDmPKl1G9/7zLdmaOLWoBHF3EF4jlJrYBSOMjPvuXiKwFg==',key_name='tempest-keypair-84908803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d667cb9927d4d5b9a44139c04e035b2',ramdisk_id='',reservation_id='r-rofrtvr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-144853562',owner_user_name='tempest-TaggedBootDevicesTest_v242-144853562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6362afe7c4a4c67b9dca81a3cb21a06',uuid=67bb65da-d976-40da-9568-2c1e3930fb7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "address": "fa:16:3e:f2:77:1c", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d8dde0-24", "ovs_interfaceid": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converting VIF {"id": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "address": "fa:16:3e:f2:77:1c", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d8dde0-24", "ovs_interfaceid": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:77:1c,bridge_name='br-int',has_traffic_filtering=True,id=d3d8dde0-2448-43f6-a03f-f619b90cc56a,network=Network(364a210c-05af-4b9d-8a55-f703d7db277d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d8dde0-24') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG os_vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:77:1c,bridge_name='br-int',has_traffic_filtering=True,id=d3d8dde0-2448-43f6-a03f-f619b90cc56a,network=Network(364a210c-05af-4b9d-8a55-f703d7db277d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d8dde0-24') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4ad89ef-d8ad-5126-bcc2-1ba308db06dc', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3d8dde0-24, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3d8dde0-24, col_values=(('qos', UUID('dd5d4b07-9066-4b20-9b57-00b50c090ae4')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3d8dde0-24, col_values=(('external_ids', {'iface-id': 'd3d8dde0-2448-43f6-a03f-f619b90cc56a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:77:1c', 'vm-uuid': '67bb65da-d976-40da-9568-2c1e3930fb7f'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: INFO os_vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:77:1c,bridge_name='br-int',has_traffic_filtering=True,id=d3d8dde0-2448-43f6-a03f-f619b90cc56a,network=Network(364a210c-05af-4b9d-8a55-f703d7db277d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d8dde0-24')
Nov 22 14:17:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-225287415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-225287415',id=10,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFAE2muYctKQ5lA2KDuTvrad/Zh8vGOeEN7ZZ/jC2h1qv/x7tvIDFYvTC96h8AMspYnkoKKy6/U8CI0G+VpnDmPKl1G9/7zLdmaOLWoBHF3EF4jlJrYBSOMjPvuXiKwFg==',key_name='tempest-keypair-84908803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d667cb9927d4d5b9a44139c04e035b2',ramdisk_id='',reservation_id='r-rofrtvr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-144853562',owner_user_name='tempest-TaggedBootDevicesTest_v242-144853562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6362afe7c4a4c67b9dca81a3cb21a06',uuid=67bb65da-d976-40da-9568-2c1e3930fb7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6190aa4-f199-434a-9953-88ca35f2b483", "address": "fa:16:3e:b8:a3:a0", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6190aa4-f1", "ovs_interfaceid": "b6190aa4-f199-434a-9953-88ca35f2b483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converting VIF {"id": "b6190aa4-f199-434a-9953-88ca35f2b483", "address": "fa:16:3e:b8:a3:a0", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6190aa4-f1", "ovs_interfaceid": "b6190aa4-f199-434a-9953-88ca35f2b483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a3:a0,bridge_name='br-int',has_traffic_filtering=True,id=b6190aa4-f199-434a-9953-88ca35f2b483,network=Network(364a210c-05af-4b9d-8a55-f703d7db277d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6190aa4-f1') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG os_vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a3:a0,bridge_name='br-int',has_traffic_filtering=True,id=b6190aa4-f199-434a-9953-88ca35f2b483,network=Network(364a210c-05af-4b9d-8a55-f703d7db277d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6190aa4-f1') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f2b13af-6a4f-5ae5-885c-f092cb06c6fa', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6190aa4-f1, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb6190aa4-f1, col_values=(('qos', UUID('c423375b-79a2-4602-9951-c3a9a664ba06')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb6190aa4-f1, col_values=(('external_ids', {'iface-id': 'b6190aa4-f199-434a-9953-88ca35f2b483', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:a3:a0', 'vm-uuid': '67bb65da-d976-40da-9568-2c1e3930fb7f'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:51 user nova-compute[74776]: INFO os_vif [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a3:a0,bridge_name='br-int',has_traffic_filtering=True,id=b6190aa4-f199-434a-9953-88ca35f2b483,network=Network(364a210c-05af-4b9d-8a55-f703d7db277d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6190aa4-f1')
Nov 22 14:17:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] No BDM found with device name hda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] No VIF found with MAC fa:16:3e:d0:0e:24, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] No VIF found with MAC fa:16:3e:f7:15:56, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:17:51 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Using config drive
Nov 22 14:17:51 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Creating config drive at /opt/stack/data/nova/instances/67bb65da-d976-40da-9568-2c1e3930fb7f/disk.config
Nov 22 14:17:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/67bb65da-d976-40da-9568-2c1e3930fb7f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9ivkw014 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:17:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/67bb65da-d976-40da-9568-2c1e3930fb7f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9ivkw014" returned: 0 in 0.053s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:17:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-27fe9cc0-506f-417b-b38f-5faf2d5b0098 req-296089a7-689b-4334-9837-183a1bb6ede2 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-plugged-b494f667-97c7-4e1e-94c8-9072d1b85d33 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-27fe9cc0-506f-417b-b38f-5faf2d5b0098 req-296089a7-689b-4334-9837-183a1bb6ede2 service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-27fe9cc0-506f-417b-b38f-5faf2d5b0098 req-296089a7-689b-4334-9837-183a1bb6ede2 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-27fe9cc0-506f-417b-b38f-5faf2d5b0098 req-296089a7-689b-4334-9837-183a1bb6ede2 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-27fe9cc0-506f-417b-b38f-5faf2d5b0098 req-296089a7-689b-4334-9837-183a1bb6ede2 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-plugged-b494f667-97c7-4e1e-94c8-9072d1b85d33 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:53 user nova-compute[74776]: WARNING nova.compute.manager [req-27fe9cc0-506f-417b-b38f-5faf2d5b0098 req-296089a7-689b-4334-9837-183a1bb6ede2 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received unexpected event network-vif-plugged-b494f667-97c7-4e1e-94c8-9072d1b85d33 for instance with vm_state building and task_state spawning.
Nov 22 14:17:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG nova.compute.manager [req-2f6fd58b-619f-4527-aff2-f94063566e7a req-0f9c49e8-d8ad-4eab-ae1a-f5e8693d6d82 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-plugged-116116d9-ff23-4e79-ac3c-c8744dd13158 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2f6fd58b-619f-4527-aff2-f94063566e7a req-0f9c49e8-d8ad-4eab-ae1a-f5e8693d6d82 service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2f6fd58b-619f-4527-aff2-f94063566e7a req-0f9c49e8-d8ad-4eab-ae1a-f5e8693d6d82 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2f6fd58b-619f-4527-aff2-f94063566e7a req-0f9c49e8-d8ad-4eab-ae1a-f5e8693d6d82 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG nova.compute.manager [req-2f6fd58b-619f-4527-aff2-f94063566e7a req-0f9c49e8-d8ad-4eab-ae1a-f5e8693d6d82 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-plugged-116116d9-ff23-4e79-ac3c-c8744dd13158 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:54 user nova-compute[74776]: WARNING nova.compute.manager [req-2f6fd58b-619f-4527-aff2-f94063566e7a req-0f9c49e8-d8ad-4eab-ae1a-f5e8693d6d82 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received unexpected event network-vif-plugged-116116d9-ff23-4e79-ac3c-c8744dd13158 for instance with vm_state building and task_state spawning.
Nov 22 14:17:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG nova.compute.manager [req-223483e5-7001-4751-98b7-b0192916a2fb req-1d2118a3-8159-44bc-b801-bdf02d017237 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-plugged-217aeb80-f22d-4b93-919a-af8856de5865 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-223483e5-7001-4751-98b7-b0192916a2fb req-1d2118a3-8159-44bc-b801-bdf02d017237 service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-223483e5-7001-4751-98b7-b0192916a2fb req-1d2118a3-8159-44bc-b801-bdf02d017237 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-223483e5-7001-4751-98b7-b0192916a2fb req-1d2118a3-8159-44bc-b801-bdf02d017237 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG nova.compute.manager [req-223483e5-7001-4751-98b7-b0192916a2fb req-1d2118a3-8159-44bc-b801-bdf02d017237 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-plugged-217aeb80-f22d-4b93-919a-af8856de5865 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:54 user nova-compute[74776]: WARNING nova.compute.manager [req-223483e5-7001-4751-98b7-b0192916a2fb req-1d2118a3-8159-44bc-b801-bdf02d017237 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received unexpected event network-vif-plugged-217aeb80-f22d-4b93-919a-af8856de5865 for instance with vm_state building and task_state spawning.
Nov 22 14:17:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG nova.compute.manager [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-plugged-b494f667-97c7-4e1e-94c8-9072d1b85d33 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG nova.compute.manager [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-plugged-b494f667-97c7-4e1e-94c8-9072d1b85d33 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:55 user nova-compute[74776]: WARNING nova.compute.manager [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received unexpected event network-vif-plugged-b494f667-97c7-4e1e-94c8-9072d1b85d33 for instance with vm_state building and task_state spawning.
Nov 22 14:17:55 user nova-compute[74776]: DEBUG nova.compute.manager [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-plugged-67c21334-fae7-424e-8612-ae7727f6c999 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG nova.compute.manager [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-plugged-67c21334-fae7-424e-8612-ae7727f6c999 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:55 user nova-compute[74776]: WARNING nova.compute.manager [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received unexpected event network-vif-plugged-67c21334-fae7-424e-8612-ae7727f6c999 for instance with vm_state building and task_state spawning.
Nov 22 14:17:55 user nova-compute[74776]: DEBUG nova.compute.manager [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-plugged-67c21334-fae7-424e-8612-ae7727f6c999 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG nova.compute.manager [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-plugged-67c21334-fae7-424e-8612-ae7727f6c999 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:55 user nova-compute[74776]: WARNING nova.compute.manager [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received unexpected event network-vif-plugged-67c21334-fae7-424e-8612-ae7727f6c999 for instance with vm_state building and task_state spawning.
Nov 22 14:17:55 user nova-compute[74776]: DEBUG nova.compute.manager [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-plugged-b6190aa4-f199-434a-9953-88ca35f2b483 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG nova.compute.manager [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-plugged-b6190aa4-f199-434a-9953-88ca35f2b483 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:55 user nova-compute[74776]: WARNING nova.compute.manager [req-42414581-c4d2-40ed-babb-8e7ebd9d154d req-bfed727e-68f4-4427-9e3b-3af7b9f5c2fa service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received unexpected event network-vif-plugged-b6190aa4-f199-434a-9953-88ca35f2b483 for instance with vm_state building and task_state spawning.
Nov 22 14:17:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-4345add6-9c14-4ef9-a70b-970d908b64f3 req-4c41631b-173d-4858-8b2b-0197d03b5136 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-plugged-116116d9-ff23-4e79-ac3c-c8744dd13158 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4345add6-9c14-4ef9-a70b-970d908b64f3 req-4c41631b-173d-4858-8b2b-0197d03b5136 service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4345add6-9c14-4ef9-a70b-970d908b64f3 req-4c41631b-173d-4858-8b2b-0197d03b5136 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4345add6-9c14-4ef9-a70b-970d908b64f3 req-4c41631b-173d-4858-8b2b-0197d03b5136 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-4345add6-9c14-4ef9-a70b-970d908b64f3 req-4c41631b-173d-4858-8b2b-0197d03b5136 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-plugged-116116d9-ff23-4e79-ac3c-c8744dd13158 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:56 user nova-compute[74776]: WARNING nova.compute.manager [req-4345add6-9c14-4ef9-a70b-970d908b64f3 req-4c41631b-173d-4858-8b2b-0197d03b5136 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received unexpected event network-vif-plugged-116116d9-ff23-4e79-ac3c-c8744dd13158 for instance with vm_state building and task_state spawning.
Nov 22 14:17:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-plugged-217aeb80-f22d-4b93-919a-af8856de5865 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-plugged-217aeb80-f22d-4b93-919a-af8856de5865 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:56 user nova-compute[74776]: WARNING nova.compute.manager [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received unexpected event network-vif-plugged-217aeb80-f22d-4b93-919a-af8856de5865 for instance with vm_state building and task_state spawning.
Nov 22 14:17:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-plugged-0e366f70-4640-4479-b132-93b103c747f4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-plugged-0e366f70-4640-4479-b132-93b103c747f4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:56 user nova-compute[74776]: WARNING nova.compute.manager [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received unexpected event network-vif-plugged-0e366f70-4640-4479-b132-93b103c747f4 for instance with vm_state building and task_state spawning.
Nov 22 14:17:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-plugged-0e366f70-4640-4479-b132-93b103c747f4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-plugged-0e366f70-4640-4479-b132-93b103c747f4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:56 user nova-compute[74776]: WARNING nova.compute.manager [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received unexpected event network-vif-plugged-0e366f70-4640-4479-b132-93b103c747f4 for instance with vm_state building and task_state spawning.
Nov 22 14:17:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-plugged-d3d8dde0-2448-43f6-a03f-f619b90cc56a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-plugged-d3d8dde0-2448-43f6-a03f-f619b90cc56a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:56 user nova-compute[74776]: WARNING nova.compute.manager [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received unexpected event network-vif-plugged-d3d8dde0-2448-43f6-a03f-f619b90cc56a for instance with vm_state building and task_state spawning.
Nov 22 14:17:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-plugged-d3d8dde0-2448-43f6-a03f-f619b90cc56a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-plugged-d3d8dde0-2448-43f6-a03f-f619b90cc56a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:56 user nova-compute[74776]: WARNING nova.compute.manager [req-60d3e4c4-c3d9-4b8f-b2dd-f7beb0eabd40 req-97dd0168-4f80-41bc-92d4-9f3a4a672054 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received unexpected event network-vif-plugged-d3d8dde0-2448-43f6-a03f-f619b90cc56a for instance with vm_state building and task_state spawning.
Nov 22 14:17:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:17:57 user nova-compute[74776]: DEBUG nova.compute.manager [req-f97e10ba-9523-4cb7-acfb-427519d915aa req-621bbac5-b631-406e-a2b2-60d2a3e9fee8 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-plugged-b6190aa4-f199-434a-9953-88ca35f2b483 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:17:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f97e10ba-9523-4cb7-acfb-427519d915aa req-621bbac5-b631-406e-a2b2-60d2a3e9fee8 service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:17:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f97e10ba-9523-4cb7-acfb-427519d915aa req-621bbac5-b631-406e-a2b2-60d2a3e9fee8 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:17:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f97e10ba-9523-4cb7-acfb-427519d915aa req-621bbac5-b631-406e-a2b2-60d2a3e9fee8 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:57 user nova-compute[74776]: DEBUG nova.compute.manager [req-f97e10ba-9523-4cb7-acfb-427519d915aa req-621bbac5-b631-406e-a2b2-60d2a3e9fee8 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-plugged-b6190aa4-f199-434a-9953-88ca35f2b483 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:17:57 user nova-compute[74776]: WARNING nova.compute.manager [req-f97e10ba-9523-4cb7-acfb-427519d915aa req-621bbac5-b631-406e-a2b2-60d2a3e9fee8 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received unexpected event network-vif-plugged-b6190aa4-f199-434a-9953-88ca35f2b483 for instance with vm_state building and task_state spawning.
Nov 22 14:17:57 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:17:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:17:57 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Instance spawned successfully.
Nov 22 14:17:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:17:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:17:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:17:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:17:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:17:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:17:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:17:57 user nova-compute[74776]: INFO nova.compute.manager [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Took 11.12 seconds to spawn the instance on the hypervisor.
Nov 22 14:17:57 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:17:58 user nova-compute[74776]: INFO nova.compute.manager [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Took 41.24 seconds to build instance.
Nov 22 14:17:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4fbadca7-946e-49ca-9eec-badd99c73f70 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.359s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:17:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:02 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:18:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:18:02 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:18:02 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:03 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:03 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:03 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:03 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:03 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:03 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:03 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:03 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:03 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:03 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:18:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:18:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:18:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Acquiring lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:05 user nova-compute[74776]: DEBUG nova.objects.instance [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lazy-loading 'flavor' on Instance uuid d13dd041-8289-4a8b-93a1-bf3e491b9e65 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:18:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.147s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:18:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Acquiring lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:06 user nova-compute[74776]: INFO nova.compute.manager [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Attaching volume f3323c0e-3430-4411-a27b-e2c61a00d32f to /dev/vdb
Nov 22 14:18:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-eda0219a-3ebb-447c-92a1-345450387f22 req-5065a1ea-cb02-4f9f-9e41-bd0eec8f0249 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received event network-changed-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-eda0219a-3ebb-447c-92a1-345450387f22 req-5065a1ea-cb02-4f9f-9e41-bd0eec8f0249 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Refreshing instance network info cache due to event network-changed-5911a175-03ae-4ed9-8c40-fc54c69233b4. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-eda0219a-3ebb-447c-92a1-345450387f22 req-5065a1ea-cb02-4f9f-9e41-bd0eec8f0249 service nova] Acquiring lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-eda0219a-3ebb-447c-92a1-345450387f22 req-5065a1ea-cb02-4f9f-9e41-bd0eec8f0249 service nova] Acquired lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG nova.network.neutron [req-eda0219a-3ebb-447c-92a1-345450387f22 req-5065a1ea-cb02-4f9f-9e41-bd0eec8f0249 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Refreshing network info cache for port 5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG os_brick.utils [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e30888-7d28-4777-be66-9fe3c73ef72d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[039e3b0e-aa61-491a-84c1-02411c34fc00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9871f772-05b3-4eeb-bc98-837175f2bc10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[236bbd34-fd50-48cc-ab07-0d61f4f30a1f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:18:06 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dea33f-fdbc-4dd7-8ca7-51cc3a23a4bd]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG os_brick.utils [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Updating existing volume attachment record: 44f76ee5-9118-43f7-a250-22590a7ad5e8 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG nova.compute.manager [req-2163ec33-2bd4-44b3-8f7a-7131c050ae5f req-96d412c1-f310-45f7-8928-bbd05035d25a service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Received event network-changed-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG nova.compute.manager [req-2163ec33-2bd4-44b3-8f7a-7131c050ae5f req-96d412c1-f310-45f7-8928-bbd05035d25a service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Refreshing instance network info cache due to event network-changed-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2163ec33-2bd4-44b3-8f7a-7131c050ae5f req-96d412c1-f310-45f7-8928-bbd05035d25a service nova] Acquiring lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2163ec33-2bd4-44b3-8f7a-7131c050ae5f req-96d412c1-f310-45f7-8928-bbd05035d25a service nova] Acquired lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG nova.network.neutron [req-2163ec33-2bd4-44b3-8f7a-7131c050ae5f req-96d412c1-f310-45f7-8928-bbd05035d25a service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Refreshing network info cache for port abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:18:07 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:18:07 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:18:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=7046MB free_disk=25.497085571289062GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance d13dd041-8289-4a8b-93a1-bf3e491b9e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance e96ab1bf-6f19-4e5f-b79d-f0266988090b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4629d82d-fd02-4a58-a535-b362b493e7c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 98fb9b54-c428-4a48-b1ff-a976f971b764 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 232d8284-a99b-40c2-aa36-1de93a25729a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 25deabe8-8cfc-4d40-a734-755d4097baf5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 62461965-8bbb-4497-81e7-d9237832f190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance fb5def2c-c757-4a3c-a832-142bf8c61413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 42b00137-df98-47d9-9d02-29b4707fed30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 67bb65da-d976-40da-9568-2c1e3930fb7f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG nova.network.neutron [req-eda0219a-3ebb-447c-92a1-345450387f22 req-5065a1ea-cb02-4f9f-9e41-bd0eec8f0249 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Updated VIF entry in instance network info cache for port 5911a175-03ae-4ed9-8c40-fc54c69233b4. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG nova.network.neutron [req-eda0219a-3ebb-447c-92a1-345450387f22 req-5065a1ea-cb02-4f9f-9e41-bd0eec8f0249 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Updating instance_info_cache with network_info: [{"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-eda0219a-3ebb-447c-92a1-345450387f22 req-5065a1ea-cb02-4f9f-9e41-bd0eec8f0249 service nova] Releasing lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:18:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.585s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:18:08 user nova-compute[74776]: DEBUG nova.network.neutron [req-2163ec33-2bd4-44b3-8f7a-7131c050ae5f req-96d412c1-f310-45f7-8928-bbd05035d25a service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Updated VIF entry in instance network info cache for port abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:18:08 user nova-compute[74776]: DEBUG nova.network.neutron [req-2163ec33-2bd4-44b3-8f7a-7131c050ae5f req-96d412c1-f310-45f7-8928-bbd05035d25a service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Updating instance_info_cache with network_info: [{"id": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "address": "fa:16:3e:a5:87:db", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabaa3c9b-98", "ovs_interfaceid": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:18:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2163ec33-2bd4-44b3-8f7a-7131c050ae5f req-96d412c1-f310-45f7-8928-bbd05035d25a service nova] Releasing lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:18:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-56e75ae6-d32f-4760-a2cf-78cb0197f49b req-d4588b3f-bddd-42f1-a8ab-b4bf500c152c service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received event network-changed-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:18:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-56e75ae6-d32f-4760-a2cf-78cb0197f49b req-d4588b3f-bddd-42f1-a8ab-b4bf500c152c service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Refreshing instance network info cache due to event network-changed-dd255982-4c19-4bf3-b01c-ba063b6f561e. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:18:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-56e75ae6-d32f-4760-a2cf-78cb0197f49b req-d4588b3f-bddd-42f1-a8ab-b4bf500c152c service nova] Acquiring lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:18:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-56e75ae6-d32f-4760-a2cf-78cb0197f49b req-d4588b3f-bddd-42f1-a8ab-b4bf500c152c service nova] Acquired lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:18:08 user nova-compute[74776]: DEBUG nova.network.neutron [req-56e75ae6-d32f-4760-a2cf-78cb0197f49b req-d4588b3f-bddd-42f1-a8ab-b4bf500c152c service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Refreshing network info cache for port dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:18:08 user nova-compute[74776]: DEBUG nova.network.neutron [req-56e75ae6-d32f-4760-a2cf-78cb0197f49b req-d4588b3f-bddd-42f1-a8ab-b4bf500c152c service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Updated VIF entry in instance network info cache for port dd255982-4c19-4bf3-b01c-ba063b6f561e. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:18:08 user nova-compute[74776]: DEBUG nova.network.neutron [req-56e75ae6-d32f-4760-a2cf-78cb0197f49b req-d4588b3f-bddd-42f1-a8ab-b4bf500c152c service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Updating instance_info_cache with network_info: [{"id": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "address": "fa:16:3e:7c:6e:68", "network": {"id": "32c8e7a3-6995-4931-ad2d-e8c3eb351538", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92fd48cf9c34eac867c14bf962c3a0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd255982-4c", "ovs_interfaceid": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:18:08 user nova-compute[74776]: DEBUG nova.compute.manager [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:18:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-56e75ae6-d32f-4760-a2cf-78cb0197f49b req-d4588b3f-bddd-42f1-a8ab-b4bf500c152c service nova] Releasing lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:18:08 user nova-compute[74776]: INFO nova.compute.manager [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] instance snapshotting
Nov 22 14:18:08 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Beginning live snapshot process
Nov 22 14:18:08 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:18:08 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:18:08 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:18:08 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:18:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json -f qcow2 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:18:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:18:09 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:18:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json -f qcow2 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json -f qcow2" returned: 0 in 0.245s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:09 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Updating instance_info_cache with network_info: [{"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:18:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnfelypi_/60de5328a0804cb190f90291b90911a9.delta 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:18:09 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:18:09 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:18:09 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:18:09 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:18:09 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:18:09 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:18:09 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:18:09 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:18:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnfelypi_/60de5328a0804cb190f90291b90911a9.delta 1073741824" returned: 0 in 0.047s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:09 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 22 14:18:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74776) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 22 14:18:09 user nova-compute[74776]: INFO nova.virt.libvirt.host [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] UEFI support detected
Nov 22 14:18:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:18:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:18:10 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 22 14:18:11 user nova-compute[74776]: DEBUG nova.privsep.utils [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74776) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 14:18:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnfelypi_/60de5328a0804cb190f90291b90911a9.delta /opt/stack/data/nova/instances/snapshots/tmpnfelypi_/60de5328a0804cb190f90291b90911a9 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnfelypi_/60de5328a0804cb190f90291b90911a9.delta /opt/stack/data/nova/instances/snapshots/tmpnfelypi_/60de5328a0804cb190f90291b90911a9" returned: 0 in 0.502s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:11 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Snapshot extracted, beginning image upload
Nov 22 14:18:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:15 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Snapshot image upload complete
Nov 22 14:18:15 user nova-compute[74776]: INFO nova.compute.manager [None req-30f6b399-ca51-4c0f-aa55-bf2416fdcf88 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Took 6.33 seconds to snapshot the instance on the hypervisor.
Nov 22 14:18:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxObteia', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:18:17 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:18:17 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:18:17 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d281f3f1-8fa9-492b-9fe1-3be7a89d18f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:18:17 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c690acb-9282-4845-b689-1262261258c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f] added
Nov 22 14:18:17 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6998bedf-ac60-4967-bbe8-b8dce00fce5f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8616d5-ed5d-49ab-8ae0-b642071f55a0]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SxObteia {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SxObteia" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[99522bbd-529f-462c-a84e-589ffc1b7741]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SxObteia'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5637a2dc-675a-4d6d-97c6-1dc1bc9e3d83]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a790b1b8-1c1c-49dc-b14f-c0e158f400d3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:17 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:17 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:17 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:17 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:17 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:17 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ccf4f3-6217-45c7-b6fa-ea60a061cf3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f, portal: 172.16.0.220,3260]
Nov 22 14:18:17 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f, portal: 172.16.0.220,3260] successful.
Nov 22 14:18:17 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5429b856-d93d-49a8-bebf-4320f5723ff4]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[51385f5d-7eb5-4e8a-9b62-c101f61d4a0c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:17 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:17 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:17 user nova-compute[74776]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f (non-flash)
Nov 22 14:18:17 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:17 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:17 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:17 user nova-compute[74776]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f (non-flash)
Nov 22 14:18:17 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.045s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39bb5b3-7eca-460f-87df-ef6bef59c969]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:18:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxObteia', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:18:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-dc8e2216-0693-4f72-8829-12b3f72fa6b8 req-172907b0-5164-465a-ad62-ae08e8af4f09 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Received event network-changed-b3675ad0-6dfc-4731-a999-a16801642163 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:18:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-dc8e2216-0693-4f72-8829-12b3f72fa6b8 req-172907b0-5164-465a-ad62-ae08e8af4f09 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Refreshing instance network info cache due to event network-changed-b3675ad0-6dfc-4731-a999-a16801642163. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:18:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dc8e2216-0693-4f72-8829-12b3f72fa6b8 req-172907b0-5164-465a-ad62-ae08e8af4f09 service nova] Acquiring lock "refresh_cache-232d8284-a99b-40c2-aa36-1de93a25729a" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:18:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dc8e2216-0693-4f72-8829-12b3f72fa6b8 req-172907b0-5164-465a-ad62-ae08e8af4f09 service nova] Acquired lock "refresh_cache-232d8284-a99b-40c2-aa36-1de93a25729a" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:18:18 user nova-compute[74776]: DEBUG nova.network.neutron [req-dc8e2216-0693-4f72-8829-12b3f72fa6b8 req-172907b0-5164-465a-ad62-ae08e8af4f09 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Refreshing network info cache for port b3675ad0-6dfc-4731-a999-a16801642163 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:18:18 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:18:18 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23461343832303161', 'path': '/dev/sde'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:18:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461343832303161', 'path': '/dev/sde'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:18:18 user nova-compute[74776]: DEBUG nova.objects.instance [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lazy-loading 'flavor' on Instance uuid d13dd041-8289-4a8b-93a1-bf3e491b9e65 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:18:18 user nova-compute[74776]: DEBUG nova.network.neutron [req-dc8e2216-0693-4f72-8829-12b3f72fa6b8 req-172907b0-5164-465a-ad62-ae08e8af4f09 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Updated VIF entry in instance network info cache for port b3675ad0-6dfc-4731-a999-a16801642163. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:18:18 user nova-compute[74776]: DEBUG nova.network.neutron [req-dc8e2216-0693-4f72-8829-12b3f72fa6b8 req-172907b0-5164-465a-ad62-ae08e8af4f09 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Updating instance_info_cache with network_info: [{"id": "b3675ad0-6dfc-4731-a999-a16801642163", "address": "fa:16:3e:01:f2:5e", "network": {"id": "18a7dc3b-d85c-457d-81d2-0a49599e45ac", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-704035334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4eea24586225438187a24cc3af0f800b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3675ad0-6d", "ovs_interfaceid": "b3675ad0-6dfc-4731-a999-a16801642163", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:18:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:18:18 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:18:18 user nova-compute[74776]:   <source dev="/dev/sde"/>
Nov 22 14:18:18 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:18:18 user nova-compute[74776]:   <serial>f3323c0e-3430-4411-a27b-e2c61a00d32f</serial>
Nov 22 14:18:18 user nova-compute[74776]: </disk>
Nov 22 14:18:18 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:18:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dc8e2216-0693-4f72-8829-12b3f72fa6b8 req-172907b0-5164-465a-ad62-ae08e8af4f09 service nova] Releasing lock "refresh_cache-232d8284-a99b-40c2-aa36-1de93a25729a" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:18:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:18:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:18:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] No VIF found with MAC fa:16:3e:10:c7:a0, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:18:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f4ad5d2d-4b2e-458c-bf1b-2725d1e01b35 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.486s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:18:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Acquiring lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Acquiring lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:18:20 user nova-compute[74776]: INFO nova.compute.manager [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Terminating instance
Nov 22 14:18:20 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:18:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-080c39c9-007a-4b3e-a2e9-438bff956731 req-b5e85251-5ce3-4972-b793-9596b78ee55f service nova] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Received event network-vif-unplugged-85404a03-3785-4381-96ac-6711e81395f9 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:18:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-080c39c9-007a-4b3e-a2e9-438bff956731 req-b5e85251-5ce3-4972-b793-9596b78ee55f service nova] Acquiring lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-080c39c9-007a-4b3e-a2e9-438bff956731 req-b5e85251-5ce3-4972-b793-9596b78ee55f service nova] Lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-080c39c9-007a-4b3e-a2e9-438bff956731 req-b5e85251-5ce3-4972-b793-9596b78ee55f service nova] Lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:18:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-080c39c9-007a-4b3e-a2e9-438bff956731 req-b5e85251-5ce3-4972-b793-9596b78ee55f service nova] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] No waiting events found dispatching network-vif-unplugged-85404a03-3785-4381-96ac-6711e81395f9 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:18:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-080c39c9-007a-4b3e-a2e9-438bff956731 req-b5e85251-5ce3-4972-b793-9596b78ee55f service nova] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Received event network-vif-unplugged-85404a03-3785-4381-96ac-6711e81395f9 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:18:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Acquiring lock "232d8284-a99b-40c2-aa36-1de93a25729a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "232d8284-a99b-40c2-aa36-1de93a25729a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:20 user nova-compute[74776]: DEBUG nova.objects.instance [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lazy-loading 'flavor' on Instance uuid 232d8284-a99b-40c2-aa36-1de93a25729a {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "232d8284-a99b-40c2-aa36-1de93a25729a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:18:21 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Instance destroyed successfully.
Nov 22 14:18:21 user nova-compute[74776]: DEBUG nova.objects.instance [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lazy-loading 'resources' on Instance uuid d13dd041-8289-4a8b-93a1-bf3e491b9e65 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1196876710',display_name='tempest-DeleteServersTestJSON-server-1196876710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1196876710',id=1,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:16:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bdc86266374d46f9b40654b2090067b0',ramdisk_id='',reservation_id='r-y07gkdoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-734096284',owner_user_name='tempest-DeleteServersTestJSON-734096284-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:16:30Z,user_data=None,user_id='f57c323128d14050b648a6bd24cace89',uuid=d13dd041-8289-4a8b-93a1-bf3e491b9e65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85404a03-3785-4381-96ac-6711e81395f9", "address": "fa:16:3e:10:c7:a0", "network": {"id": "696ca276-acaf-4f2d-85b8-8afd52ce4742", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1692508702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc86266374d46f9b40654b2090067b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85404a03-37", "ovs_interfaceid": "85404a03-3785-4381-96ac-6711e81395f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Converting VIF {"id": "85404a03-3785-4381-96ac-6711e81395f9", "address": "fa:16:3e:10:c7:a0", "network": {"id": "696ca276-acaf-4f2d-85b8-8afd52ce4742", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1692508702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc86266374d46f9b40654b2090067b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85404a03-37", "ovs_interfaceid": "85404a03-3785-4381-96ac-6711e81395f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:c7:a0,bridge_name='br-int',has_traffic_filtering=True,id=85404a03-3785-4381-96ac-6711e81395f9,network=Network(696ca276-acaf-4f2d-85b8-8afd52ce4742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85404a03-37') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_vif [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:c7:a0,bridge_name='br-int',has_traffic_filtering=True,id=85404a03-3785-4381-96ac-6711e81395f9,network=Network(696ca276-acaf-4f2d-85b8-8afd52ce4742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85404a03-37') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85404a03-37, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46e28774-a2a7-47a4-89c8-df564fd815e0) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:21 user nova-compute[74776]: INFO os_vif [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:c7:a0,bridge_name='br-int',has_traffic_filtering=True,id=85404a03-3785-4381-96ac-6711e81395f9,network=Network(696ca276-acaf-4f2d-85b8-8afd52ce4742),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85404a03-37')
Nov 22 14:18:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxObteia', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:18:21 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Acquiring lock "232d8284-a99b-40c2-aa36-1de93a25729a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "232d8284-a99b-40c2-aa36-1de93a25729a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:21 user nova-compute[74776]: INFO nova.compute.manager [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Attaching volume c25005b9-4e56-43d8-b745-6c1bea65b1d4 to /dev/sdc
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8165efcb-ac50-45f1-8ca6-7aca4bef64ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:18:21 user nova-compute[74776]: No targets found.
Nov 22 14:18:21 user nova-compute[74776]: iSNS:
Nov 22 14:18:21 user nova-compute[74776]: No targets found.
Nov 22 14:18:21 user nova-compute[74776]: STATIC:
Nov 22 14:18:21 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618
Nov 22 14:18:21 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:18:21 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:18:21 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f
Nov 22 14:18:21 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:18:21 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:18:21 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900
Nov 22 14:18:21 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:18:21 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:18:21 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab
Nov 22 14:18:21 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:18:21 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:18:21 user nova-compute[74776]: FIRMWARE:
Nov 22 14:18:21 user nova-compute[74776]: No targets found.
Nov 22 14:18:21 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:18:21 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:18:21 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[88abf41e-8e4f-4a7c-9f5b-422339e6ea34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b45bd9-b241-4cbb-b5f0-f6146ce841dc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:21 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:21 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:21 user nova-compute[74776]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f (non-flash)
Nov 22 14:18:21 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:21 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:21 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:21 user nova-compute[74776]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f (non-flash)
Nov 22 14:18:21 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c783436d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f'): ({'sde'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Removing single pathed devices sde {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.utils [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e7e16e-0f0c-4dd7-98a5-5a70f8c159d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[176dca64-58f5-4c87-8ed8-26ee781b944b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[136fc873-c88b-49e1-a353-40d72bc8f9dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd73a11e-2dc9-4cc2-81e1-0d57d02a776d]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Flushing IO for device /dev/sde {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bd6251-9462-442e-a970-74cffe22b870]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b059cfe-97e6-4c7a-8004-0bb0e088ed9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b04913d-3f46-4ccd-9490-672ef8ef99a2]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:18:21 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[87541706-57f8-4208-8e64-239971e5ad79]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.utils [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Updating existing volume attachment record: ae4d1ebf-3a89-4f34-b057-389b28aaa034 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[425dc1f8-a0ef-45c6-9a26-35cc17164291]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] SCSI volumes sde have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0753fc-c101-46dd-8941-7ae0dc7612c8]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cbc919-e605-46a1-9d0e-ec62852144a8]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f, portal: 172.16.0.220,3260]
Nov 22 14:18:21 user nova-compute[74776]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f, portal: 172.16.0.220,3260] successful.
Nov 22 14:18:21 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3323c0e-3430-4411-a27b-e2c61a00d32f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab58884-b867-4f77-9ba1-d6abf398c020]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] <== disconnect_volume: return (401ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:18:21 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Deleting instance files /opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65_del
Nov 22 14:18:21 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Deletion of /opt/stack/data/nova/instances/d13dd041-8289-4a8b-93a1-bf3e491b9e65_del complete
Nov 22 14:18:21 user nova-compute[74776]: INFO nova.compute.manager [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 22 14:18:21 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:18:21 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:18:22 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:18:22 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Took 0.80 seconds to deallocate network for instance.
Nov 22 14:18:22 user nova-compute[74776]: DEBUG nova.compute.manager [req-3b62181d-902f-404b-8240-30d8e6e30c7f req-3b7044ed-c2a2-473e-a4f0-ae60cf358a71 service nova] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Received event network-vif-plugged-85404a03-3785-4381-96ac-6711e81395f9 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:18:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3b62181d-902f-404b-8240-30d8e6e30c7f req-3b7044ed-c2a2-473e-a4f0-ae60cf358a71 service nova] Acquiring lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3b62181d-902f-404b-8240-30d8e6e30c7f req-3b7044ed-c2a2-473e-a4f0-ae60cf358a71 service nova] Lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3b62181d-902f-404b-8240-30d8e6e30c7f req-3b7044ed-c2a2-473e-a4f0-ae60cf358a71 service nova] Lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:18:22 user nova-compute[74776]: DEBUG nova.compute.manager [req-3b62181d-902f-404b-8240-30d8e6e30c7f req-3b7044ed-c2a2-473e-a4f0-ae60cf358a71 service nova] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] No waiting events found dispatching network-vif-plugged-85404a03-3785-4381-96ac-6711e81395f9 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:18:22 user nova-compute[74776]: WARNING nova.compute.manager [req-3b62181d-902f-404b-8240-30d8e6e30c7f req-3b7044ed-c2a2-473e-a4f0-ae60cf358a71 service nova] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Received unexpected event network-vif-plugged-85404a03-3785-4381-96ac-6711e81395f9 for instance with vm_state active and task_state deleting.
Nov 22 14:18:22 user nova-compute[74776]: DEBUG nova.compute.manager [req-3b62181d-902f-404b-8240-30d8e6e30c7f req-3b7044ed-c2a2-473e-a4f0-ae60cf358a71 service nova] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Received event network-vif-deleted-85404a03-3785-4381-96ac-6711e81395f9 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:18:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-ea5b737b-0bb8-4532-9519-f060cd327aab req-748be500-643a-4e46-8727-e9f0c97335a4 service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Received event network-changed-08471f51-9b29-4d1f-9c06-3006abae8ff1 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:18:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-ea5b737b-0bb8-4532-9519-f060cd327aab req-748be500-643a-4e46-8727-e9f0c97335a4 service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Refreshing instance network info cache due to event network-changed-08471f51-9b29-4d1f-9c06-3006abae8ff1. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:18:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ea5b737b-0bb8-4532-9519-f060cd327aab req-748be500-643a-4e46-8727-e9f0c97335a4 service nova] Acquiring lock "refresh_cache-25deabe8-8cfc-4d40-a734-755d4097baf5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:18:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ea5b737b-0bb8-4532-9519-f060cd327aab req-748be500-643a-4e46-8727-e9f0c97335a4 service nova] Acquired lock "refresh_cache-25deabe8-8cfc-4d40-a734-755d4097baf5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:18:24 user nova-compute[74776]: DEBUG nova.network.neutron [req-ea5b737b-0bb8-4532-9519-f060cd327aab req-748be500-643a-4e46-8727-e9f0c97335a4 service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Refreshing network info cache for port 08471f51-9b29-4d1f-9c06-3006abae8ff1 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:18:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:24 user nova-compute[74776]: DEBUG nova.network.neutron [req-ea5b737b-0bb8-4532-9519-f060cd327aab req-748be500-643a-4e46-8727-e9f0c97335a4 service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Updated VIF entry in instance network info cache for port 08471f51-9b29-4d1f-9c06-3006abae8ff1. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:18:24 user nova-compute[74776]: DEBUG nova.network.neutron [req-ea5b737b-0bb8-4532-9519-f060cd327aab req-748be500-643a-4e46-8727-e9f0c97335a4 service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Updating instance_info_cache with network_info: [{"id": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "address": "fa:16:3e:98:ce:04", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08471f51-9b", "ovs_interfaceid": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:18:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ea5b737b-0bb8-4532-9519-f060cd327aab req-748be500-643a-4e46-8727-e9f0c97335a4 service nova] Releasing lock "refresh_cache-25deabe8-8cfc-4d40-a734-755d4097baf5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:18:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG nova.compute.manager [req-d2c29631-07be-434d-80b8-7f43e14079a1 req-691ad688-32c4-4446-80f7-6bc8547ba827 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Received event network-changed-fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG nova.compute.manager [req-d2c29631-07be-434d-80b8-7f43e14079a1 req-691ad688-32c4-4446-80f7-6bc8547ba827 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Refreshing instance network info cache due to event network-changed-fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2c29631-07be-434d-80b8-7f43e14079a1 req-691ad688-32c4-4446-80f7-6bc8547ba827 service nova] Acquiring lock "refresh_cache-62461965-8bbb-4497-81e7-d9237832f190" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2c29631-07be-434d-80b8-7f43e14079a1 req-691ad688-32c4-4446-80f7-6bc8547ba827 service nova] Acquired lock "refresh_cache-62461965-8bbb-4497-81e7-d9237832f190" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG nova.network.neutron [req-d2c29631-07be-434d-80b8-7f43e14079a1 req-691ad688-32c4-4446-80f7-6bc8547ba827 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Refreshing network info cache for port fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "25deabe8-8cfc-4d40-a734-755d4097baf5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "25deabe8-8cfc-4d40-a734-755d4097baf5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG nova.objects.instance [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lazy-loading 'flavor' on Instance uuid 25deabe8-8cfc-4d40-a734-755d4097baf5 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Acquiring lock "62461965-8bbb-4497-81e7-d9237832f190" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "62461965-8bbb-4497-81e7-d9237832f190" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG nova.objects.instance [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lazy-loading 'flavor' on Instance uuid 62461965-8bbb-4497-81e7-d9237832f190 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "25deabe8-8cfc-4d40-a734-755d4097baf5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.135s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "62461965-8bbb-4497-81e7-d9237832f190" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "25deabe8-8cfc-4d40-a734-755d4097baf5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "25deabe8-8cfc-4d40-a734-755d4097baf5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:27 user nova-compute[74776]: INFO nova.compute.manager [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Attaching volume 09fa723b-5995-49c3-9d4f-a51986f69f83 to /dev/vdb
Nov 22 14:18:27 user nova-compute[74776]: DEBUG nova.network.neutron [req-d2c29631-07be-434d-80b8-7f43e14079a1 req-691ad688-32c4-4446-80f7-6bc8547ba827 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Updated VIF entry in instance network info cache for port fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG nova.network.neutron [req-d2c29631-07be-434d-80b8-7f43e14079a1 req-691ad688-32c4-4446-80f7-6bc8547ba827 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Updating instance_info_cache with network_info: [{"id": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "address": "fa:16:3e:88:e5:06", "network": {"id": "27ef6736-2e02-4129-9a99-808e36b78c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2032983723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91bafa921c884ef4bf2928492c58c0d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf7b87c-b8", "ovs_interfaceid": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2c29631-07be-434d-80b8-7f43e14079a1 req-691ad688-32c4-4446-80f7-6bc8547ba827 service nova] Releasing lock "refresh_cache-62461965-8bbb-4497-81e7-d9237832f190" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Acquiring lock "62461965-8bbb-4497-81e7-d9237832f190" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "62461965-8bbb-4497-81e7-d9237832f190" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:27 user nova-compute[74776]: INFO nova.compute.manager [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Attaching volume 744a160c-44d1-41e8-a877-de71e5b9b047 to /dev/vdb
Nov 22 14:18:27 user nova-compute[74776]: DEBUG os_brick.utils [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a5ffb8-3622-4799-a6a6-adab23b6d2a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d961e86-28ce-4488-a15d-7aef79428a33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG os_brick.utils [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe1ed56-662b-4579-8c37-04fe65c25531]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21f2ab5-eb9d-471f-a567-605065da12c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f089903-fa09-4625-8104-f031eda2d700]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:18:27 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[803ba1f0-c328-4352-a907-c70da0657a70]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG os_brick.utils [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Updating existing volume attachment record: b4c6bb95-0172-43d8-83ad-8a94ada59cbb {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72a5fb0-64b4-4ab8-ab30-a7a417f03a12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bb29f7-010a-496e-91eb-c271c4df2350]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b007bb9-157c-4890-8255-ffe38417e967]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:18:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:18:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:18:28 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:18:28 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fa03cf-1e03-41d1-b5bf-d200c200d936]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:18:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:18:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:18:28 user nova-compute[74776]: DEBUG os_brick.utils [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:18:28 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Updating existing volume attachment record: efbdebf9-ede1-4011-8cec-f90219fd1ef8 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:18:28 user nova-compute[74776]: INFO nova.compute.manager [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] [instance: d13dd041-8289-4a8b-93a1-bf3e491b9e65] Took 5.74 seconds to detach 1 volumes for instance.
Nov 22 14:18:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:28 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:18:28 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:18:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:18:28 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Deleted allocations for instance d13dd041-8289-4a8b-93a1-bf3e491b9e65
Nov 22 14:18:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ae7be941-2c00-432e-bab4-1f35158628d7 tempest-DeleteServersTestJSON-734096284 tempest-DeleteServersTestJSON-734096284-project-member] Lock "d13dd041-8289-4a8b-93a1-bf3e491b9e65" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.476s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:18:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlpxTmQS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:18:34 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:18:34 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:18:34 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[682f694f-424a-482b-87ef-3586f68cb159]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:18:34 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0770c547-7bc0-41e9-a0c4-2cdc4b18688d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4] added
Nov 22 14:18:34 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTmjRwyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:18:34 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cfd20b-4ffe-480d-950e-217ab253a2e3]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae375ac6-aaf9-4179-a378-a3121b000363]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IlpxTmQS {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IlpxTmQS" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9509d8-eee0-45f3-92ce-8b994caa1be1]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IlpxTmQS'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55a4308-254e-4892-b585-de53fac67227]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iEPpGoFD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:18:34 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5203afa-d28b-435a-b4a7-6a31785d82bb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:34 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:34 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:34 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:34 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:34 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:34 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4fdf50-c5f3-4ae8-bf99-04ccee16c715]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4, portal: 172.16.0.220,3260]
Nov 22 14:18:34 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4, portal: 172.16.0.220,3260] successful.
Nov 22 14:18:34 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8cf16a-7c66-4447-91bd-428e0bf906ea]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a165953-d5a5-43f6-bb33-68f43a6f29ee]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:34 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:34 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:34 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:34 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:34 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:34 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:34 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:34 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:35 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d143502-1b38-4be5-9484-6a089082f18f]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:35 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: None {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlpxTmQS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23565386437616439', 'path': '/dev/sde'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565386437616439', 'path': '/dev/sde'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.271s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:18:36 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:18:36 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG nova.objects.instance [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lazy-loading 'flavor' on Instance uuid 232d8284-a99b-40c2-aa36-1de93a25729a {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b997e61-7113-492d-ab9c-39b92f997393]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:18:36 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:18:36 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:18:36 user nova-compute[74776]:   <source dev="/dev/sde"/>
Nov 22 14:18:36 user nova-compute[74776]:   <target dev="sdc" bus="scsi"/>
Nov 22 14:18:36 user nova-compute[74776]:   <serial>c25005b9-4e56-43d8-b745-6c1bea65b1d4</serial>
Nov 22 14:18:36 user nova-compute[74776]:   <address type="drive" controller="0" unit="2"/>
Nov 22 14:18:36 user nova-compute[74776]: </disk>
Nov 22 14:18:36 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5a2f0d-f580-43fe-9b41-f2b9905236cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047] added
Nov 22 14:18:36 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[09883669-9c30-40f5-b02c-42833f7ed210]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60e8502-69e8-4a6b-9241-c98cdd1583be]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sTmjRwyi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sTmjRwyi" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[050907bd-7083-4414-bfa1-9a18ef3b06ba]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sTmjRwyi'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7775bc7d-4497-456b-a5f5-3dd5da687bd8]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea161af-de62-445d-bb3d-d32c8e568615]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:36 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:36 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:36 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:36 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:36 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:36 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:36 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:36 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[526d0cd7-71f1-4f62-b325-647a7dacb5d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047, portal: 172.16.0.220,3260]
Nov 22 14:18:36 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047, portal: 172.16.0.220,3260] successful.
Nov 22 14:18:36 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[af68a285-639a-4c8c-a809-d6a10c1f7f50]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[df70eecd-fa89-4f2b-b1b5-238d4ddf0b4c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:36 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:36 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:36 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:36 user nova-compute[74776]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:18:36 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:36 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:36 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:36 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:36 user nova-compute[74776]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:18:36 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97ba091-ebfe-42fc-9309-7be7b5d283cc]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTmjRwyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] No BDM found with device name sda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] No VIF found with MAC fa:16:3e:01:f2:5e, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:18:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5083cf9e-5ec1-48bb-8549-8c1beba4f968 tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "232d8284-a99b-40c2-aa36-1de93a25729a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.479s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] <== connect_volume: return (2665ms) {'type': 'block', 'scsi_wwn': '26634643634666634', 'path': '/dev/sdf'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634643634666634', 'path': '/dev/sdf'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.555s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:18:37 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:18:37 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG nova.objects.instance [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lazy-loading 'flavor' on Instance uuid 62461965-8bbb-4497-81e7-d9237832f190 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b012f0-093e-459c-be77-52c7908d5e95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:18:37 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:18:37 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:18:37 user nova-compute[74776]:   <source dev="/dev/sdf"/>
Nov 22 14:18:37 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:18:37 user nova-compute[74776]:   <serial>744a160c-44d1-41e8-a877-de71e5b9b047</serial>
Nov 22 14:18:37 user nova-compute[74776]: </disk>
Nov 22 14:18:37 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Acquiring lock "232d8284-a99b-40c2-aa36-1de93a25729a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "232d8284-a99b-40c2-aa36-1de93a25729a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[056688a2-ae45-4f7f-8d26-03bf52668d80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83] added
Nov 22 14:18:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:37 user nova-compute[74776]: INFO nova.compute.manager [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Detaching volume c25005b9-4e56-43d8-b745-6c1bea65b1d4
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6e3040-c97e-4c01-8104-d7a310fe49b8]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b17a06e-61c8-4dff-a428-4fdd18ab1ec1]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iEPpGoFD {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iEPpGoFD" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb21f1da-2646-4192-8c46-64a9ffb3b648]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iEPpGoFD'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:37 user nova-compute[74776]: INFO nova.virt.block_device [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Attempting to driver detach volume c25005b9-4e56-43d8-b745-6c1bea65b1d4 from mountpoint /dev/sdc
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c9398b-12af-49e2-9988-95c15f302537]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Attempting to detach device sdc from instance 232d8284-a99b-40c2-aa36-1de93a25729a from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:18:37 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:18:37 user nova-compute[74776]:   <source dev="/dev/sde"/>
Nov 22 14:18:37 user nova-compute[74776]:   <target dev="sdc" bus="scsi"/>
Nov 22 14:18:37 user nova-compute[74776]:   <serial>c25005b9-4e56-43d8-b745-6c1bea65b1d4</serial>
Nov 22 14:18:37 user nova-compute[74776]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 22 14:18:37 user nova-compute[74776]: </disk>
Nov 22 14:18:37 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:18:37 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Successfully detached device sdc from instance 232d8284-a99b-40c2-aa36-1de93a25729a from the persistent domain config.
Nov 22 14:18:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 232d8284-a99b-40c2-aa36-1de93a25729a from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:18:37 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:18:37 user nova-compute[74776]:   <source dev="/dev/sde"/>
Nov 22 14:18:37 user nova-compute[74776]:   <target dev="sdc" bus="scsi"/>
Nov 22 14:18:37 user nova-compute[74776]:   <serial>c25005b9-4e56-43d8-b745-6c1bea65b1d4</serial>
Nov 22 14:18:37 user nova-compute[74776]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 22 14:18:37 user nova-compute[74776]: </disk>
Nov 22 14:18:37 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffac718a-6624-455f-a647-23c27529bd52]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:37 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:37 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:37 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:37 user nova-compute[74776]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:18:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:37 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:37 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:37 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:37 user nova-compute[74776]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:18:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c248b33-7948-4068-8c97-c29ce21d81fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83, portal: 172.16.0.220,3260]
Nov 22 14:18:37 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83, portal: 172.16.0.220,3260] successful.
Nov 22 14:18:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[541b80e0-4c06-423e-98e2-ca6076462763]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa8b6d0-14ca-48ab-8833-be5ae32734d4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:37 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:37 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:37 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:37 user nova-compute[74776]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:18:37 user nova-compute[74776]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)
Nov 22 14:18:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:37 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:37 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:37 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:37 user nova-compute[74776]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:18:37 user nova-compute[74776]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)
Nov 22 14:18:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a862a63-0c04-43b7-b0ed-e5556e55fda8]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iEPpGoFD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:18:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] No VIF found with MAC fa:16:3e:88:e5:06, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-26786a38-6015-4095-a964-5bb4185f9e39 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "62461965-8bbb-4497-81e7-d9237832f190" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.307s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 232d8284-a99b-40c2-aa36-1de93a25729a {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Acquiring lock "62461965-8bbb-4497-81e7-d9237832f190" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Lock "62461965-8bbb-4497-81e7-d9237832f190" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG os_brick.utils [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e927f3d5-6411-41a2-a71d-666d6f539a7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] <== connect_volume: return (3941ms) {'type': 'block', 'scsi_wwn': '23232323634336361', 'path': '/dev/sdg'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232323634336361', 'path': '/dev/sdg'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG nova.objects.instance [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lazy-loading 'flavor' on Instance uuid 25deabe8-8cfc-4d40-a734-755d4097baf5 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[464f285c-d12f-4464-a757-82b981ad1d80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c75d47-131d-484f-8770-154b3201082a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:18:38 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:18:38 user nova-compute[74776]:   <source dev="/dev/sdg"/>
Nov 22 14:18:38 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:18:38 user nova-compute[74776]:   <serial>09fa723b-5995-49c3-9d4f-a51986f69f83</serial>
Nov 22 14:18:38 user nova-compute[74776]: </disk>
Nov 22 14:18:38 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[351f19e6-38d5-4d42-8de0-158217e4e5a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:18:38 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:18:38 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3486c5a8-fef5-40b2-afb6-bcaaa6d41b19]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:18:38 user nova-compute[74776]: DEBUG os_brick.utils [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:18:39 user nova-compute[74776]: INFO nova.compute.manager [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Swapping volume 744a160c-44d1-41e8-a877-de71e5b9b047 for e5f4000f-04ae-4ac4-8623-1afba6388551
Nov 22 14:18:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:18:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:18:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] No VIF found with MAC fa:16:3e:98:ce:04, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:18:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4d96535b-ffc7-4c6f-813a-2f5c33aa4fb9 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "25deabe8-8cfc-4d40-a734-755d4097baf5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.233s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:18:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "25deabe8-8cfc-4d40-a734-755d4097baf5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "25deabe8-8cfc-4d40-a734-755d4097baf5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:41 user nova-compute[74776]: INFO nova.compute.manager [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Detaching volume 09fa723b-5995-49c3-9d4f-a51986f69f83
Nov 22 14:18:41 user nova-compute[74776]: INFO nova.virt.block_device [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Attempting to driver detach volume 09fa723b-5995-49c3-9d4f-a51986f69f83 from mountpoint /dev/vdb
Nov 22 14:18:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Attempting to detach device vdb from instance 25deabe8-8cfc-4d40-a734-755d4097baf5 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:18:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:18:41 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:18:41 user nova-compute[74776]:   <source dev="/dev/sdg"/>
Nov 22 14:18:41 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:18:41 user nova-compute[74776]:   <serial>09fa723b-5995-49c3-9d4f-a51986f69f83</serial>
Nov 22 14:18:41 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:18:41 user nova-compute[74776]: </disk>
Nov 22 14:18:41 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:18:41 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Successfully detached device vdb from instance 25deabe8-8cfc-4d40-a734-755d4097baf5 from the persistent domain config.
Nov 22 14:18:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 25deabe8-8cfc-4d40-a734-755d4097baf5 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:18:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:18:41 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:18:41 user nova-compute[74776]:   <source dev="/dev/sdg"/>
Nov 22 14:18:41 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:18:41 user nova-compute[74776]:   <serial>09fa723b-5995-49c3-9d4f-a51986f69f83</serial>
Nov 22 14:18:41 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:18:41 user nova-compute[74776]: </disk>
Nov 22 14:18:41 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:18:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 25deabe8-8cfc-4d40-a734-755d4097baf5 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:18:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-b854fce6-9df5-4b75-a0fd-022b5c0d1f47 req-5dcbb0dc-0b81-4064-969b-f372b1589d3a service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Received event network-changed-5ac74f62-5924-4561-9764-37baf7fb4a76 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:18:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-b854fce6-9df5-4b75-a0fd-022b5c0d1f47 req-5dcbb0dc-0b81-4064-969b-f372b1589d3a service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Refreshing instance network info cache due to event network-changed-5ac74f62-5924-4561-9764-37baf7fb4a76. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:18:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b854fce6-9df5-4b75-a0fd-022b5c0d1f47 req-5dcbb0dc-0b81-4064-969b-f372b1589d3a service nova] Acquiring lock "refresh_cache-fb5def2c-c757-4a3c-a832-142bf8c61413" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:18:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b854fce6-9df5-4b75-a0fd-022b5c0d1f47 req-5dcbb0dc-0b81-4064-969b-f372b1589d3a service nova] Acquired lock "refresh_cache-fb5def2c-c757-4a3c-a832-142bf8c61413" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:18:41 user nova-compute[74776]: DEBUG nova.network.neutron [req-b854fce6-9df5-4b75-a0fd-022b5c0d1f47 req-5dcbb0dc-0b81-4064-969b-f372b1589d3a service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Refreshing network info cache for port 5ac74f62-5924-4561-9764-37baf7fb4a76 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:18:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Acquiring lock "fb5def2c-c757-4a3c-a832-142bf8c61413" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Lock "fb5def2c-c757-4a3c-a832-142bf8c61413" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:41 user nova-compute[74776]: DEBUG nova.objects.instance [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Lazy-loading 'flavor' on Instance uuid fb5def2c-c757-4a3c-a832-142bf8c61413 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:18:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Lock "fb5def2c-c757-4a3c-a832-142bf8c61413" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG nova.network.neutron [req-b854fce6-9df5-4b75-a0fd-022b5c0d1f47 req-5dcbb0dc-0b81-4064-969b-f372b1589d3a service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Updated VIF entry in instance network info cache for port 5ac74f62-5924-4561-9764-37baf7fb4a76. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG nova.network.neutron [req-b854fce6-9df5-4b75-a0fd-022b5c0d1f47 req-5dcbb0dc-0b81-4064-969b-f372b1589d3a service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Updating instance_info_cache with network_info: [{"id": "5ac74f62-5924-4561-9764-37baf7fb4a76", "address": "fa:16:3e:98:f8:b7", "network": {"id": "53d2e1ea-b878-4276-94e0-8cd654e520d8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1299382333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f11960384544c3e935913363bdb1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ac74f62-59", "ovs_interfaceid": "5ac74f62-5924-4561-9764-37baf7fb4a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b854fce6-9df5-4b75-a0fd-022b5c0d1f47 req-5dcbb0dc-0b81-4064-969b-f372b1589d3a service nova] Releasing lock "refresh_cache-fb5def2c-c757-4a3c-a832-142bf8c61413" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Acquiring lock "fb5def2c-c757-4a3c-a832-142bf8c61413" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Lock "fb5def2c-c757-4a3c-a832-142bf8c61413" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:42 user nova-compute[74776]: INFO nova.compute.manager [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Attaching volume 618eee02-93fc-4b6e-a7db-cfdadd664ea0 to /dev/vdb
Nov 22 14:18:42 user nova-compute[74776]: DEBUG os_brick.utils [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[065da869-ccb3-4876-80f6-610772d73893]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d498592b-8b97-477b-a6e8-b6e925f4b3a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6550cb-c2ee-43fc-b3dc-ee9da77f04d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14d5dbb-2190-488e-a515-dce642756fcc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:18:42 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:18:42 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[14555a24-ab35-4003-b016-445e5622be05]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG os_brick.utils [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:18:42 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Updating existing volume attachment record: 7c3b13c9-df00-420d-b4eb-6d49cc7357a8 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:18:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] [instance: 62461965-8bbb-4497-81e7-d9237832f190] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWBFbRsA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '62461965-8bbb-4497-81e7-d9237832f190', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5f4000f-04ae-4ac4-8623-1afba6388551', 'serial': 'e5f4000f-04ae-4ac4-8623-1afba6388551'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTmjRwyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '62461965-8bbb-4497-81e7-d9237832f190', 'attached_at': '', 'detached_at': '', 'volume_id': '744a160c-44d1-41e8-a877-de71e5b9b047', 'serial'} {{(pid=74776) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWBFbRsA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:18:45 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:18:45 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:18:45 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cacc7d9-bfa8-4ed5-a9f9-c07f46bf76b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:18:45 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f7f2d4-3f7f-4140-802f-6a7836aa96b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551] added
Nov 22 14:18:45 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9118a97-349f-47e3-b821-9e086508c165]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8b844e-ad7e-4190-af89-e12b1bdedb8a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VWBFbRsA {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VWBFbRsA" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c7f7e1-3747-4d06-bda9-e829c7b010e3]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VWBFbRsA'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ee6f86-785d-4a06-813c-a5eb5c205091]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4100e2e9-7bb4-44fb-bc11-652973ee11d1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69614be-696b-4635-8fa1-a6daa9b8040f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551, portal: 172.16.0.220,3260]
Nov 22 14:18:45 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551, portal: 172.16.0.220,3260] successful.
Nov 22 14:18:45 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[336ddb09-01dd-43e5-874e-e321f0d3e309]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d671959-81d5-4eac-9594-15e4d018be77]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)
Nov 22 14:18:45 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb8779b-2d78-4700-a631-1b55385250c5]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:18:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWBFbRsA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:18:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:18:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23431396264383538', 'path': '/dev/sdh'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:18:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431396264383538', 'path': '/dev/sdh'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:18:47 user nova-compute[74776]: DEBUG nova.objects.instance [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Lazy-loading 'flavor' on Instance uuid 62461965-8bbb-4497-81e7-d9237832f190 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:18:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:18:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] COPY block job progress, current cursor: 104857600 final cursor: 1073741824 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:18:48 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] COPY block job progress, current cursor: 218103808 final cursor: 1073741824 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:18:48 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] COPY block job progress, current cursor: 363855872 final cursor: 1073741824 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:18:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] COPY block job progress, current cursor: 452984832 final cursor: 1073741824 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:18:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] COPY block job progress, current cursor: 597688320 final cursor: 1073741824 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:18:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] COPY block job progress, current cursor: 678428672 final cursor: 1073741824 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:18:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] COPY block job progress, current cursor: 824180736 final cursor: 1073741824 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:18:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:18:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] COPY block job progress, current cursor: 888143872 final cursor: 1073741824 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] COPY block job progress, current cursor: 957349888 final cursor: 1073741824 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] [instance: 62461965-8bbb-4497-81e7-d9237832f190] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTmjRwyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:18:52 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:18:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e611b8ae-9f06-443e-ba6f-a72022fd4b91]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:18:52 user nova-compute[74776]: No targets found.
Nov 22 14:18:52 user nova-compute[74776]: iSNS:
Nov 22 14:18:52 user nova-compute[74776]: No targets found.
Nov 22 14:18:52 user nova-compute[74776]: STATIC:
Nov 22 14:18:52 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618
Nov 22 14:18:52 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:18:52 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:18:52 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83
Nov 22 14:18:52 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:18:52 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:18:52 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900
Nov 22 14:18:52 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:18:52 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:18:52 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab
Nov 22 14:18:52 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:18:52 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:18:52 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047
Nov 22 14:18:52 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:18:52 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:18:52 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551
Nov 22 14:18:52 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:18:52 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:18:52 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4
Nov 22 14:18:52 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:18:52 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:18:52 user nova-compute[74776]: FIRMWARE:
Nov 22 14:18:52 user nova-compute[74776]: No targets found.
Nov 22 14:18:52 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:18:52 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:18:52 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[528273fe-91a0-4ecb-80cc-3cb13cf6009e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12065f1-30f6-477b-9b34-a7b137c94b10]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:52 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:52 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:52 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:52 user nova-compute[74776]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:18:52 user nova-compute[74776]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)
Nov 22 14:18:52 user nova-compute[74776]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)
Nov 22 14:18:52 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:52 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:52 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:52 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:52 user nova-compute[74776]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:18:52 user nova-compute[74776]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)
Nov 22 14:18:52 user nova-compute[74776]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)
Nov 22 14:18:52 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c7820edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047'): ({'sdf'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Removing single pathed devices sdf {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb9f343-d932-4653-b611-a1e523100114]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[388b937c-b1bc-4d60-8dd7-9d0c1c430a72]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Flushing IO for device /dev/sdf {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0c78ab-8cfb-437a-b931-d357990d0072]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c5d4cc-e39d-4f08-a343-ca940bca6620]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] SCSI volumes sdf have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bacaa8-45b3-44e3-ab09-2540966c504c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[96af9eb2-6a9e-4d66-92f3-b35daadb29be]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047, portal: 172.16.0.220,3260]
Nov 22 14:18:52 user nova-compute[74776]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047, portal: 172.16.0.220,3260] successful.
Nov 22 14:18:52 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:53 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[517a1c8f-015f-4ae5-9d68-349bebf804ac]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:53 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:53 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:18:53 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] <== disconnect_volume: return (325ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:18:53 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:18:53 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWBFbRsA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '62461965-8bbb-4497-81e7-d9237832f190', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5f4000f-04ae-4ac4-8623-1afba6388551', 'serial'} {{(pid=74776) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 22 14:18:53 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] [instance: 62461965-8bbb-4497-81e7-d9237832f190] swap_volume: removing Cinder connection for volume 744a160c-44d1-41e8-a877-de71e5b9b047 {{(pid=74776) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] [instance: 62461965-8bbb-4497-81e7-d9237832f190] swap_volume: Updating volume 744a160c-44d1-41e8-a877-de71e5b9b047 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "VWBFbRsA", "auth_password": "tHyunTG7AZeMmC", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "e5f4000f-04ae-4ac4-8623-1afba6388551"}, "status": "reserved", "instance": "62461965-8bbb-4497-81e7-d9237832f190", "attached_at": "", "detached_at": "", "volume_id": "e5f4000f-04ae-4ac4-8623-1afba6388551", "serial": "e5f4000f-04ae-4ac4-8623-1afba6388551"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'e5f4000f-04ae-4ac4-8623-1afba6388551', 'no_device': None, 'attachment_id': 'de33c216-2823-4ebf-89b8-4f801aeb760a'} {{(pid=74776) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ed440e06-e023-466d-9337-25276b37170e tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Lock "62461965-8bbb-4497-81e7-d9237832f190" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.470s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WyeRqbkn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:18:56 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:18:56 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:18:56 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d59b3f1-8927-4483-b697-5c1763d36eb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:18:56 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[49996fc8-d445-46d2-9932-681a9a498192]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0] added
Nov 22 14:18:56 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c721d77-376f-4819-8ecc-4b63ff21df3f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae2d0d4-cf09-476d-b3e0-ce4308970988]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WyeRqbkn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WyeRqbkn" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f72f2a-e57b-4cbf-9dce-88619dd16f59]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WyeRqbkn'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[387243fd-8a07-4b28-bf52-b735e4e1cc4c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c79eed6-e4f9-4de7-a446-a360db153cdb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[29566aac-28f3-4fc9-8e8b-881be6de87fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0, portal: 172.16.0.220,3260]
Nov 22 14:18:56 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0, portal: 172.16.0.220,3260] successful.
Nov 22 14:18:56 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9933c56d-b6e9-4adf-80dc-18fe6d17d13f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef5b18f-69d9-4ed5-8b25-d3547cb1ed41]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)
Nov 22 14:18:56 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] HCTL ('37', '-', '-', 0) found on session 10 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[33726eb7-ac88-4e4b-a6c7-a9379018d6e7]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:56 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: None {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Acquiring lock "62461965-8bbb-4497-81e7-d9237832f190" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Lock "62461965-8bbb-4497-81e7-d9237832f190" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG os_brick.utils [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WyeRqbkn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26665333939346337', 'path': '/dev/sdf'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665333939346337', 'path': '/dev/sdf'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaf2149-c1f3-45d8-af71-51f5c53738c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG nova.objects.instance [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Lazy-loading 'flavor' on Instance uuid fb5def2c-c757-4a3c-a832-142bf8c61413 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[977a30a5-9123-48c1-bd7a-e9dd711635ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] attach device xml: <disk type="block" device="disk">
Nov 22 14:18:57 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:18:57 user nova-compute[74776]:   <source dev="/dev/sdf"/>
Nov 22 14:18:57 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:18:57 user nova-compute[74776]:   <serial>618eee02-93fc-4b6e-a7db-cfdadd664ea0</serial>
Nov 22 14:18:57 user nova-compute[74776]: </disk>
Nov 22 14:18:57 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b87f486-9d10-4dfb-8157-3c8a38ae6802]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d964e5c9-8e59-4796-b8b8-580ec4ef1ec3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:18:57 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:18:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfe41bc-4607-4887-8a44-14daca81b582]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:18:57 user nova-compute[74776]: DEBUG os_brick.utils [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:18:57 user nova-compute[74776]: INFO nova.compute.manager [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Swapping volume e5f4000f-04ae-4ac4-8623-1afba6388551 for 744a160c-44d1-41e8-a877-de71e5b9b047
Nov 22 14:18:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] No VIF found with MAC fa:16:3e:98:f8:b7, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:18:58 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 232d8284-a99b-40c2-aa36-1de93a25729a is timed out.
Nov 22 14:18:58 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Successfully detached device sdc from instance 232d8284-a99b-40c2-aa36-1de93a25729a from the live domain config.
Nov 22 14:18:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlpxTmQS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:18:58 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:18:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8d4bf1d8-6048-4f8d-a715-a5b04ea3f559 tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Lock "fb5def2c-c757-4a3c-a832-142bf8c61413" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.841s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1b95fd-5628-462f-b45f-2fc6a48bc6eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:18:58 user nova-compute[74776]: No targets found.
Nov 22 14:18:58 user nova-compute[74776]: iSNS:
Nov 22 14:18:58 user nova-compute[74776]: No targets found.
Nov 22 14:18:58 user nova-compute[74776]: STATIC:
Nov 22 14:18:58 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618
Nov 22 14:18:58 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:18:58 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:18:58 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0
Nov 22 14:18:58 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:18:58 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:18:58 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83
Nov 22 14:18:58 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:18:58 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:18:58 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900
Nov 22 14:18:58 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:18:58 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:18:58 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab
Nov 22 14:18:58 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:18:58 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:18:58 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551
Nov 22 14:18:58 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:18:58 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:18:58 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4
Nov 22 14:18:58 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:18:58 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:18:58 user nova-compute[74776]: FIRMWARE:
Nov 22 14:18:58 user nova-compute[74776]: No targets found.
Nov 22 14:18:58 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:18:58 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:18:58 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dccdba-827b-4163-a89d-be8a85c7c9cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96e09ff-9dae-4842-946b-3efaf7ee861f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:18:58 user nova-compute[74776]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:58 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:58 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:58 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:58 user nova-compute[74776]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)
Nov 22 14:18:58 user nova-compute[74776]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)
Nov 22 14:18:58 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:18:58 user nova-compute[74776]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:18:58 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:18:58 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:18:58 user nova-compute[74776]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 (non-flash)
Nov 22 14:18:58 user nova-compute[74776]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)
Nov 22 14:18:58 user nova-compute[74776]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)
Nov 22 14:18:58 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c5871c790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4'): ({'sde'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Removing single pathed devices sde {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae257471-cf56-47db-b424-604f31baa9ef]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cf189b-7fc2-4955-bb63-2b98f7c6d6d2]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Flushing IO for device /dev/sde {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.011s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c5f10d-66f8-430a-90d8-92718b322548]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac282d84-2e77-4eec-bae0-e1a277b3ccf5]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] SCSI volumes sde have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e4a662-7ce6-4734-9ddd-8944261e41a8]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ee85e8-5b9c-4862-80b4-5ddb2a3e819a]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4, portal: 172.16.0.220,3260]
Nov 22 14:18:58 user nova-compute[74776]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4, portal: 172.16.0.220,3260] successful.
Nov 22 14:18:58 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25005b9-4e56-43d8-b745-6c1bea65b1d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a545f33-e504-49b4-a0eb-c237c179ccc3]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] <== disconnect_volume: return (338ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bb4770a2-2337-495e-b579-776f6346839d tempest-VolumesAssistedSnapshotsTest-1929042589 tempest-VolumesAssistedSnapshotsTest-1929042589-project] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] volume_snapshot_create: create_info: {'snapshot_id': '150c737a-b2fc-413e-910e-a311c8bd2201', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74776) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bb4770a2-2337-495e-b579-776f6346839d tempest-VolumesAssistedSnapshotsTest-1929042589 tempest-VolumesAssistedSnapshotsTest-1929042589-project] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] snap xml: <domainsnapshot>
Nov 22 14:18:58 user nova-compute[74776]:   <disks>
Nov 22 14:18:58 user nova-compute[74776]:     <disk name="/dev/sdf" snapshot="external" type="file">
Nov 22 14:18:58 user nova-compute[74776]:       <source file="/dev/new_file"/>
Nov 22 14:18:58 user nova-compute[74776]:     </disk>
Nov 22 14:18:58 user nova-compute[74776]:     <disk name="vda" snapshot="no"/>
Nov 22 14:18:58 user nova-compute[74776]:   </disks>
Nov 22 14:18:58 user nova-compute[74776]: </domainsnapshot>
Nov 22 14:18:58 user nova-compute[74776]:  {{(pid=74776) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 22 14:18:58 user nova-compute[74776]: DEBUG nova.objects.instance [None req-bb4770a2-2337-495e-b579-776f6346839d tempest-VolumesAssistedSnapshotsTest-1929042589 tempest-VolumesAssistedSnapshotsTest-1929042589-project] Lazy-loading 'system_metadata' on Instance uuid fb5def2c-c757-4a3c-a832-142bf8c61413 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:18:58 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-bb4770a2-2337-495e-b579-776f6346839d tempest-VolumesAssistedSnapshotsTest-1929042589 tempest-VolumesAssistedSnapshotsTest-1929042589-project] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 22 14:18:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e4533a64-f25e-434b-85bf-2ac7564f2cd6 tempest-VolumesAssistedSnapshotsTest-1929042589 tempest-VolumesAssistedSnapshotsTest-1929042589-project] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] volume_snapshot_delete: delete_info: {'volume_id': '618eee02-93fc-4b6e-a7db-cfdadd664ea0'} {{(pid=74776) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [None req-e4533a64-f25e-434b-85bf-2ac7564f2cd6 tempest-VolumesAssistedSnapshotsTest-1929042589 tempest-VolumesAssistedSnapshotsTest-1929042589-project] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Traceback (most recent call last):
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]     if delete_info['type'] != 'qcow2':
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] KeyError: 'type'
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] 
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [None req-bb4770a2-2337-495e-b579-776f6346839d tempest-VolumesAssistedSnapshotsTest-1929042589 tempest-VolumesAssistedSnapshotsTest-1929042589-project] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Traceback (most recent call last):
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]     rv = execute(f, *args, **kwargs)
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]     six.reraise(c, e, tb)
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]     raise value
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]     rv = meth(*args, **kwargs)
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] 
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [None req-bb4770a2-2337-495e-b579-776f6346839d tempest-VolumesAssistedSnapshotsTest-1929042589 tempest-VolumesAssistedSnapshotsTest-1929042589-project] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Traceback (most recent call last):
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]     self._volume_snapshot_create(context, instance, guest,
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]     rv = execute(f, *args, **kwargs)
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]     six.reraise(c, e, tb)
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]     raise value
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]     rv = meth(*args, **kwargs)
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 22 14:18:58 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] 
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [None req-e4533a64-f25e-434b-85bf-2ac7564f2cd6 tempest-VolumesAssistedSnapshotsTest-1929042589 tempest-VolumesAssistedSnapshotsTest-1929042589-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver 
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver 
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-f8d217b7-d240-428d-b98c-7afb78d6d94a)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver 
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver 
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver 
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server [None req-e4533a64-f25e-434b-85bf-2ac7564f2cd6 tempest-VolumesAssistedSnapshotsTest-1929042589 tempest-VolumesAssistedSnapshotsTest-1929042589-project] Exception during message handling: KeyError: 'type'
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server 
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver [None req-bb4770a2-2337-495e-b579-776f6346839d tempest-VolumesAssistedSnapshotsTest-1929042589 tempest-VolumesAssistedSnapshotsTest-1929042589-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 150c737a-b2fc-413e-910e-a311c8bd2201 could not be found.
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     raise value
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver 
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver 
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 150c737a-b2fc-413e-910e-a311c8bd2201 could not be found. (HTTP 404) (Request-ID: req-8d6ccec5-b970-4eee-8fcc-57bef156ebec)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver 
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver 
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 150c737a-b2fc-413e-910e-a311c8bd2201 could not be found.
Nov 22 14:18:59 user nova-compute[74776]: ERROR nova.virt.libvirt.driver 
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server [None req-bb4770a2-2337-495e-b579-776f6346839d tempest-VolumesAssistedSnapshotsTest-1929042589 tempest-VolumesAssistedSnapshotsTest-1929042589-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     raise value
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 22 14:18:59 user nova-compute[74776]: ERROR oslo_messaging.rpc.server 
Nov 22 14:18:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Acquiring lock "fb5def2c-c757-4a3c-a832-142bf8c61413" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:18:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Lock "fb5def2c-c757-4a3c-a832-142bf8c61413" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:18:59 user nova-compute[74776]: INFO nova.compute.manager [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Detaching volume 618eee02-93fc-4b6e-a7db-cfdadd664ea0
Nov 22 14:18:59 user nova-compute[74776]: INFO nova.virt.block_device [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Attempting to driver detach volume 618eee02-93fc-4b6e-a7db-cfdadd664ea0 from mountpoint /dev/vdb
Nov 22 14:18:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Attempting to detach device vdb from instance fb5def2c-c757-4a3c-a832-142bf8c61413 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:18:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] detach device xml: <disk type="block" device="disk">
Nov 22 14:18:59 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:18:59 user nova-compute[74776]:   <source dev="/dev/sdf"/>
Nov 22 14:18:59 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:18:59 user nova-compute[74776]:   <serial>618eee02-93fc-4b6e-a7db-cfdadd664ea0</serial>
Nov 22 14:18:59 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:18:59 user nova-compute[74776]: </disk>
Nov 22 14:18:59 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:18:59 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Successfully detached device vdb from instance fb5def2c-c757-4a3c-a832-142bf8c61413 from the persistent domain config.
Nov 22 14:18:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fb5def2c-c757-4a3c-a832-142bf8c61413 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:18:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] detach device xml: <disk type="block" device="disk">
Nov 22 14:18:59 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:18:59 user nova-compute[74776]:   <source dev="/dev/sdf"/>
Nov 22 14:18:59 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:18:59 user nova-compute[74776]:   <serial>618eee02-93fc-4b6e-a7db-cfdadd664ea0</serial>
Nov 22 14:18:59 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:18:59 user nova-compute[74776]: </disk>
Nov 22 14:18:59 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:18:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fb5def2c-c757-4a3c-a832-142bf8c61413 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:18:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:01 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 25deabe8-8cfc-4d40-a734-755d4097baf5 is timed out.
Nov 22 14:19:01 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Successfully detached device vdb from instance 25deabe8-8cfc-4d40-a734-755d4097baf5 from the live domain config.
Nov 22 14:19:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iEPpGoFD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:19:01 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:19:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd78754-a26e-4ddf-91d1-8c7e525a00cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:19:01 user nova-compute[74776]: No targets found.
Nov 22 14:19:01 user nova-compute[74776]: iSNS:
Nov 22 14:19:01 user nova-compute[74776]: No targets found.
Nov 22 14:19:01 user nova-compute[74776]: STATIC:
Nov 22 14:19:01 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618
Nov 22 14:19:01 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:01 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:01 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0
Nov 22 14:19:01 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:01 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:01 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83
Nov 22 14:19:01 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:01 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:01 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900
Nov 22 14:19:01 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:01 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:01 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab
Nov 22 14:19:01 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:01 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:01 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551
Nov 22 14:19:01 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:01 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:01 user nova-compute[74776]: FIRMWARE:
Nov 22 14:19:01 user nova-compute[74776]: No targets found.
Nov 22 14:19:01 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:19:01 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:19:01 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[604b5ccc-e089-441a-a41a-c912345b91ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b634c7c-9da1-4a73-8259-24b39e51ce45]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:19:01 user nova-compute[74776]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:19:01 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:19:01 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:19:01 user nova-compute[74776]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)
Nov 22 14:19:01 user nova-compute[74776]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)
Nov 22 14:19:01 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:19:01 user nova-compute[74776]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:19:01 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:19:01 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:19:01 user nova-compute[74776]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 (non-flash)
Nov 22 14:19:01 user nova-compute[74776]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)
Nov 22 14:19:01 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c581fe320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83'): ({'sdg'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Removing single pathed devices sdg {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b7f352-665b-4150-97f0-ee98a49b18de]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadb22f3-9cd2-407d-9b9c-f10c87b0b622]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Flushing IO for device /dev/sdg {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f11de36-1b39-48df-9875-34e58cdd12bd]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb749e9-9f8f-49c8-abe7-b7b79a7e1af4]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] SCSI volumes sdg have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[031cde13-5e10-4cd2-b583-ea33c3c96f1e]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87ef420-5ecf-4d38-8005-a5fd33a1ab5c]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83, portal: 172.16.0.220,3260]
Nov 22 14:19:01 user nova-compute[74776]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83, portal: 172.16.0.220,3260] successful.
Nov 22 14:19:01 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09fa723b-5995-49c3-9d4f-a51986f69f83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7861d69-1cbd-42ff-9a90-2999f2f45816]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] <== disconnect_volume: return (321ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:19:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:19:02 user nova-compute[74776]: DEBUG nova.objects.instance [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lazy-loading 'flavor' on Instance uuid 25deabe8-8cfc-4d40-a734-755d4097baf5 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:19:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c2a9dd7d-d59c-41b6-8e5d-6d9deb74a2f3 tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "25deabe8-8cfc-4d40-a734-755d4097baf5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.944s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:04 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:19:04 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:19:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:04 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:19:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG nova.objects.instance [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lazy-loading 'flavor' on Instance uuid 232d8284-a99b-40c2-aa36-1de93a25729a {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-800d184c-01be-44b6-aeef-6a00c4edc56e tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "232d8284-a99b-40c2-aa36-1de93a25729a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.691s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] [instance: 62461965-8bbb-4497-81e7-d9237832f190] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTmjRwyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '62461965-8bbb-4497-81e7-d9237832f190', 'attached_at': '', 'detached_at': '', 'volume_id': '744a160c-44d1-41e8-a877-de71e5b9b047', 'serial': '744a160c-44d1-41e8-a877-de71e5b9b047'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWBFbRsA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'e5f4000f-04ae-4ac4-8623-1afba6388551'}, 'status': 'reserved', 'instance': '62461965-8bbb-4497-81e7-d9237832f190', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5f4000f-04ae-4ac4-8623-1afba6388551', 'serial'} {{(pid=74776) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTmjRwyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:19:05 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:19:05 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:19:05 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec457216-9656-4945-95e3-2d7c3a2cf062]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:19:05 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d46713-af04-4630-9163-a9ceae606041]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047] added
Nov 22 14:19:05 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[26795b19-9aab-4da4-8b61-fde9c83d2984]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bcda92-0f67-47c8-87eb-9871c12ba6a3]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sTmjRwyi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sTmjRwyi" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7d8e56-42fd-4945-aaba-fac175e7ae27]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sTmjRwyi'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49443fe-5b8a-4a81-bb86-57a1d2051bb5]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e4cc3b-f867-4ba2-80f1-d72708077d04]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:19:05 user nova-compute[74776]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:19:05 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:19:05 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:19:05 user nova-compute[74776]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)
Nov 22 14:19:05 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:19:05 user nova-compute[74776]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:19:05 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:19:05 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:19:05 user nova-compute[74776]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)
Nov 22 14:19:05 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa71143b-e911-4f5b-a547-d26f978d406c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047, portal: 172.16.0.220,3260]
Nov 22 14:19:05 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047, portal: 172.16.0.220,3260] successful.
Nov 22 14:19:05 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb79cdc9-5d6c-4e5e-896b-7455b07be1dc]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95eb06f-d9ca-4f6f-b2eb-a01f08c874fb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:19:05 user nova-compute[74776]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:19:05 user nova-compute[74776]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:19:05 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:19:05 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:19:05 user nova-compute[74776]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)
Nov 22 14:19:05 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:19:05 user nova-compute[74776]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:19:05 user nova-compute[74776]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:19:05 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:19:05 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:19:05 user nova-compute[74776]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)
Nov 22 14:19:05 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[29863fc6-4f0f-4d60-8f1e-4186c338d603]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTmjRwyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Acquiring lock "232d8284-a99b-40c2-aa36-1de93a25729a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "232d8284-a99b-40c2-aa36-1de93a25729a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Acquiring lock "232d8284-a99b-40c2-aa36-1de93a25729a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "232d8284-a99b-40c2-aa36-1de93a25729a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "232d8284-a99b-40c2-aa36-1de93a25729a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:06 user nova-compute[74776]: INFO nova.compute.manager [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Terminating instance
Nov 22 14:19:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26634643634666634', 'path': '/dev/sde'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634643634666634', 'path': '/dev/sde'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG nova.objects.instance [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Lazy-loading 'flavor' on Instance uuid 62461965-8bbb-4497-81e7-d9237832f190 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:19:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG nova.compute.manager [req-e3787328-a75a-49e6-970e-1c4636c33faf req-38b8d1d4-1160-4fba-b136-ebf6ea621c51 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Received event network-vif-unplugged-b3675ad0-6dfc-4731-a999-a16801642163 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e3787328-a75a-49e6-970e-1c4636c33faf req-38b8d1d4-1160-4fba-b136-ebf6ea621c51 service nova] Acquiring lock "232d8284-a99b-40c2-aa36-1de93a25729a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e3787328-a75a-49e6-970e-1c4636c33faf req-38b8d1d4-1160-4fba-b136-ebf6ea621c51 service nova] Lock "232d8284-a99b-40c2-aa36-1de93a25729a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e3787328-a75a-49e6-970e-1c4636c33faf req-38b8d1d4-1160-4fba-b136-ebf6ea621c51 service nova] Lock "232d8284-a99b-40c2-aa36-1de93a25729a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG nova.compute.manager [req-e3787328-a75a-49e6-970e-1c4636c33faf req-38b8d1d4-1160-4fba-b136-ebf6ea621c51 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] No waiting events found dispatching network-vif-unplugged-b3675ad0-6dfc-4731-a999-a16801642163 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG nova.compute.manager [req-e3787328-a75a-49e6-970e-1c4636c33faf req-38b8d1d4-1160-4fba-b136-ebf6ea621c51 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Received event network-vif-unplugged-b3675ad0-6dfc-4731-a999-a16801642163 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG nova.compute.manager [req-6774a2f7-9f1c-4767-8bb8-c353ce2b03cc req-fbbc25e1-06ed-4d3c-a781-380c38be210f service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Received event network-changed-1c7ec696-a871-442f-aec4-902014c6ea9a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG nova.compute.manager [req-6774a2f7-9f1c-4767-8bb8-c353ce2b03cc req-fbbc25e1-06ed-4d3c-a781-380c38be210f service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Refreshing instance network info cache due to event network-changed-1c7ec696-a871-442f-aec4-902014c6ea9a. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6774a2f7-9f1c-4767-8bb8-c353ce2b03cc req-fbbc25e1-06ed-4d3c-a781-380c38be210f service nova] Acquiring lock "refresh_cache-42b00137-df98-47d9-9d02-29b4707fed30" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6774a2f7-9f1c-4767-8bb8-c353ce2b03cc req-fbbc25e1-06ed-4d3c-a781-380c38be210f service nova] Acquired lock "refresh_cache-42b00137-df98-47d9-9d02-29b4707fed30" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG nova.network.neutron [req-6774a2f7-9f1c-4767-8bb8-c353ce2b03cc req-fbbc25e1-06ed-4d3c-a781-380c38be210f service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Refreshing network info cache for port 1c7ec696-a871-442f-aec4-902014c6ea9a {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:07 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Instance destroyed successfully.
Nov 22 14:19:07 user nova-compute[74776]: DEBUG nova.objects.instance [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lazy-loading 'resources' on Instance uuid 232d8284-a99b-40c2-aa36-1de93a25729a {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-331917364',display_name='tempest-AttachSCSIVolumeTestJSON-server-331917364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-331917364',id=5,image_ref='1638bb8c-f36c-4d1b-ab22-67c3b2500095',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM03DEyNjAHttoQ0r+wlU4uKjwYHyIFVNlSo1JXiwIEAKK1no5H+fnR1WKHvch3FiM7sN22LyNxFK0dMMU6lkhZpwDMNlhWOONYuUezddU2Fv3eabuUiuNHj8Ar2SDW3SQ==',key_name='tempest-keypair-977328427',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:16:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4eea24586225438187a24cc3af0f800b',ramdisk_id='',reservation_id='r-ngn8ht0i',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1638bb8c-f36c-4d1b-ab22-67c3b2500095',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-933096826',owner_user_name='tempest-AttachSCSIVolumeTestJSON-933096826-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:16:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a271783c7a5a4564815d0c837a811551',uuid=232d8284-a99b-40c2-aa36-1de93a25729a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3675ad0-6dfc-4731-a999-a16801642163", "address": "fa:16:3e:01:f2:5e", "network": {"id": "18a7dc3b-d85c-457d-81d2-0a49599e45ac", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-704035334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4eea24586225438187a24cc3af0f800b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3675ad0-6d", "ovs_interfaceid": "b3675ad0-6dfc-4731-a999-a16801642163", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Converting VIF {"id": "b3675ad0-6dfc-4731-a999-a16801642163", "address": "fa:16:3e:01:f2:5e", "network": {"id": "18a7dc3b-d85c-457d-81d2-0a49599e45ac", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-704035334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4eea24586225438187a24cc3af0f800b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3675ad0-6d", "ovs_interfaceid": "b3675ad0-6dfc-4731-a999-a16801642163", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:f2:5e,bridge_name='br-int',has_traffic_filtering=True,id=b3675ad0-6dfc-4731-a999-a16801642163,network=Network(18a7dc3b-d85c-457d-81d2-0a49599e45ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3675ad0-6d') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG os_vif [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:f2:5e,bridge_name='br-int',has_traffic_filtering=True,id=b3675ad0-6dfc-4731-a999-a16801642163,network=Network(18a7dc3b-d85c-457d-81d2-0a49599e45ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3675ad0-6d') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3675ad0-6d, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4637a04-5de1-4784-b696-5f0d407fc1a6) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:07 user nova-compute[74776]: INFO os_vif [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:f2:5e,bridge_name='br-int',has_traffic_filtering=True,id=b3675ad0-6dfc-4731-a999-a16801642163,network=Network(18a7dc3b-d85c-457d-81d2-0a49599e45ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3675ad0-6d')
Nov 22 14:19:07 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Deleting instance files /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a_del
Nov 22 14:19:07 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Deletion of /opt/stack/data/nova/instances/232d8284-a99b-40c2-aa36-1de93a25729a_del complete
Nov 22 14:19:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json" returned: 0 in 0.336s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] COPY block job progress, current cursor: 165675008 final cursor: 1073741824 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:19:07 user nova-compute[74776]: INFO nova.compute.manager [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 22 14:19:07 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:19:07 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:19:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "42b00137-df98-47d9-9d02-29b4707fed30" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "42b00137-df98-47d9-9d02-29b4707fed30" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:08 user nova-compute[74776]: DEBUG nova.objects.instance [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lazy-loading 'flavor' on Instance uuid 42b00137-df98-47d9-9d02-29b4707fed30 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:19:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "42b00137-df98-47d9-9d02-29b4707fed30" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.137s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:08 user nova-compute[74776]: DEBUG nova.network.neutron [req-6774a2f7-9f1c-4767-8bb8-c353ce2b03cc req-fbbc25e1-06ed-4d3c-a781-380c38be210f service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Updated VIF entry in instance network info cache for port 1c7ec696-a871-442f-aec4-902014c6ea9a. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:19:08 user nova-compute[74776]: DEBUG nova.network.neutron [req-6774a2f7-9f1c-4767-8bb8-c353ce2b03cc req-fbbc25e1-06ed-4d3c-a781-380c38be210f service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Updating instance_info_cache with network_info: [{"id": "1c7ec696-a871-442f-aec4-902014c6ea9a", "address": "fa:16:3e:03:d6:8f", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7ec696-a8", "ovs_interfaceid": "1c7ec696-a871-442f-aec4-902014c6ea9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:19:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6774a2f7-9f1c-4767-8bb8-c353ce2b03cc req-fbbc25e1-06ed-4d3c-a781-380c38be210f service nova] Releasing lock "refresh_cache-42b00137-df98-47d9-9d02-29b4707fed30" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:19:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-9bf28e5f-fd98-45db-b344-5b46fa7382c1 req-0092ba54-6f11-499a-850d-cb3fcc43b3c1 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-changed-b494f667-97c7-4e1e-94c8-9072d1b85d33 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-9bf28e5f-fd98-45db-b344-5b46fa7382c1 req-0092ba54-6f11-499a-850d-cb3fcc43b3c1 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Refreshing instance network info cache due to event network-changed-b494f667-97c7-4e1e-94c8-9072d1b85d33. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:19:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9bf28e5f-fd98-45db-b344-5b46fa7382c1 req-0092ba54-6f11-499a-850d-cb3fcc43b3c1 service nova] Acquiring lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:19:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9bf28e5f-fd98-45db-b344-5b46fa7382c1 req-0092ba54-6f11-499a-850d-cb3fcc43b3c1 service nova] Acquired lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:19:08 user nova-compute[74776]: DEBUG nova.network.neutron [req-9bf28e5f-fd98-45db-b344-5b46fa7382c1 req-0092ba54-6f11-499a-850d-cb3fcc43b3c1 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Refreshing network info cache for port b494f667-97c7-4e1e-94c8-9072d1b85d33 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:19:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] COPY block job progress, current cursor: 321912832 final cursor: 1073741824 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:19:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "42b00137-df98-47d9-9d02-29b4707fed30" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "42b00137-df98-47d9-9d02-29b4707fed30" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:08 user nova-compute[74776]: INFO nova.compute.manager [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Attaching volume 99d7c30a-946e-42e1-b105-fac14a5bd866 to /dev/vdb
Nov 22 14:19:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:08 user nova-compute[74776]: DEBUG os_brick.utils [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:19:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[72105b19-dd21-4122-ae3d-3ca142233f84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-f56d5735-50ff-4f8a-b606-268e8b43be1b req-8a437151-3fe5-4966-8a02-b5c6ab350dc6 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Received event network-vif-plugged-b3675ad0-6dfc-4731-a999-a16801642163 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f56d5735-50ff-4f8a-b606-268e8b43be1b req-8a437151-3fe5-4966-8a02-b5c6ab350dc6 service nova] Acquiring lock "232d8284-a99b-40c2-aa36-1de93a25729a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f56d5735-50ff-4f8a-b606-268e8b43be1b req-8a437151-3fe5-4966-8a02-b5c6ab350dc6 service nova] Lock "232d8284-a99b-40c2-aa36-1de93a25729a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f56d5735-50ff-4f8a-b606-268e8b43be1b req-8a437151-3fe5-4966-8a02-b5c6ab350dc6 service nova] Lock "232d8284-a99b-40c2-aa36-1de93a25729a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-f56d5735-50ff-4f8a-b606-268e8b43be1b req-8a437151-3fe5-4966-8a02-b5c6ab350dc6 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] No waiting events found dispatching network-vif-plugged-b3675ad0-6dfc-4731-a999-a16801642163 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:09 user nova-compute[74776]: WARNING nova.compute.manager [req-f56d5735-50ff-4f8a-b606-268e8b43be1b req-8a437151-3fe5-4966-8a02-b5c6ab350dc6 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Received unexpected event network-vif-plugged-b3675ad0-6dfc-4731-a999-a16801642163 for instance with vm_state active and task_state deleting.
Nov 22 14:19:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] COPY block job progress, current cursor: 528482304 final cursor: 1073741824 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:19:09 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:19:09 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:19:09 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=7319MB free_disk=25.4459228515625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d882569-5ccc-417d-a504-e7b111fa20be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab87d42-79d6-4847-b952-5820f2744962]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2911c34-c262-418c-a99a-08b750595309]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:19:09 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:19:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[59281ba5-5385-4b08-ba48-551ff7d7ec5d]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG os_brick.utils [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] <== get_connector_properties: return (773ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Updating existing volume attachment record: 22a17e90-a20e-4134-93c7-24da47bc0994 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance e96ab1bf-6f19-4e5f-b79d-f0266988090b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4629d82d-fd02-4a58-a535-b362b493e7c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 98fb9b54-c428-4a48-b1ff-a976f971b764 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 232d8284-a99b-40c2-aa36-1de93a25729a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 25deabe8-8cfc-4d40-a734-755d4097baf5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 62461965-8bbb-4497-81e7-d9237832f190 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance fb5def2c-c757-4a3c-a832-142bf8c61413 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 42b00137-df98-47d9-9d02-29b4707fed30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 67bb65da-d976-40da-9568-2c1e3930fb7f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] COPY block job progress, current cursor: 667942912 final cursor: 1073741824 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:19:09 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Took 2.01 seconds to deallocate network for instance.
Nov 22 14:19:09 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:19:09 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:19:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:10 user nova-compute[74776]: DEBUG nova.network.neutron [req-9bf28e5f-fd98-45db-b344-5b46fa7382c1 req-0092ba54-6f11-499a-850d-cb3fcc43b3c1 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Updated VIF entry in instance network info cache for port b494f667-97c7-4e1e-94c8-9072d1b85d33. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:19:10 user nova-compute[74776]: DEBUG nova.network.neutron [req-9bf28e5f-fd98-45db-b344-5b46fa7382c1 req-0092ba54-6f11-499a-850d-cb3fcc43b3c1 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Updating instance_info_cache with network_info: [{"id": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "address": "fa:16:3e:d0:0e:24", "network": {"id": "80ca7997-9b10-4a5f-a42a-4bbbde2937b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-773521062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb494f667-97", "ovs_interfaceid": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67c21334-fae7-424e-8612-ae7727f6c999", "address": "fa:16:3e:76:a6:88", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c21334-fa", "ovs_interfaceid": "67c21334-fae7-424e-8612-ae7727f6c999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "116116d9-ff23-4e79-ac3c-c8744dd13158", "address": "fa:16:3e:73:5e:dc", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116116d9-ff", "ovs_interfaceid": "116116d9-ff23-4e79-ac3c-c8744dd13158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "217aeb80-f22d-4b93-919a-af8856de5865", "address": "fa:16:3e:89:09:5e", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217aeb80-f2", "ovs_interfaceid": "217aeb80-f22d-4b93-919a-af8856de5865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e366f70-4640-4479-b132-93b103c747f4", "address": "fa:16:3e:f7:15:56", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e366f70-46", "ovs_interfaceid": "0e366f70-4640-4479-b132-93b103c747f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "address": "fa:16:3e:f2:77:1c", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d8dde0-24", "ovs_interfaceid": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6190aa4-f199-434a-9953-88ca35f2b483", "address": "fa:16:3e:b8:a3:a0", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6190aa4-f1", "ovs_interfaceid": "b6190aa4-f199-434a-9953-88ca35f2b483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:19:10 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:19:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.784s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.040s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9bf28e5f-fd98-45db-b344-5b46fa7382c1 req-0092ba54-6f11-499a-850d-cb3fcc43b3c1 service nova] Releasing lock "refresh_cache-67bb65da-d976-40da-9568-2c1e3930fb7f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:19:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] COPY block job progress, current cursor: 835715072 final cursor: 1073741824 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:19:10 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:19:10 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:19:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.498s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:10 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Deleted allocations for instance 232d8284-a99b-40c2-aa36-1de93a25729a
Nov 22 14:19:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-00389036-bce4-40df-9cb5-e105d7f5766b tempest-AttachSCSIVolumeTestJSON-933096826 tempest-AttachSCSIVolumeTestJSON-933096826-project-member] Lock "232d8284-a99b-40c2-aa36-1de93a25729a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.105s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] COPY block job progress, current cursor: 985661440 final cursor: 1073741824 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG nova.compute.manager [req-6f5ba931-6e29-43f3-b74f-83b9237ae6c2 req-00a0e678-fea1-44ae-b554-18ce0fed9a73 service nova] [instance: 232d8284-a99b-40c2-aa36-1de93a25729a] Received event network-vif-deleted-b3675ad0-6dfc-4731-a999-a16801642163 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] [instance: 62461965-8bbb-4497-81e7-d9237832f190] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWBFbRsA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'e5f4000f-04ae-4ac4-8623-1afba6388551'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:19:11 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:19:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5b8000-d78a-4d99-b456-ab407b069901]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:19:11 user nova-compute[74776]: No targets found.
Nov 22 14:19:11 user nova-compute[74776]: iSNS:
Nov 22 14:19:11 user nova-compute[74776]: No targets found.
Nov 22 14:19:11 user nova-compute[74776]: STATIC:
Nov 22 14:19:11 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618
Nov 22 14:19:11 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:11 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:11 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0
Nov 22 14:19:11 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:11 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:11 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900
Nov 22 14:19:11 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:11 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:11 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab
Nov 22 14:19:11 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:11 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:11 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047
Nov 22 14:19:11 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:11 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:11 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551
Nov 22 14:19:11 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:11 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:11 user nova-compute[74776]: FIRMWARE:
Nov 22 14:19:11 user nova-compute[74776]: No targets found.
Nov 22 14:19:11 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:19:11 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:19:11 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a08ba49-d081-49bf-959b-f36fabf049de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c440dc-bbd2-4d03-b79c-4b8768ab672a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:19:11 user nova-compute[74776]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:19:11 user nova-compute[74776]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:19:11 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:19:11 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:19:11 user nova-compute[74776]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)
Nov 22 14:19:11 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:19:11 user nova-compute[74776]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:19:11 user nova-compute[74776]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:19:11 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:19:11 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:19:11 user nova-compute[74776]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 (non-flash)
Nov 22 14:19:11 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c58257490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551'): ({'sdh'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Removing single pathed devices sdh {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[085786d0-731e-41dd-8825-8f2d978bae5b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c5f1d0-95f1-4a7d-a8e0-201314c2b565]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Flushing IO for device /dev/sdh {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a494c883-648b-4736-9582-727c55a6f929]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.039s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ad1c0f-9912-480e-a8ef-a27d87edfd22]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] SCSI volumes sdh have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Updating instance_info_cache with network_info: [{"id": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "address": "fa:16:3e:a5:87:db", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabaa3c9b-98", "ovs_interfaceid": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3146a233-8781-4651-857c-08bda93f6989]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50335f3-6cec-4e1d-a132-73f200599711]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551, portal: 172.16.0.220,3260]
Nov 22 14:19:11 user nova-compute[74776]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551, portal: 172.16.0.220,3260] successful.
Nov 22 14:19:11 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5f4000f-04ae-4ac4-8623-1afba6388551 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5055c25-d4a8-405c-9dc4-55d515d201d1]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] <== disconnect_volume: return (375ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTmjRwyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '62461965-8bbb-4497-81e7-d9237832f190', 'attached_at': '', 'detached_at': '', 'volume_id': '744a160c-44d1-41e8-a877-de71e5b9b047', 'serial'} {{(pid=74776) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] [instance: 62461965-8bbb-4497-81e7-d9237832f190] swap_volume: removing Cinder connection for volume e5f4000f-04ae-4ac4-8623-1afba6388551 {{(pid=74776) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:11 user nova-compute[74776]: INFO nova.compute.manager [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Terminating instance
Nov 22 14:19:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-1735ce64-dcb6-4760-8968-88fe96a2a3d7 req-efe53675-488a-4126-aba4-943cced2c272 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-unplugged-116116d9-ff23-4e79-ac3c-c8744dd13158 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1735ce64-dcb6-4760-8968-88fe96a2a3d7 req-efe53675-488a-4126-aba4-943cced2c272 service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1735ce64-dcb6-4760-8968-88fe96a2a3d7 req-efe53675-488a-4126-aba4-943cced2c272 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1735ce64-dcb6-4760-8968-88fe96a2a3d7 req-efe53675-488a-4126-aba4-943cced2c272 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-1735ce64-dcb6-4760-8968-88fe96a2a3d7 req-efe53675-488a-4126-aba4-943cced2c272 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-unplugged-116116d9-ff23-4e79-ac3c-c8744dd13158 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-1735ce64-dcb6-4760-8968-88fe96a2a3d7 req-efe53675-488a-4126-aba4-943cced2c272 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-unplugged-116116d9-ff23-4e79-ac3c-c8744dd13158 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-1351a9a2-de17-4c6f-8fab-4c13abf0a99c req-e277c6d1-e264-4a7a-bb0a-871957c1172f service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-unplugged-217aeb80-f22d-4b93-919a-af8856de5865 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1351a9a2-de17-4c6f-8fab-4c13abf0a99c req-e277c6d1-e264-4a7a-bb0a-871957c1172f service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1351a9a2-de17-4c6f-8fab-4c13abf0a99c req-e277c6d1-e264-4a7a-bb0a-871957c1172f service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1351a9a2-de17-4c6f-8fab-4c13abf0a99c req-e277c6d1-e264-4a7a-bb0a-871957c1172f service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-1351a9a2-de17-4c6f-8fab-4c13abf0a99c req-e277c6d1-e264-4a7a-bb0a-871957c1172f service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-unplugged-217aeb80-f22d-4b93-919a-af8856de5865 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-1351a9a2-de17-4c6f-8fab-4c13abf0a99c req-e277c6d1-e264-4a7a-bb0a-871957c1172f service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-unplugged-217aeb80-f22d-4b93-919a-af8856de5865 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] [instance: 62461965-8bbb-4497-81e7-d9237832f190] swap_volume: Updating volume e5f4000f-04ae-4ac4-8623-1afba6388551 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "sTmjRwyi", "auth_password": "m5yYZxzcwbKg8o", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "744a160c-44d1-41e8-a877-de71e5b9b047"}, "status": "reserved", "instance": "62461965-8bbb-4497-81e7-d9237832f190", "attached_at": "", "detached_at": "", "volume_id": "744a160c-44d1-41e8-a877-de71e5b9b047", "serial": "744a160c-44d1-41e8-a877-de71e5b9b047"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '744a160c-44d1-41e8-a877-de71e5b9b047', 'no_device': None, 'attachment_id': 'c8c99375-e6d6-4b2a-8cc9-0a8ffb25d3b1'} {{(pid=74776) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ad9b9d86-08c0-4cfe-9ae7-278bd52a1718 tempest-TestVolumeSwap-894762680 tempest-TestVolumeSwap-894762680-project-admin] Lock "62461965-8bbb-4497-81e7-d9237832f190" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.404s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG nova.compute.manager [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-unplugged-b494f667-97c7-4e1e-94c8-9072d1b85d33 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG nova.compute.manager [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-unplugged-b494f667-97c7-4e1e-94c8-9072d1b85d33 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG nova.compute.manager [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-unplugged-b494f667-97c7-4e1e-94c8-9072d1b85d33 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG nova.compute.manager [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-plugged-b494f667-97c7-4e1e-94c8-9072d1b85d33 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG nova.compute.manager [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-plugged-b494f667-97c7-4e1e-94c8-9072d1b85d33 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:13 user nova-compute[74776]: WARNING nova.compute.manager [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received unexpected event network-vif-plugged-b494f667-97c7-4e1e-94c8-9072d1b85d33 for instance with vm_state active and task_state deleting.
Nov 22 14:19:13 user nova-compute[74776]: DEBUG nova.compute.manager [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-unplugged-67c21334-fae7-424e-8612-ae7727f6c999 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG nova.compute.manager [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-unplugged-67c21334-fae7-424e-8612-ae7727f6c999 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG nova.compute.manager [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-unplugged-67c21334-fae7-424e-8612-ae7727f6c999 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG nova.compute.manager [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-plugged-67c21334-fae7-424e-8612-ae7727f6c999 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG nova.compute.manager [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-plugged-67c21334-fae7-424e-8612-ae7727f6c999 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:13 user nova-compute[74776]: WARNING nova.compute.manager [req-d2278b17-763e-4a1b-a0e7-8d2c5d890c38 req-dc1100a5-e3de-476d-8e11-21fa610d9955 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received unexpected event network-vif-plugged-67c21334-fae7-424e-8612-ae7727f6c999 for instance with vm_state active and task_state deleting.
Nov 22 14:19:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Acquiring lock "62461965-8bbb-4497-81e7-d9237832f190" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "62461965-8bbb-4497-81e7-d9237832f190" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:13 user nova-compute[74776]: INFO nova.compute.manager [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Detaching volume 744a160c-44d1-41e8-a877-de71e5b9b047
Nov 22 14:19:13 user nova-compute[74776]: INFO nova.virt.block_device [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Attempting to driver detach volume 744a160c-44d1-41e8-a877-de71e5b9b047 from mountpoint /dev/vdb
Nov 22 14:19:13 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Instance destroyed successfully.
Nov 22 14:19:13 user nova-compute[74776]: DEBUG nova.objects.instance [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lazy-loading 'resources' on Instance uuid 67bb65da-d976-40da-9568-2c1e3930fb7f {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Attempting to detach device vdb from instance 62461965-8bbb-4497-81e7-d9237832f190 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:19:13 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:19:13 user nova-compute[74776]:   <source dev="/dev/sde"/>
Nov 22 14:19:13 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:19:13 user nova-compute[74776]:   <serial>744a160c-44d1-41e8-a877-de71e5b9b047</serial>
Nov 22 14:19:13 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:19:13 user nova-compute[74776]: </disk>
Nov 22 14:19:13 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:19:13 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Successfully detached device vdb from instance 62461965-8bbb-4497-81e7-d9237832f190 from the persistent domain config.
Nov 22 14:19:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 62461965-8bbb-4497-81e7-d9237832f190 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:19:13 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:19:13 user nova-compute[74776]:   <source dev="/dev/sde"/>
Nov 22 14:19:13 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:19:13 user nova-compute[74776]:   <serial>744a160c-44d1-41e8-a877-de71e5b9b047</serial>
Nov 22 14:19:13 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:19:13 user nova-compute[74776]: </disk>
Nov 22 14:19:13 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-225287415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-225287415',id=10,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFAE2muYctKQ5lA2KDuTvrad/Zh8vGOeEN7ZZ/jC2h1qv/x7tvIDFYvTC96h8AMspYnkoKKy6/U8CI0G+VpnDmPKl1G9/7zLdmaOLWoBHF3EF4jlJrYBSOMjPvuXiKwFg==',key_name='tempest-keypair-84908803',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:17:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d667cb9927d4d5b9a44139c04e035b2',ramdisk_id='',reservation_id='r-rofrtvr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-144853562',owner_user_name='tempest-TaggedBootDevicesTest_v242-144853562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6362afe7c4a4c67b9dca81a3cb21a06',uuid=67bb65da-d976-40da-9568-2c1e3930fb7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "address": "fa:16:3e:d0:0e:24", "network": {"id": "80ca7997-9b10-4a5f-a42a-4bbbde2937b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-773521062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb494f667-97", "ovs_interfaceid": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converting VIF {"id": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "address": "fa:16:3e:d0:0e:24", "network": {"id": "80ca7997-9b10-4a5f-a42a-4bbbde2937b5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-773521062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb494f667-97", "ovs_interfaceid": "b494f667-97c7-4e1e-94c8-9072d1b85d33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:0e:24,bridge_name='br-int',has_traffic_filtering=True,id=b494f667-97c7-4e1e-94c8-9072d1b85d33,network=Network(80ca7997-9b10-4a5f-a42a-4bbbde2937b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb494f667-97') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG os_vif [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:0e:24,bridge_name='br-int',has_traffic_filtering=True,id=b494f667-97c7-4e1e-94c8-9072d1b85d33,network=Network(80ca7997-9b10-4a5f-a42a-4bbbde2937b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb494f667-97') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb494f667-97, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee3d25e0-86a5-46c1-b0e6-a65b78517577) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: INFO os_vif [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:0e:24,bridge_name='br-int',has_traffic_filtering=True,id=b494f667-97c7-4e1e-94c8-9072d1b85d33,network=Network(80ca7997-9b10-4a5f-a42a-4bbbde2937b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb494f667-97')
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-225287415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-225287415',id=10,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFAE2muYctKQ5lA2KDuTvrad/Zh8vGOeEN7ZZ/jC2h1qv/x7tvIDFYvTC96h8AMspYnkoKKy6/U8CI0G+VpnDmPKl1G9/7zLdmaOLWoBHF3EF4jlJrYBSOMjPvuXiKwFg==',key_name='tempest-keypair-84908803',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:17:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d667cb9927d4d5b9a44139c04e035b2',ramdisk_id='',reservation_id='r-rofrtvr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-144853562',owner_user_name='tempest-TaggedBootDevicesTest_v242-144853562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6362afe7c4a4c67b9dca81a3cb21a06',uuid=67bb65da-d976-40da-9568-2c1e3930fb7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67c21334-fae7-424e-8612-ae7727f6c999", "address": "fa:16:3e:76:a6:88", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c21334-fa", "ovs_interfaceid": "67c21334-fae7-424e-8612-ae7727f6c999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converting VIF {"id": "67c21334-fae7-424e-8612-ae7727f6c999", "address": "fa:16:3e:76:a6:88", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c21334-fa", "ovs_interfaceid": "67c21334-fae7-424e-8612-ae7727f6c999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=67c21334-fae7-424e-8612-ae7727f6c999,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap67c21334-fa') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_vif [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=67c21334-fae7-424e-8612-ae7727f6c999,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap67c21334-fa') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67c21334-fa, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40f66bb5-6488-4a7f-8074-5771e6130c32) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: INFO os_vif [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:a6:88,bridge_name='br-int',has_traffic_filtering=True,id=67c21334-fae7-424e-8612-ae7727f6c999,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap67c21334-fa')
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-225287415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-225287415',id=10,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFAE2muYctKQ5lA2KDuTvrad/Zh8vGOeEN7ZZ/jC2h1qv/x7tvIDFYvTC96h8AMspYnkoKKy6/U8CI0G+VpnDmPKl1G9/7zLdmaOLWoBHF3EF4jlJrYBSOMjPvuXiKwFg==',key_name='tempest-keypair-84908803',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:17:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d667cb9927d4d5b9a44139c04e035b2',ramdisk_id='',reservation_id='r-rofrtvr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-144853562',owner_user_name='tempest-TaggedBootDevicesTest_v242-144853562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6362afe7c4a4c67b9dca81a3cb21a06',uuid=67bb65da-d976-40da-9568-2c1e3930fb7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "116116d9-ff23-4e79-ac3c-c8744dd13158", "address": "fa:16:3e:73:5e:dc", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116116d9-ff", "ovs_interfaceid": "116116d9-ff23-4e79-ac3c-c8744dd13158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converting VIF {"id": "116116d9-ff23-4e79-ac3c-c8744dd13158", "address": "fa:16:3e:73:5e:dc", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116116d9-ff", "ovs_interfaceid": "116116d9-ff23-4e79-ac3c-c8744dd13158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:5e:dc,bridge_name='br-int',has_traffic_filtering=True,id=116116d9-ff23-4e79-ac3c-c8744dd13158,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap116116d9-ff') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_vif [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:5e:dc,bridge_name='br-int',has_traffic_filtering=True,id=116116d9-ff23-4e79-ac3c-c8744dd13158,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap116116d9-ff') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap116116d9-ff, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=913df32e-44a3-47e2-9681-c7c54af8e070) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: INFO os_vif [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:5e:dc,bridge_name='br-int',has_traffic_filtering=True,id=116116d9-ff23-4e79-ac3c-c8744dd13158,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap116116d9-ff')
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-225287415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-225287415',id=10,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFAE2muYctKQ5lA2KDuTvrad/Zh8vGOeEN7ZZ/jC2h1qv/x7tvIDFYvTC96h8AMspYnkoKKy6/U8CI0G+VpnDmPKl1G9/7zLdmaOLWoBHF3EF4jlJrYBSOMjPvuXiKwFg==',key_name='tempest-keypair-84908803',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:17:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d667cb9927d4d5b9a44139c04e035b2',ramdisk_id='',reservation_id='r-rofrtvr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-144853562',owner_user_name='tempest-TaggedBootDevicesTest_v242-144853562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6362afe7c4a4c67b9dca81a3cb21a06',uuid=67bb65da-d976-40da-9568-2c1e3930fb7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "217aeb80-f22d-4b93-919a-af8856de5865", "address": "fa:16:3e:89:09:5e", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217aeb80-f2", "ovs_interfaceid": "217aeb80-f22d-4b93-919a-af8856de5865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converting VIF {"id": "217aeb80-f22d-4b93-919a-af8856de5865", "address": "fa:16:3e:89:09:5e", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217aeb80-f2", "ovs_interfaceid": "217aeb80-f22d-4b93-919a-af8856de5865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:09:5e,bridge_name='br-int',has_traffic_filtering=True,id=217aeb80-f22d-4b93-919a-af8856de5865,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217aeb80-f2') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_vif [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:09:5e,bridge_name='br-int',has_traffic_filtering=True,id=217aeb80-f22d-4b93-919a-af8856de5865,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217aeb80-f2') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap217aeb80-f2, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=126fc054-d251-4047-8fd6-88cf4ac0c18b) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 62461965-8bbb-4497-81e7-d9237832f190 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: INFO os_vif [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:09:5e,bridge_name='br-int',has_traffic_filtering=True,id=217aeb80-f22d-4b93-919a-af8856de5865,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217aeb80-f2')
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-225287415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-225287415',id=10,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFAE2muYctKQ5lA2KDuTvrad/Zh8vGOeEN7ZZ/jC2h1qv/x7tvIDFYvTC96h8AMspYnkoKKy6/U8CI0G+VpnDmPKl1G9/7zLdmaOLWoBHF3EF4jlJrYBSOMjPvuXiKwFg==',key_name='tempest-keypair-84908803',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:17:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d667cb9927d4d5b9a44139c04e035b2',ramdisk_id='',reservation_id='r-rofrtvr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-144853562',owner_user_name='tempest-TaggedBootDevicesTest_v242-144853562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6362afe7c4a4c67b9dca81a3cb21a06',uuid=67bb65da-d976-40da-9568-2c1e3930fb7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e366f70-4640-4479-b132-93b103c747f4", "address": "fa:16:3e:f7:15:56", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e366f70-46", "ovs_interfaceid": "0e366f70-4640-4479-b132-93b103c747f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converting VIF {"id": "0e366f70-4640-4479-b132-93b103c747f4", "address": "fa:16:3e:f7:15:56", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e366f70-46", "ovs_interfaceid": "0e366f70-4640-4479-b132-93b103c747f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:15:56,bridge_name='br-int',has_traffic_filtering=True,id=0e366f70-4640-4479-b132-93b103c747f4,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e366f70-46') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_vif [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:15:56,bridge_name='br-int',has_traffic_filtering=True,id=0e366f70-4640-4479-b132-93b103c747f4,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e366f70-46') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e366f70-46, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f582baa-ff24-42aa-a6fc-a253df204c1c) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: INFO os_vif [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:15:56,bridge_name='br-int',has_traffic_filtering=True,id=0e366f70-4640-4479-b132-93b103c747f4,network=Network(a6689528-20f9-4310-a7b9-edd787583cde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e366f70-46')
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-225287415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-225287415',id=10,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFAE2muYctKQ5lA2KDuTvrad/Zh8vGOeEN7ZZ/jC2h1qv/x7tvIDFYvTC96h8AMspYnkoKKy6/U8CI0G+VpnDmPKl1G9/7zLdmaOLWoBHF3EF4jlJrYBSOMjPvuXiKwFg==',key_name='tempest-keypair-84908803',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:17:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d667cb9927d4d5b9a44139c04e035b2',ramdisk_id='',reservation_id='r-rofrtvr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-144853562',owner_user_name='tempest-TaggedBootDevicesTest_v242-144853562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6362afe7c4a4c67b9dca81a3cb21a06',uuid=67bb65da-d976-40da-9568-2c1e3930fb7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "address": "fa:16:3e:f2:77:1c", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d8dde0-24", "ovs_interfaceid": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converting VIF {"id": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "address": "fa:16:3e:f2:77:1c", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d8dde0-24", "ovs_interfaceid": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:77:1c,bridge_name='br-int',has_traffic_filtering=True,id=d3d8dde0-2448-43f6-a03f-f619b90cc56a,network=Network(364a210c-05af-4b9d-8a55-f703d7db277d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d8dde0-24') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_vif [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:77:1c,bridge_name='br-int',has_traffic_filtering=True,id=d3d8dde0-2448-43f6-a03f-f619b90cc56a,network=Network(364a210c-05af-4b9d-8a55-f703d7db277d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d8dde0-24') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3d8dde0-24, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd5d4b07-9066-4b20-9b57-00b50c090ae4) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: INFO os_vif [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:77:1c,bridge_name='br-int',has_traffic_filtering=True,id=d3d8dde0-2448-43f6-a03f-f619b90cc56a,network=Network(364a210c-05af-4b9d-8a55-f703d7db277d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d8dde0-24')
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-225287415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-225287415',id=10,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFAE2muYctKQ5lA2KDuTvrad/Zh8vGOeEN7ZZ/jC2h1qv/x7tvIDFYvTC96h8AMspYnkoKKy6/U8CI0G+VpnDmPKl1G9/7zLdmaOLWoBHF3EF4jlJrYBSOMjPvuXiKwFg==',key_name='tempest-keypair-84908803',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:17:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d667cb9927d4d5b9a44139c04e035b2',ramdisk_id='',reservation_id='r-rofrtvr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-144853562',owner_user_name='tempest-TaggedBootDevicesTest_v242-144853562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a6362afe7c4a4c67b9dca81a3cb21a06',uuid=67bb65da-d976-40da-9568-2c1e3930fb7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6190aa4-f199-434a-9953-88ca35f2b483", "address": "fa:16:3e:b8:a3:a0", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6190aa4-f1", "ovs_interfaceid": "b6190aa4-f199-434a-9953-88ca35f2b483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converting VIF {"id": "b6190aa4-f199-434a-9953-88ca35f2b483", "address": "fa:16:3e:b8:a3:a0", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6190aa4-f1", "ovs_interfaceid": "b6190aa4-f199-434a-9953-88ca35f2b483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a3:a0,bridge_name='br-int',has_traffic_filtering=True,id=b6190aa4-f199-434a-9953-88ca35f2b483,network=Network(364a210c-05af-4b9d-8a55-f703d7db277d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6190aa4-f1') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_vif [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a3:a0,bridge_name='br-int',has_traffic_filtering=True,id=b6190aa4-f199-434a-9953-88ca35f2b483,network=Network(364a210c-05af-4b9d-8a55-f703d7db277d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6190aa4-f1') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6190aa4-f1, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c423375b-79a2-4602-9951-c3a9a664ba06) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:14 user nova-compute[74776]: INFO os_vif [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:a3:a0,bridge_name='br-int',has_traffic_filtering=True,id=b6190aa4-f199-434a-9953-88ca35f2b483,network=Network(364a210c-05af-4b9d-8a55-f703d7db277d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6190aa4-f1')
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaGRgOnx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:19:14 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e45b89-eb0b-4263-931e-d95483d6c171]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:19:14 user nova-compute[74776]: No targets found.
Nov 22 14:19:14 user nova-compute[74776]: iSNS:
Nov 22 14:19:14 user nova-compute[74776]: No targets found.
Nov 22 14:19:14 user nova-compute[74776]: STATIC:
Nov 22 14:19:14 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618
Nov 22 14:19:14 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:14 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:14 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0
Nov 22 14:19:14 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:14 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:14 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900
Nov 22 14:19:14 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:14 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:14 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab
Nov 22 14:19:14 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:14 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:14 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047
Nov 22 14:19:14 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:14 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:14 user nova-compute[74776]: FIRMWARE:
Nov 22 14:19:14 user nova-compute[74776]: No targets found.
Nov 22 14:19:14 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:19:14 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:19:14 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[47af20f8-1e0b-4555-bc51-965ed2cab74c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf6351f-e1d8-4b3b-8d38-f92721546fd4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:19:14 user nova-compute[74776]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:19:14 user nova-compute[74776]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:19:14 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:19:14 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:19:14 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:19:14 user nova-compute[74776]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:19:14 user nova-compute[74776]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 (non-flash)
Nov 22 14:19:14 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:19:14 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:19:14 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c7820d120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900'): ({'sdb'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Removing single pathed devices sdb {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a20bb5-d4da-42ce-b4e2-c6d6dda1cdda]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c604f2-028a-47bc-948e-a44b9914780c]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Flushing IO for device /dev/sdb {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ae3692-d5cc-4326-b691-a22929071103]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[03edef14-7b69-43c8-8535-dfc415ea3f0a]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-bcd4003b-5edd-4555-8adf-1000402be73d req-e9f4689d-1c16-4865-ba4f-aab8cd06670b service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-plugged-116116d9-ff23-4e79-ac3c-c8744dd13158 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-bcd4003b-5edd-4555-8adf-1000402be73d req-e9f4689d-1c16-4865-ba4f-aab8cd06670b service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-bcd4003b-5edd-4555-8adf-1000402be73d req-e9f4689d-1c16-4865-ba4f-aab8cd06670b service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-bcd4003b-5edd-4555-8adf-1000402be73d req-e9f4689d-1c16-4865-ba4f-aab8cd06670b service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-bcd4003b-5edd-4555-8adf-1000402be73d req-e9f4689d-1c16-4865-ba4f-aab8cd06670b service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-plugged-116116d9-ff23-4e79-ac3c-c8744dd13158 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:14 user nova-compute[74776]: WARNING nova.compute.manager [req-bcd4003b-5edd-4555-8adf-1000402be73d req-e9f4689d-1c16-4865-ba4f-aab8cd06670b service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received unexpected event network-vif-plugged-116116d9-ff23-4e79-ac3c-c8744dd13158 for instance with vm_state active and task_state deleting.
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[690c7e42-a67b-4f0a-9c76-5f9644a362df]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[58907f6d-d6d9-4456-9e7e-aadfb36c0b90]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900, portal: 172.16.0.220,3260]
Nov 22 14:19:14 user nova-compute[74776]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900, portal: 172.16.0.220,3260] successful.
Nov 22 14:19:14 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-plugged-217aeb80-f22d-4b93-919a-af8856de5865 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-plugged-217aeb80-f22d-4b93-919a-af8856de5865 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:14 user nova-compute[74776]: WARNING nova.compute.manager [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received unexpected event network-vif-plugged-217aeb80-f22d-4b93-919a-af8856de5865 for instance with vm_state active and task_state deleting.
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-unplugged-0e366f70-4640-4479-b132-93b103c747f4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-unplugged-0e366f70-4640-4479-b132-93b103c747f4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-unplugged-0e366f70-4640-4479-b132-93b103c747f4 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-plugged-0e366f70-4640-4479-b132-93b103c747f4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-plugged-0e366f70-4640-4479-b132-93b103c747f4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:14 user nova-compute[74776]: WARNING nova.compute.manager [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received unexpected event network-vif-plugged-0e366f70-4640-4479-b132-93b103c747f4 for instance with vm_state active and task_state deleting.
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-unplugged-d3d8dde0-2448-43f6-a03f-f619b90cc56a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-unplugged-d3d8dde0-2448-43f6-a03f-f619b90cc56a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-unplugged-d3d8dde0-2448-43f6-a03f-f619b90cc56a for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-plugged-d3d8dde0-2448-43f6-a03f-f619b90cc56a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-plugged-d3d8dde0-2448-43f6-a03f-f619b90cc56a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:14 user nova-compute[74776]: WARNING nova.compute.manager [req-e78c9287-0ddc-4f93-8511-3bc28d4b7264 req-9cb3786f-54e3-4097-a123-fa998160bc1a service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received unexpected event network-vif-plugged-d3d8dde0-2448-43f6-a03f-f619b90cc56a for instance with vm_state active and task_state deleting.
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa29ed11-be21-4eae-9105-ff2d767a3900 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b709292e-f08f-4ce0-83d6-1755e5ed43da]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] <== disconnect_volume: return (323ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqHFlNCm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:19:14 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d0d810-719b-43bb-8a43-2e62fec117a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:19:14 user nova-compute[74776]: No targets found.
Nov 22 14:19:14 user nova-compute[74776]: iSNS:
Nov 22 14:19:14 user nova-compute[74776]: No targets found.
Nov 22 14:19:14 user nova-compute[74776]: STATIC:
Nov 22 14:19:14 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618
Nov 22 14:19:14 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:14 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:14 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0
Nov 22 14:19:14 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:14 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:14 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab
Nov 22 14:19:14 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:14 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:14 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047
Nov 22 14:19:14 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:14 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:14 user nova-compute[74776]: FIRMWARE:
Nov 22 14:19:14 user nova-compute[74776]: No targets found.
Nov 22 14:19:14 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:19:14 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:19:14 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[55144b09-2118-4fb7-a524-2bdbd31b55fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5607982c-f548-4150-9fee-0b32f842faf8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:19:14 user nova-compute[74776]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:19:14 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:19:14 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:19:14 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:19:14 user nova-compute[74776]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:19:14 user nova-compute[74776]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 (non-flash)
Nov 22 14:19:14 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:19:14 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c58250ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618'): ({'sdc'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Removing single pathed devices sdc {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8866fda-4802-4bc4-9d6f-b04990c4de79]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[879240ad-1a0c-486b-8b0e-9778893e7251]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Flushing IO for device /dev/sdc {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[92650d32-d052-4978-9007-b26424380b57]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:19:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe10b44-f5aa-4370-ab8c-caddde5d025d]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5897772-42ed-4822-9f33-cdd1c833ce27]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a0b397-33d2-4de6-be91-ebbf8092de3b]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618, portal: 172.16.0.220,3260]
Nov 22 14:19:15 user nova-compute[74776]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618, portal: 172.16.0.220,3260] successful.
Nov 22 14:19:15 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10ff42dd-0151-4e1c-9ec4-c36af0f80618 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecff8f1-2adf-4403-b10c-c381a93e4c28]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] <== disconnect_volume: return (314ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrMqpECs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:19:15 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6027e55d-459c-409b-a0b5-e17bec1a55bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:19:15 user nova-compute[74776]: No targets found.
Nov 22 14:19:15 user nova-compute[74776]: iSNS:
Nov 22 14:19:15 user nova-compute[74776]: No targets found.
Nov 22 14:19:15 user nova-compute[74776]: STATIC:
Nov 22 14:19:15 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0
Nov 22 14:19:15 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:15 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:15 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab
Nov 22 14:19:15 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:15 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:15 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047
Nov 22 14:19:15 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:15 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:15 user nova-compute[74776]: FIRMWARE:
Nov 22 14:19:15 user nova-compute[74776]: No targets found.
Nov 22 14:19:15 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:19:15 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:19:15 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[418f434a-b65e-4eb8-be40-0d16dbbbb68c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d33a96b-5bbd-4a94-bfae-f6a046e0ee98]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:19:15 user nova-compute[74776]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:19:15 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:19:15 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:19:15 user nova-compute[74776]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:19:15 user nova-compute[74776]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab (non-flash)
Nov 22 14:19:15 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c58251fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab'): ({'sdd'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Removing single pathed devices sdd {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8400ff-6d44-4e7e-8b44-59545e3d431b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e87992-2f9e-444d-b40a-14a7556e1562]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Flushing IO for device /dev/sdd {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f746b561-3702-44e8-b4d6-ede8a9830324]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0180fd-04dd-4e72-936f-78e24bc0570e]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] SCSI volumes sdd have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG nova.compute.manager [req-3a90d337-13c8-48bb-898d-f98aa33de0e1 req-3bccb39b-00f2-49b1-9914-f1ae3f90a485 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-unplugged-b6190aa4-f199-434a-9953-88ca35f2b483 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3a90d337-13c8-48bb-898d-f98aa33de0e1 req-3bccb39b-00f2-49b1-9914-f1ae3f90a485 service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3a90d337-13c8-48bb-898d-f98aa33de0e1 req-3bccb39b-00f2-49b1-9914-f1ae3f90a485 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3a90d337-13c8-48bb-898d-f98aa33de0e1 req-3bccb39b-00f2-49b1-9914-f1ae3f90a485 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG nova.compute.manager [req-3a90d337-13c8-48bb-898d-f98aa33de0e1 req-3bccb39b-00f2-49b1-9914-f1ae3f90a485 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-unplugged-b6190aa4-f199-434a-9953-88ca35f2b483 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG nova.compute.manager [req-3a90d337-13c8-48bb-898d-f98aa33de0e1 req-3bccb39b-00f2-49b1-9914-f1ae3f90a485 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-unplugged-b6190aa4-f199-434a-9953-88ca35f2b483 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG nova.compute.manager [req-3a90d337-13c8-48bb-898d-f98aa33de0e1 req-3bccb39b-00f2-49b1-9914-f1ae3f90a485 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-plugged-b6190aa4-f199-434a-9953-88ca35f2b483 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3a90d337-13c8-48bb-898d-f98aa33de0e1 req-3bccb39b-00f2-49b1-9914-f1ae3f90a485 service nova] Acquiring lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3a90d337-13c8-48bb-898d-f98aa33de0e1 req-3bccb39b-00f2-49b1-9914-f1ae3f90a485 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3a90d337-13c8-48bb-898d-f98aa33de0e1 req-3bccb39b-00f2-49b1-9914-f1ae3f90a485 service nova] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG nova.compute.manager [req-3a90d337-13c8-48bb-898d-f98aa33de0e1 req-3bccb39b-00f2-49b1-9914-f1ae3f90a485 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] No waiting events found dispatching network-vif-plugged-b6190aa4-f199-434a-9953-88ca35f2b483 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:15 user nova-compute[74776]: WARNING nova.compute.manager [req-3a90d337-13c8-48bb-898d-f98aa33de0e1 req-3bccb39b-00f2-49b1-9914-f1ae3f90a485 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received unexpected event network-vif-plugged-b6190aa4-f199-434a-9953-88ca35f2b483 for instance with vm_state active and task_state deleting.
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a888c8-3cf2-4194-8919-c7ff3a16947d]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.107s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4e7f78-9800-4248-9410-1bf24381e50e]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab, portal: 172.16.0.220,3260]
Nov 22 14:19:15 user nova-compute[74776]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab, portal: 172.16.0.220,3260] successful.
Nov 22 14:19:15 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6ae6271-8e40-4f31-af64-c86afa4cf2ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cdb4e4-da01-412d-ad36-a334bb0dc0a7]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] <== disconnect_volume: return (348ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:19:15 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Deleting instance files /opt/stack/data/nova/instances/67bb65da-d976-40da-9568-2c1e3930fb7f_del
Nov 22 14:19:15 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Deletion of /opt/stack/data/nova/instances/67bb65da-d976-40da-9568-2c1e3930fb7f_del complete
Nov 22 14:19:15 user nova-compute[74776]: INFO nova.compute.manager [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Took 3.57 seconds to destroy the instance on the hypervisor.
Nov 22 14:19:15 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:19:15 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DstQFecd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:19:17 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:19:17 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:19:17 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfac779c-2f78-4e64-9604-8aa720d625f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:19:17 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6615c929-f564-4367-a2d3-07d505c91708]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866] added
Nov 22 14:19:17 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[660ea972-871d-4da7-8d64-912711a90f00]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a188f405-e762-4839-bf7b-e2d1bd2f0672]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DstQFecd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DstQFecd" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad61506a-1736-48e1-ac81-c693f5152ca1]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DstQFecd'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a2549a-1c1e-49e3-9749-496d54d7a3b2]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[516ac868-ede8-4acd-afbb-c50e6af318d5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:19:17 user nova-compute[74776]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:19:17 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:19:17 user nova-compute[74776]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:19:17 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdbb1ec-0b11-4f8e-90c0-f3cdc5541894]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866, portal: 172.16.0.220,3260]
Nov 22 14:19:17 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866, portal: 172.16.0.220,3260] successful.
Nov 22 14:19:17 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d76f75-f85f-4c0e-9661-0d70253e61fa]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec7edec-06c2-4e8d-bd96-d6c51ccecf77]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:19:17 user nova-compute[74776]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:19:17 user nova-compute[74776]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 (non-flash)
Nov 22 14:19:17 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:19:17 user nova-compute[74776]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:19:17 user nova-compute[74776]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 (non-flash)
Nov 22 14:19:17 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.034s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c276d7-dec3-4d00-94a0-dfbfe88624e6]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:19:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DstQFecd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:19:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:18 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:19:18 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23039666439373837', 'path': '/dev/sdb'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:19:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039666439373837', 'path': '/dev/sdb'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:19:18 user nova-compute[74776]: DEBUG nova.objects.instance [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lazy-loading 'flavor' on Instance uuid 42b00137-df98-47d9-9d02-29b4707fed30 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:19:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:19:18 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:19:18 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 14:19:18 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:19:18 user nova-compute[74776]:   <serial>99d7c30a-946e-42e1-b105-fac14a5bd866</serial>
Nov 22 14:19:18 user nova-compute[74776]: </disk>
Nov 22 14:19:18 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:19:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-a6bca9f0-f65d-41b2-8d85-eeafe8f09afd req-a499b138-e84a-471c-87b6-eaf633862172 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-deleted-b494f667-97c7-4e1e-94c8-9072d1b85d33 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:18 user nova-compute[74776]: INFO nova.compute.manager [req-a6bca9f0-f65d-41b2-8d85-eeafe8f09afd req-a499b138-e84a-471c-87b6-eaf633862172 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Neutron deleted interface b494f667-97c7-4e1e-94c8-9072d1b85d33; detaching it from the instance and deleting it from the info cache
Nov 22 14:19:18 user nova-compute[74776]: DEBUG nova.network.neutron [req-a6bca9f0-f65d-41b2-8d85-eeafe8f09afd req-a499b138-e84a-471c-87b6-eaf633862172 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Updating instance_info_cache with network_info: [{"id": "67c21334-fae7-424e-8612-ae7727f6c999", "address": "fa:16:3e:76:a6:88", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67c21334-fa", "ovs_interfaceid": "67c21334-fae7-424e-8612-ae7727f6c999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "116116d9-ff23-4e79-ac3c-c8744dd13158", "address": "fa:16:3e:73:5e:dc", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap116116d9-ff", "ovs_interfaceid": "116116d9-ff23-4e79-ac3c-c8744dd13158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "217aeb80-f22d-4b93-919a-af8856de5865", "address": "fa:16:3e:89:09:5e", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217aeb80-f2", "ovs_interfaceid": "217aeb80-f22d-4b93-919a-af8856de5865", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0e366f70-4640-4479-b132-93b103c747f4", "address": "fa:16:3e:f7:15:56", "network": {"id": "a6689528-20f9-4310-a7b9-edd787583cde", "bridge": "br-int", "label": "tempest-device-tagging-net1-1116234464", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e366f70-46", "ovs_interfaceid": "0e366f70-4640-4479-b132-93b103c747f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "address": "fa:16:3e:f2:77:1c", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d8dde0-24", "ovs_interfaceid": "d3d8dde0-2448-43f6-a03f-f619b90cc56a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6190aa4-f199-434a-9953-88ca35f2b483", "address": "fa:16:3e:b8:a3:a0", "network": {"id": "364a210c-05af-4b9d-8a55-f703d7db277d", "bridge": "br-int", "label": "tempest-device-tagging-net2-88914185", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d667cb9927d4d5b9a44139c04e035b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6190aa4-f1", "ovs_interfaceid": "b6190aa4-f199-434a-9953-88ca35f2b483", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:19:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-a6bca9f0-f65d-41b2-8d85-eeafe8f09afd req-a499b138-e84a-471c-87b6-eaf633862172 service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Detach interface failed, port_id=b494f667-97c7-4e1e-94c8-9072d1b85d33, reason: Instance 67bb65da-d976-40da-9568-2c1e3930fb7f could not be found. {{(pid=74776) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] No VIF found with MAC fa:16:3e:03:d6:8f, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42832bf1-f187-4747-b9e0-41bf2ebe22c7 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "42b00137-df98-47d9-9d02-29b4707fed30" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.724s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:19 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fb5def2c-c757-4a3c-a832-142bf8c61413 is timed out.
Nov 22 14:19:19 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Successfully detached device vdb from instance fb5def2c-c757-4a3c-a832-142bf8c61413 from the live domain config.
Nov 22 14:19:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WyeRqbkn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:19:19 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:19:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[71003d7f-327f-4d6a-8446-0ae05a227bd6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:19:19 user nova-compute[74776]: No targets found.
Nov 22 14:19:19 user nova-compute[74776]: iSNS:
Nov 22 14:19:19 user nova-compute[74776]: No targets found.
Nov 22 14:19:19 user nova-compute[74776]: STATIC:
Nov 22 14:19:19 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0
Nov 22 14:19:19 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:19 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:19 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866
Nov 22 14:19:19 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:19 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:19 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047
Nov 22 14:19:19 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:19 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:19 user nova-compute[74776]: FIRMWARE:
Nov 22 14:19:19 user nova-compute[74776]: No targets found.
Nov 22 14:19:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:19:19 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:19:19 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f284664b-0ea9-4a4f-a0ed-c625027e9bdd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6144adad-f9c5-4d2d-a626-f92923f260b7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:19:19 user nova-compute[74776]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:19:19 user nova-compute[74776]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 (non-flash)
Nov 22 14:19:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 (non-flash)
Nov 22 14:19:19 user nova-compute[74776]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:19:19 user nova-compute[74776]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 (non-flash)
Nov 22 14:19:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c581fed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0'): ({'sdf'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Removing single pathed devices sdf {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.039s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eadfd6-2116-4078-96c4-6b6d8230d7a7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd38782-3dbf-4eec-ac32-479ead6cb6c4]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Flushing IO for device /dev/sdf {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94aeae2-e5e5-419d-a473-09b8f17fa79b]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:19 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:19:19 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Took 4.37 seconds to deallocate network for instance.
Nov 22 14:19:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3288cbe2-1475-44f8-b838-276859658dc1]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] SCSI volumes sdf have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe65073b-0829-4478-bb68-de93ce9bcc04]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e52b1b4-6d9e-417c-a080-a9b80245ad6f]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0, portal: 172.16.0.220,3260]
Nov 22 14:19:20 user nova-compute[74776]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0, portal: 172.16.0.220,3260] successful.
Nov 22 14:19:20 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618eee02-93fc-4b6e-a7db-cfdadd664ea0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a345ac-69cd-459d-a275-51406737ed27]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] <== disconnect_volume: return (355ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-adc63e2a-a076-49c6-b73e-a926be0c9858 req-2906db32-b3a5-4205-a243-154a95ad02bf service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-deleted-217aeb80-f22d-4b93-919a-af8856de5865 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-adc63e2a-a076-49c6-b73e-a926be0c9858 req-2906db32-b3a5-4205-a243-154a95ad02bf service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-deleted-d3d8dde0-2448-43f6-a03f-f619b90cc56a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-adc63e2a-a076-49c6-b73e-a926be0c9858 req-2906db32-b3a5-4205-a243-154a95ad02bf service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-deleted-0e366f70-4640-4479-b132-93b103c747f4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-adc63e2a-a076-49c6-b73e-a926be0c9858 req-2906db32-b3a5-4205-a243-154a95ad02bf service nova] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Received event network-vif-deleted-b6190aa4-f199-434a-9953-88ca35f2b483 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:21 user nova-compute[74776]: DEBUG nova.objects.instance [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Lazy-loading 'flavor' on Instance uuid fb5def2c-c757-4a3c-a832-142bf8c61413 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:19:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-92b1fc5b-03b1-4602-b041-4fc5217203dc tempest-VolumesAssistedSnapshotsTest-308247882 tempest-VolumesAssistedSnapshotsTest-308247882-project-admin] Lock "fb5def2c-c757-4a3c-a832-142bf8c61413" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.982s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "42b00137-df98-47d9-9d02-29b4707fed30" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "42b00137-df98-47d9-9d02-29b4707fed30" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:21 user nova-compute[74776]: INFO nova.compute.manager [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Detaching volume 99d7c30a-946e-42e1-b105-fac14a5bd866
Nov 22 14:19:21 user nova-compute[74776]: INFO nova.virt.block_device [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Attempting to driver detach volume 99d7c30a-946e-42e1-b105-fac14a5bd866 from mountpoint /dev/vdb
Nov 22 14:19:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Attempting to detach device vdb from instance 42b00137-df98-47d9-9d02-29b4707fed30 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:19:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:19:21 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:19:21 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 14:19:21 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:19:21 user nova-compute[74776]:   <serial>99d7c30a-946e-42e1-b105-fac14a5bd866</serial>
Nov 22 14:19:21 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:19:21 user nova-compute[74776]: </disk>
Nov 22 14:19:21 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:19:21 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Successfully detached device vdb from instance 42b00137-df98-47d9-9d02-29b4707fed30 from the persistent domain config.
Nov 22 14:19:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 42b00137-df98-47d9-9d02-29b4707fed30 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:19:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:19:21 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:19:21 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 14:19:21 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:19:21 user nova-compute[74776]:   <serial>99d7c30a-946e-42e1-b105-fac14a5bd866</serial>
Nov 22 14:19:21 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:19:21 user nova-compute[74776]: </disk>
Nov 22 14:19:21 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:19:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 42b00137-df98-47d9-9d02-29b4707fed30 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:19:22 user nova-compute[74776]: INFO nova.compute.manager [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] [instance: 67bb65da-d976-40da-9568-2c1e3930fb7f] Took 2.41 seconds to detach 3 volumes for instance.
Nov 22 14:19:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:22 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:19:22 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:19:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:22 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Deleted allocations for instance 67bb65da-d976-40da-9568-2c1e3930fb7f
Nov 22 14:19:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc19f7ef-80dd-47cb-976a-7a83c9e30ef3 tempest-TaggedBootDevicesTest_v242-144853562 tempest-TaggedBootDevicesTest_v242-144853562-project-member] Lock "67bb65da-d976-40da-9568-2c1e3930fb7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.854s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "913e1c5b-59ec-4d26-831e-dee562748839" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "913e1c5b-59ec-4d26-831e-dee562748839" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:32 user nova-compute[74776]: DEBUG nova.compute.manager [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:19:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:32 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:19:32 user nova-compute[74776]: INFO nova.compute.claims [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Claim successful on node user
Nov 22 14:19:32 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:19:32 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:19:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:32 user nova-compute[74776]: DEBUG nova.compute.manager [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:19:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:19:33 user nova-compute[74776]: DEBUG nova.network.neutron [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:19:33 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:19:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:19:33 user nova-compute[74776]: DEBUG nova.policy [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d30d915576746b0a9f38789a2e74f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84f31ee687a47558c74cf007bd17175', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:19:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:19:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:19:33 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Creating image(s)
Nov 22 14:19:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "/opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "/opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "/opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.179s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.197s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:33 user nova-compute[74776]: DEBUG nova.network.neutron [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Successfully created port: 12ea19bb-0c98-4450-acb2-5acf20af9e66 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:19:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839/disk 1073741824" returned: 0 in 0.053s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:33 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Checking if we can resize image /opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:19:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Cannot resize image /opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Ensure instance console log exists: /opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.network.neutron [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Successfully updated port: 12ea19bb-0c98-4450-acb2-5acf20af9e66 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "refresh_cache-913e1c5b-59ec-4d26-831e-dee562748839" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquired lock "refresh_cache-913e1c5b-59ec-4d26-831e-dee562748839" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.network.neutron [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.compute.manager [req-9177043d-77d8-4259-a469-372a751eceea req-c86df064-e8d3-443c-ac1d-eb731c7e90f7 service nova] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Received event network-changed-12ea19bb-0c98-4450-acb2-5acf20af9e66 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.compute.manager [req-9177043d-77d8-4259-a469-372a751eceea req-c86df064-e8d3-443c-ac1d-eb731c7e90f7 service nova] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Refreshing instance network info cache due to event network-changed-12ea19bb-0c98-4450-acb2-5acf20af9e66. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9177043d-77d8-4259-a469-372a751eceea req-c86df064-e8d3-443c-ac1d-eb731c7e90f7 service nova] Acquiring lock "refresh_cache-913e1c5b-59ec-4d26-831e-dee562748839" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.network.neutron [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:19:34 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 62461965-8bbb-4497-81e7-d9237832f190 is timed out.
Nov 22 14:19:34 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Successfully detached device vdb from instance 62461965-8bbb-4497-81e7-d9237832f190 from the live domain config.
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTmjRwyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '744a160c-44d1-41e8-a877-de71e5b9b047'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:19:34 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:19:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[786240dd-4abb-4d0f-ac0a-8b7a5dce4ed2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:19:34 user nova-compute[74776]: No targets found.
Nov 22 14:19:34 user nova-compute[74776]: iSNS:
Nov 22 14:19:34 user nova-compute[74776]: No targets found.
Nov 22 14:19:34 user nova-compute[74776]: STATIC:
Nov 22 14:19:34 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866
Nov 22 14:19:34 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:34 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:34 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047
Nov 22 14:19:34 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:34 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:34 user nova-compute[74776]: FIRMWARE:
Nov 22 14:19:34 user nova-compute[74776]: No targets found.
Nov 22 14:19:34 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:19:34 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:19:34 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b958455a-bbde-49bc-b4a2-531c0fe75469]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69286a8-986a-452a-8fda-463beb42373a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:19:34 user nova-compute[74776]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 (non-flash)
Nov 22 14:19:34 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 (non-flash)
Nov 22 14:19:34 user nova-compute[74776]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 (non-flash)
Nov 22 14:19:34 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c7820c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047'): ({'sde'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Removing single pathed devices sde {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.network.neutron [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Updating instance_info_cache with network_info: [{"id": "12ea19bb-0c98-4450-acb2-5acf20af9e66", "address": "fa:16:3e:8d:5e:0a", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ea19bb-0c", "ovs_interfaceid": "12ea19bb-0c98-4450-acb2-5acf20af9e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.065s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[659c1eac-1002-4c03-b048-9b59cf4b520e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Releasing lock "refresh_cache-913e1c5b-59ec-4d26-831e-dee562748839" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.compute.manager [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Instance network_info: |[{"id": "12ea19bb-0c98-4450-acb2-5acf20af9e66", "address": "fa:16:3e:8d:5e:0a", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ea19bb-0c", "ovs_interfaceid": "12ea19bb-0c98-4450-acb2-5acf20af9e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9177043d-77d8-4259-a469-372a751eceea req-c86df064-e8d3-443c-ac1d-eb731c7e90f7 service nova] Acquired lock "refresh_cache-913e1c5b-59ec-4d26-831e-dee562748839" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.network.neutron [req-9177043d-77d8-4259-a469-372a751eceea req-c86df064-e8d3-443c-ac1d-eb731c7e90f7 service nova] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Refreshing network info cache for port 12ea19bb-0c98-4450-acb2-5acf20af9e66 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Start _get_guest_xml network_info=[{"id": "12ea19bb-0c98-4450-acb2-5acf20af9e66", "address": "fa:16:3e:8d:5e:0a", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ea19bb-0c", "ovs_interfaceid": "12ea19bb-0c98-4450-acb2-5acf20af9e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:19:34 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:19:34 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ff7d65-033f-4435-b072-d0f50546de3e]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Flushing IO for device /dev/sde {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:19:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1646307772',display_name='tempest-VolumesAdminNegativeTest-server-1646307772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1646307772',id=11,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e84f31ee687a47558c74cf007bd17175',ramdisk_id='',reservation_id='r-82ukf107',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1815512001',owner_user_name='tempest-VolumesAdminNegativeTest-1815512001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:19:33Z,user_data=None,user_id='3d30d915576746b0a9f38789a2e74f03',uuid=913e1c5b-59ec-4d26-831e-dee562748839,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12ea19bb-0c98-4450-acb2-5acf20af9e66", "address": "fa:16:3e:8d:5e:0a", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ea19bb-0c", "ovs_interfaceid": "12ea19bb-0c98-4450-acb2-5acf20af9e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Converting VIF {"id": "12ea19bb-0c98-4450-acb2-5acf20af9e66", "address": "fa:16:3e:8d:5e:0a", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ea19bb-0c", "ovs_interfaceid": "12ea19bb-0c98-4450-acb2-5acf20af9e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:5e:0a,bridge_name='br-int',has_traffic_filtering=True,id=12ea19bb-0c98-4450-acb2-5acf20af9e66,network=Network(59cbde16-cdcd-4761-9c50-b31b4f2387b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ea19bb-0c') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.objects.instance [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lazy-loading 'pci_devices' on Instance uuid 913e1c5b-59ec-4d26-831e-dee562748839 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b699493-9802-470b-bcd6-91dcce5342cc]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:19:34 user nova-compute[74776]:   <uuid>913e1c5b-59ec-4d26-831e-dee562748839</uuid>
Nov 22 14:19:34 user nova-compute[74776]:   <name>instance-0000000b</name>
Nov 22 14:19:34 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:19:34 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:19:34 user nova-compute[74776]:   <metadata>
Nov 22 14:19:34 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:19:34 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:19:34 user nova-compute[74776]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1646307772</nova:name>
Nov 22 14:19:34 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:19:34</nova:creationTime>
Nov 22 14:19:34 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:19:34 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:19:34 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:19:34 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:19:34 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:19:34 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:19:34 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:19:34 user nova-compute[74776]:       <nova:owner>
Nov 22 14:19:34 user nova-compute[74776]:         <nova:user uuid="3d30d915576746b0a9f38789a2e74f03">tempest-VolumesAdminNegativeTest-1815512001-project-member</nova:user>
Nov 22 14:19:34 user nova-compute[74776]:         <nova:project uuid="e84f31ee687a47558c74cf007bd17175">tempest-VolumesAdminNegativeTest-1815512001</nova:project>
Nov 22 14:19:34 user nova-compute[74776]:       </nova:owner>
Nov 22 14:19:34 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:19:34 user nova-compute[74776]:       <nova:ports>
Nov 22 14:19:34 user nova-compute[74776]:         <nova:port uuid="12ea19bb-0c98-4450-acb2-5acf20af9e66">
Nov 22 14:19:34 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 22 14:19:34 user nova-compute[74776]:         </nova:port>
Nov 22 14:19:34 user nova-compute[74776]:       </nova:ports>
Nov 22 14:19:34 user nova-compute[74776]:     </nova:instance>
Nov 22 14:19:34 user nova-compute[74776]:   </metadata>
Nov 22 14:19:34 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:19:34 user nova-compute[74776]:     <system>
Nov 22 14:19:34 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:19:34 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:19:34 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:19:34 user nova-compute[74776]:       <entry name="serial">913e1c5b-59ec-4d26-831e-dee562748839</entry>
Nov 22 14:19:34 user nova-compute[74776]:       <entry name="uuid">913e1c5b-59ec-4d26-831e-dee562748839</entry>
Nov 22 14:19:34 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:19:34 user nova-compute[74776]:     </system>
Nov 22 14:19:34 user nova-compute[74776]:   </sysinfo>
Nov 22 14:19:34 user nova-compute[74776]:   <os>
Nov 22 14:19:34 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:19:34 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:19:34 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:19:34 user nova-compute[74776]:   </os>
Nov 22 14:19:34 user nova-compute[74776]:   <features>
Nov 22 14:19:34 user nova-compute[74776]:     <acpi/>
Nov 22 14:19:34 user nova-compute[74776]:     <apic/>
Nov 22 14:19:34 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:19:34 user nova-compute[74776]:   </features>
Nov 22 14:19:34 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:19:34 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:19:34 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:19:34 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:19:34 user nova-compute[74776]:   </clock>
Nov 22 14:19:34 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:19:34 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:19:34 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:19:34 user nova-compute[74776]:   </cpu>
Nov 22 14:19:34 user nova-compute[74776]:   <devices>
Nov 22 14:19:34 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:19:34 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:19:34 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839/disk"/>
Nov 22 14:19:34 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:19:34 user nova-compute[74776]:     </disk>
Nov 22 14:19:34 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:19:34 user nova-compute[74776]:       <mac address="fa:16:3e:8d:5e:0a"/>
Nov 22 14:19:34 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:19:34 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:19:34 user nova-compute[74776]:       <target dev="tap12ea19bb-0c"/>
Nov 22 14:19:34 user nova-compute[74776]:     </interface>
Nov 22 14:19:34 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:19:34 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839/console.log" append="off"/>
Nov 22 14:19:34 user nova-compute[74776]:     </serial>
Nov 22 14:19:34 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:19:34 user nova-compute[74776]:     <video>
Nov 22 14:19:34 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:19:34 user nova-compute[74776]:     </video>
Nov 22 14:19:34 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:19:34 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:19:34 user nova-compute[74776]:     </rng>
Nov 22 14:19:34 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:19:34 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:19:34 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:19:34 user nova-compute[74776]:     </memballoon>
Nov 22 14:19:34 user nova-compute[74776]:   </devices>
Nov 22 14:19:34 user nova-compute[74776]: </domain>
Nov 22 14:19:34 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:19:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1646307772',display_name='tempest-VolumesAdminNegativeTest-server-1646307772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1646307772',id=11,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e84f31ee687a47558c74cf007bd17175',ramdisk_id='',reservation_id='r-82ukf107',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1815512001',owner_user_name='tempest-VolumesAdminNegativeTest-1815512001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:19:33Z,user_data=None,user_id='3d30d915576746b0a9f38789a2e74f03',uuid=913e1c5b-59ec-4d26-831e-dee562748839,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12ea19bb-0c98-4450-acb2-5acf20af9e66", "address": "fa:16:3e:8d:5e:0a", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ea19bb-0c", "ovs_interfaceid": "12ea19bb-0c98-4450-acb2-5acf20af9e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Converting VIF {"id": "12ea19bb-0c98-4450-acb2-5acf20af9e66", "address": "fa:16:3e:8d:5e:0a", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ea19bb-0c", "ovs_interfaceid": "12ea19bb-0c98-4450-acb2-5acf20af9e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:5e:0a,bridge_name='br-int',has_traffic_filtering=True,id=12ea19bb-0c98-4450-acb2-5acf20af9e66,network=Network(59cbde16-cdcd-4761-9c50-b31b4f2387b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ea19bb-0c') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG os_vif [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:5e:0a,bridge_name='br-int',has_traffic_filtering=True,id=12ea19bb-0c98-4450-acb2-5acf20af9e66,network=Network(59cbde16-cdcd-4761-9c50-b31b4f2387b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ea19bb-0c') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48e6850e-8b5c-5a7c-bb5f-7e5194663822', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12ea19bb-0c, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap12ea19bb-0c, col_values=(('qos', UUID('94f7942a-782b-4428-a92e-42b8eb60d1cd')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap12ea19bb-0c, col_values=(('external_ids', {'iface-id': '12ea19bb-0c98-4450-acb2-5acf20af9e66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:5e:0a', 'vm-uuid': '913e1c5b-59ec-4d26-831e-dee562748839'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:34 user nova-compute[74776]: INFO os_vif [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:5e:0a,bridge_name='br-int',has_traffic_filtering=True,id=12ea19bb-0c98-4450-acb2-5acf20af9e66,network=Network(59cbde16-cdcd-4761-9c50-b31b4f2387b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ea19bb-0c')
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01dd9b1-ed86-4b3a-ac95-267adab6f30d]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] SCSI volumes sde have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf6cc6c-b392-4536-94cf-dcc35e31ea64]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] No VIF found with MAC fa:16:3e:8d:5e:0a, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[689f3e1f-ec30-4997-8c84-ae365bf55f57]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047, portal: 172.16.0.220,3260]
Nov 22 14:19:34 user nova-compute[74776]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047, portal: 172.16.0.220,3260] successful.
Nov 22 14:19:34 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:744a160c-44d1-41e8-a877-de71e5b9b047 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9a7b95-4111-4b3d-83db-6fd92e9d3602]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] <== disconnect_volume: return (375ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.network.neutron [req-9177043d-77d8-4259-a469-372a751eceea req-c86df064-e8d3-443c-ac1d-eb731c7e90f7 service nova] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Updated VIF entry in instance network info cache for port 12ea19bb-0c98-4450-acb2-5acf20af9e66. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG nova.network.neutron [req-9177043d-77d8-4259-a469-372a751eceea req-c86df064-e8d3-443c-ac1d-eb731c7e90f7 service nova] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Updating instance_info_cache with network_info: [{"id": "12ea19bb-0c98-4450-acb2-5acf20af9e66", "address": "fa:16:3e:8d:5e:0a", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ea19bb-0c", "ovs_interfaceid": "12ea19bb-0c98-4450-acb2-5acf20af9e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:19:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9177043d-77d8-4259-a469-372a751eceea req-c86df064-e8d3-443c-ac1d-eb731c7e90f7 service nova] Releasing lock "refresh_cache-913e1c5b-59ec-4d26-831e-dee562748839" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:19:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:35 user nova-compute[74776]: DEBUG nova.objects.instance [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lazy-loading 'flavor' on Instance uuid 62461965-8bbb-4497-81e7-d9237832f190 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:19:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-203a5411-69dd-4137-8903-60340ae91e70 tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "62461965-8bbb-4497-81e7-d9237832f190" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.915s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:36 user nova-compute[74776]: DEBUG nova.compute.manager [req-9c328c6d-d6da-499b-af13-c9fd091cd1bb req-f5a8afa5-cf71-4b81-b23c-e29c2f9ace38 service nova] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Received event network-vif-plugged-12ea19bb-0c98-4450-acb2-5acf20af9e66 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9c328c6d-d6da-499b-af13-c9fd091cd1bb req-f5a8afa5-cf71-4b81-b23c-e29c2f9ace38 service nova] Acquiring lock "913e1c5b-59ec-4d26-831e-dee562748839-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9c328c6d-d6da-499b-af13-c9fd091cd1bb req-f5a8afa5-cf71-4b81-b23c-e29c2f9ace38 service nova] Lock "913e1c5b-59ec-4d26-831e-dee562748839-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9c328c6d-d6da-499b-af13-c9fd091cd1bb req-f5a8afa5-cf71-4b81-b23c-e29c2f9ace38 service nova] Lock "913e1c5b-59ec-4d26-831e-dee562748839-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:36 user nova-compute[74776]: DEBUG nova.compute.manager [req-9c328c6d-d6da-499b-af13-c9fd091cd1bb req-f5a8afa5-cf71-4b81-b23c-e29c2f9ace38 service nova] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] No waiting events found dispatching network-vif-plugged-12ea19bb-0c98-4450-acb2-5acf20af9e66 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:36 user nova-compute[74776]: WARNING nova.compute.manager [req-9c328c6d-d6da-499b-af13-c9fd091cd1bb req-f5a8afa5-cf71-4b81-b23c-e29c2f9ace38 service nova] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Received unexpected event network-vif-plugged-12ea19bb-0c98-4450-acb2-5acf20af9e66 for instance with vm_state building and task_state spawning.
Nov 22 14:19:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquiring lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:37 user nova-compute[74776]: DEBUG nova.compute.manager [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:19:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:37 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:19:37 user nova-compute[74776]: INFO nova.compute.claims [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Claim successful on node user
Nov 22 14:19:37 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:19:37 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:19:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:37 user nova-compute[74776]: DEBUG nova.compute.manager [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:19:37 user nova-compute[74776]: DEBUG nova.compute.manager [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:19:37 user nova-compute[74776]: DEBUG nova.network.neutron [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:19:37 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:19:37 user nova-compute[74776]: DEBUG nova.compute.manager [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:19:37 user nova-compute[74776]: DEBUG nova.policy [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d173b822df3448bb49245f30afc0e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027310982a0047d9a0d06c29b5b6e1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG nova.compute.manager [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:19:38 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Creating image(s)
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquiring lock "/opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "/opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "/opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG nova.compute.manager [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:19:38 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Instance spawned successfully.
Nov 22 14:19:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.207s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG nova.compute.manager [req-6495ff7e-6c70-4b91-ae16-afc92660dec5 req-b36396e2-eb64-489c-a3eb-4881cd8a4710 service nova] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Received event network-vif-plugged-12ea19bb-0c98-4450-acb2-5acf20af9e66 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6495ff7e-6c70-4b91-ae16-afc92660dec5 req-b36396e2-eb64-489c-a3eb-4881cd8a4710 service nova] Acquiring lock "913e1c5b-59ec-4d26-831e-dee562748839-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6495ff7e-6c70-4b91-ae16-afc92660dec5 req-b36396e2-eb64-489c-a3eb-4881cd8a4710 service nova] Lock "913e1c5b-59ec-4d26-831e-dee562748839-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6495ff7e-6c70-4b91-ae16-afc92660dec5 req-b36396e2-eb64-489c-a3eb-4881cd8a4710 service nova] Lock "913e1c5b-59ec-4d26-831e-dee562748839-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG nova.compute.manager [req-6495ff7e-6c70-4b91-ae16-afc92660dec5 req-b36396e2-eb64-489c-a3eb-4881cd8a4710 service nova] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] No waiting events found dispatching network-vif-plugged-12ea19bb-0c98-4450-acb2-5acf20af9e66 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:38 user nova-compute[74776]: WARNING nova.compute.manager [req-6495ff7e-6c70-4b91-ae16-afc92660dec5 req-b36396e2-eb64-489c-a3eb-4881cd8a4710 service nova] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Received unexpected event network-vif-plugged-12ea19bb-0c98-4450-acb2-5acf20af9e66 for instance with vm_state building and task_state spawning.
Nov 22 14:19:38 user nova-compute[74776]: INFO nova.compute.manager [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 22 14:19:38 user nova-compute[74776]: DEBUG nova.compute.manager [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:19:38 user nova-compute[74776]: INFO nova.compute.manager [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Took 5.80 seconds to build instance.
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-78b630de-11bf-4783-ba1f-6a98ae321a3f tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "913e1c5b-59ec-4d26-831e-dee562748839" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.929s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk 1073741824" returned: 0 in 0.069s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG nova.network.neutron [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Successfully created port: d13f9065-d7f3-4274-929f-3ac85db8bf73 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.188s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Cannot resize image /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Ensure instance console log exists: /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.network.neutron [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Successfully updated port: d13f9065-d7f3-4274-929f-3ac85db8bf73 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquiring lock "refresh_cache-6dcf355f-759d-4a9a-9fb6-394e242c03e4" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquired lock "refresh_cache-6dcf355f-759d-4a9a-9fb6-394e242c03e4" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.network.neutron [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-33c54b37-fe38-4382-8460-707bd2acf49f req-bd6bf31e-2051-48e2-9ee8-c1fc38c201ff service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Received event network-changed-d13f9065-d7f3-4274-929f-3ac85db8bf73 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-33c54b37-fe38-4382-8460-707bd2acf49f req-bd6bf31e-2051-48e2-9ee8-c1fc38c201ff service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Refreshing instance network info cache due to event network-changed-d13f9065-d7f3-4274-929f-3ac85db8bf73. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-33c54b37-fe38-4382-8460-707bd2acf49f req-bd6bf31e-2051-48e2-9ee8-c1fc38c201ff service nova] Acquiring lock "refresh_cache-6dcf355f-759d-4a9a-9fb6-394e242c03e4" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.network.neutron [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.network.neutron [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Updating instance_info_cache with network_info: [{"id": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "address": "fa:16:3e:0f:a0:64", "network": {"id": "2fd2ca6a-6401-4865-99d6-647854bec84d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1799040535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13f9065-d7", "ovs_interfaceid": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Releasing lock "refresh_cache-6dcf355f-759d-4a9a-9fb6-394e242c03e4" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.compute.manager [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Instance network_info: |[{"id": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "address": "fa:16:3e:0f:a0:64", "network": {"id": "2fd2ca6a-6401-4865-99d6-647854bec84d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1799040535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13f9065-d7", "ovs_interfaceid": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-33c54b37-fe38-4382-8460-707bd2acf49f req-bd6bf31e-2051-48e2-9ee8-c1fc38c201ff service nova] Acquired lock "refresh_cache-6dcf355f-759d-4a9a-9fb6-394e242c03e4" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.network.neutron [req-33c54b37-fe38-4382-8460-707bd2acf49f req-bd6bf31e-2051-48e2-9ee8-c1fc38c201ff service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Refreshing network info cache for port d13f9065-d7f3-4274-929f-3ac85db8bf73 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Start _get_guest_xml network_info=[{"id": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "address": "fa:16:3e:0f:a0:64", "network": {"id": "2fd2ca6a-6401-4865-99d6-647854bec84d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1799040535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13f9065-d7", "ovs_interfaceid": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:19:39 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:19:39 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1295290313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1295290313',id=12,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOi2wt6bwWC52YfMKFz0ZOdIihoSozV9972X7DtLjMCaPcI7UTCrW5QcIACFjc56Pj6b7cRSH9i47OvgkdTcAES+2IVEx2e8rM0Q9iF4eOSwA6MrKwoAcVhYd6C5lAkb1w==',key_name='tempest-keypair-973400344',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='027310982a0047d9a0d06c29b5b6e1f2',ramdisk_id='',reservation_id='r-n0ic6hqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2066916431',owner_user_name='tempest-TaggedAttachmentsTest-2066916431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:19:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d173b822df3448bb49245f30afc0e17',uuid=6dcf355f-759d-4a9a-9fb6-394e242c03e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "address": "fa:16:3e:0f:a0:64", "network": {"id": "2fd2ca6a-6401-4865-99d6-647854bec84d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1799040535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13f9065-d7", "ovs_interfaceid": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Converting VIF {"id": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "address": "fa:16:3e:0f:a0:64", "network": {"id": "2fd2ca6a-6401-4865-99d6-647854bec84d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1799040535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13f9065-d7", "ovs_interfaceid": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a0:64,bridge_name='br-int',has_traffic_filtering=True,id=d13f9065-d7f3-4274-929f-3ac85db8bf73,network=Network(2fd2ca6a-6401-4865-99d6-647854bec84d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13f9065-d7') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.objects.instance [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lazy-loading 'pci_devices' on Instance uuid 6dcf355f-759d-4a9a-9fb6-394e242c03e4 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:19:39 user nova-compute[74776]:   <uuid>6dcf355f-759d-4a9a-9fb6-394e242c03e4</uuid>
Nov 22 14:19:39 user nova-compute[74776]:   <name>instance-0000000c</name>
Nov 22 14:19:39 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:19:39 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:19:39 user nova-compute[74776]:   <metadata>
Nov 22 14:19:39 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:19:39 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:19:39 user nova-compute[74776]:       <nova:name>tempest-device-tagging-server-1295290313</nova:name>
Nov 22 14:19:39 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:19:39</nova:creationTime>
Nov 22 14:19:39 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:19:39 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:19:39 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:19:39 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:19:39 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:19:39 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:19:39 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:19:39 user nova-compute[74776]:       <nova:owner>
Nov 22 14:19:39 user nova-compute[74776]:         <nova:user uuid="1d173b822df3448bb49245f30afc0e17">tempest-TaggedAttachmentsTest-2066916431-project-member</nova:user>
Nov 22 14:19:39 user nova-compute[74776]:         <nova:project uuid="027310982a0047d9a0d06c29b5b6e1f2">tempest-TaggedAttachmentsTest-2066916431</nova:project>
Nov 22 14:19:39 user nova-compute[74776]:       </nova:owner>
Nov 22 14:19:39 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:19:39 user nova-compute[74776]:       <nova:ports>
Nov 22 14:19:39 user nova-compute[74776]:         <nova:port uuid="d13f9065-d7f3-4274-929f-3ac85db8bf73">
Nov 22 14:19:39 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 14:19:39 user nova-compute[74776]:         </nova:port>
Nov 22 14:19:39 user nova-compute[74776]:       </nova:ports>
Nov 22 14:19:39 user nova-compute[74776]:     </nova:instance>
Nov 22 14:19:39 user nova-compute[74776]:   </metadata>
Nov 22 14:19:39 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:19:39 user nova-compute[74776]:     <system>
Nov 22 14:19:39 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:19:39 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:19:39 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:19:39 user nova-compute[74776]:       <entry name="serial">6dcf355f-759d-4a9a-9fb6-394e242c03e4</entry>
Nov 22 14:19:39 user nova-compute[74776]:       <entry name="uuid">6dcf355f-759d-4a9a-9fb6-394e242c03e4</entry>
Nov 22 14:19:39 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:19:39 user nova-compute[74776]:     </system>
Nov 22 14:19:39 user nova-compute[74776]:   </sysinfo>
Nov 22 14:19:39 user nova-compute[74776]:   <os>
Nov 22 14:19:39 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:19:39 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:19:39 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:19:39 user nova-compute[74776]:   </os>
Nov 22 14:19:39 user nova-compute[74776]:   <features>
Nov 22 14:19:39 user nova-compute[74776]:     <acpi/>
Nov 22 14:19:39 user nova-compute[74776]:     <apic/>
Nov 22 14:19:39 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:19:39 user nova-compute[74776]:   </features>
Nov 22 14:19:39 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:19:39 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:19:39 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:19:39 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:19:39 user nova-compute[74776]:   </clock>
Nov 22 14:19:39 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:19:39 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:19:39 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:19:39 user nova-compute[74776]:   </cpu>
Nov 22 14:19:39 user nova-compute[74776]:   <devices>
Nov 22 14:19:39 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:19:39 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:19:39 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk"/>
Nov 22 14:19:39 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:19:39 user nova-compute[74776]:     </disk>
Nov 22 14:19:39 user nova-compute[74776]:     <disk type="file" device="cdrom">
Nov 22 14:19:39 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none"/>
Nov 22 14:19:39 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk.config"/>
Nov 22 14:19:39 user nova-compute[74776]:       <target dev="hda" bus="ide"/>
Nov 22 14:19:39 user nova-compute[74776]:     </disk>
Nov 22 14:19:39 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:19:39 user nova-compute[74776]:       <mac address="fa:16:3e:0f:a0:64"/>
Nov 22 14:19:39 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:19:39 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:19:39 user nova-compute[74776]:       <target dev="tapd13f9065-d7"/>
Nov 22 14:19:39 user nova-compute[74776]:     </interface>
Nov 22 14:19:39 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:19:39 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/console.log" append="off"/>
Nov 22 14:19:39 user nova-compute[74776]:     </serial>
Nov 22 14:19:39 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:19:39 user nova-compute[74776]:     <video>
Nov 22 14:19:39 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:19:39 user nova-compute[74776]:     </video>
Nov 22 14:19:39 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:19:39 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:19:39 user nova-compute[74776]:     </rng>
Nov 22 14:19:39 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:19:39 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:19:39 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:19:39 user nova-compute[74776]:     </memballoon>
Nov 22 14:19:39 user nova-compute[74776]:   </devices>
Nov 22 14:19:39 user nova-compute[74776]: </domain>
Nov 22 14:19:39 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1295290313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1295290313',id=12,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOi2wt6bwWC52YfMKFz0ZOdIihoSozV9972X7DtLjMCaPcI7UTCrW5QcIACFjc56Pj6b7cRSH9i47OvgkdTcAES+2IVEx2e8rM0Q9iF4eOSwA6MrKwoAcVhYd6C5lAkb1w==',key_name='tempest-keypair-973400344',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='027310982a0047d9a0d06c29b5b6e1f2',ramdisk_id='',reservation_id='r-n0ic6hqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2066916431',owner_user_name='tempest-TaggedAttachmentsTest-2066916431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:19:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d173b822df3448bb49245f30afc0e17',uuid=6dcf355f-759d-4a9a-9fb6-394e242c03e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "address": "fa:16:3e:0f:a0:64", "network": {"id": "2fd2ca6a-6401-4865-99d6-647854bec84d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1799040535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13f9065-d7", "ovs_interfaceid": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Converting VIF {"id": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "address": "fa:16:3e:0f:a0:64", "network": {"id": "2fd2ca6a-6401-4865-99d6-647854bec84d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1799040535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13f9065-d7", "ovs_interfaceid": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a0:64,bridge_name='br-int',has_traffic_filtering=True,id=d13f9065-d7f3-4274-929f-3ac85db8bf73,network=Network(2fd2ca6a-6401-4865-99d6-647854bec84d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13f9065-d7') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG os_vif [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a0:64,bridge_name='br-int',has_traffic_filtering=True,id=d13f9065-d7f3-4274-929f-3ac85db8bf73,network=Network(2fd2ca6a-6401-4865-99d6-647854bec84d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13f9065-d7') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17229b00-3b04-58b3-8fbe-e54d37f7996c', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd13f9065-d7, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd13f9065-d7, col_values=(('qos', UUID('0a69df3b-2ec8-474d-8e07-bdddc9adb906')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd13f9065-d7, col_values=(('external_ids', {'iface-id': 'd13f9065-d7f3-4274-929f-3ac85db8bf73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:a0:64', 'vm-uuid': '6dcf355f-759d-4a9a-9fb6-394e242c03e4'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:39 user nova-compute[74776]: INFO os_vif [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a0:64,bridge_name='br-int',has_traffic_filtering=True,id=d13f9065-d7f3-4274-929f-3ac85db8bf73,network=Network(2fd2ca6a-6401-4865-99d6-647854bec84d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13f9065-d7')
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] No BDM found with device name hda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] No VIF found with MAC fa:16:3e:0f:a0:64, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:19:39 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Using config drive
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.network.neutron [req-33c54b37-fe38-4382-8460-707bd2acf49f req-bd6bf31e-2051-48e2-9ee8-c1fc38c201ff service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Updated VIF entry in instance network info cache for port d13f9065-d7f3-4274-929f-3ac85db8bf73. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG nova.network.neutron [req-33c54b37-fe38-4382-8460-707bd2acf49f req-bd6bf31e-2051-48e2-9ee8-c1fc38c201ff service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Updating instance_info_cache with network_info: [{"id": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "address": "fa:16:3e:0f:a0:64", "network": {"id": "2fd2ca6a-6401-4865-99d6-647854bec84d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1799040535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13f9065-d7", "ovs_interfaceid": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:19:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-33c54b37-fe38-4382-8460-707bd2acf49f req-bd6bf31e-2051-48e2-9ee8-c1fc38c201ff service nova] Releasing lock "refresh_cache-6dcf355f-759d-4a9a-9fb6-394e242c03e4" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:19:39 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Creating config drive at /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk.config
Nov 22 14:19:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpah2fwar9 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpah2fwar9" returned: 0 in 0.136s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-8d23759b-0edd-4732-a2b4-42e770c34750 req-1eb458df-bcbb-477e-8adc-c2d74b6bd584 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Received event network-vif-plugged-d13f9065-d7f3-4274-929f-3ac85db8bf73 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8d23759b-0edd-4732-a2b4-42e770c34750 req-1eb458df-bcbb-477e-8adc-c2d74b6bd584 service nova] Acquiring lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8d23759b-0edd-4732-a2b4-42e770c34750 req-1eb458df-bcbb-477e-8adc-c2d74b6bd584 service nova] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8d23759b-0edd-4732-a2b4-42e770c34750 req-1eb458df-bcbb-477e-8adc-c2d74b6bd584 service nova] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-8d23759b-0edd-4732-a2b4-42e770c34750 req-1eb458df-bcbb-477e-8adc-c2d74b6bd584 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] No waiting events found dispatching network-vif-plugged-d13f9065-d7f3-4274-929f-3ac85db8bf73 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:41 user nova-compute[74776]: WARNING nova.compute.manager [req-8d23759b-0edd-4732-a2b4-42e770c34750 req-1eb458df-bcbb-477e-8adc-c2d74b6bd584 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Received unexpected event network-vif-plugged-d13f9065-d7f3-4274-929f-3ac85db8bf73 for instance with vm_state building and task_state spawning.
Nov 22 14:19:42 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 42b00137-df98-47d9-9d02-29b4707fed30 is timed out.
Nov 22 14:19:42 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Successfully detached device vdb from instance 42b00137-df98-47d9-9d02-29b4707fed30 from the live domain config.
Nov 22 14:19:42 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DstQFecd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:19:42 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:19:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[878907da-76e9-4631-a0dd-2135772a0962]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:19:42 user nova-compute[74776]: No targets found.
Nov 22 14:19:42 user nova-compute[74776]: iSNS:
Nov 22 14:19:42 user nova-compute[74776]: No targets found.
Nov 22 14:19:42 user nova-compute[74776]: STATIC:
Nov 22 14:19:42 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866
Nov 22 14:19:42 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:19:42 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:19:42 user nova-compute[74776]: FIRMWARE:
Nov 22 14:19:42 user nova-compute[74776]: No targets found.
Nov 22 14:19:42 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:19:42 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:19:42 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d9ff9a-ead9-4ebb-aca0-9c9c9f79ba4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a0b6ee-b0c5-4a49-8c1b-dd0856d3de08]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 (non-flash)
Nov 22 14:19:42 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 (non-flash)
Nov 22 14:19:42 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c58250dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866'): ({'sdb'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Removing single pathed devices sdb {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e9e773-ca88-4d90-a4e6-7f7b1711f7be]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5223e1-29f6-4694-9b18-bbc982f39554]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Flushing IO for device /dev/sdb {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76247a3-c2c1-4cae-99f0-d4e630e16c3d]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebe1ecd-6b5f-47c5-86c1-a111d1dffba8]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd77029-471c-4910-b868-9c73add6f755]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[397ba0da-ef4d-43eb-a761-d08d901a009d]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866, portal: 172.16.0.220,3260]
Nov 22 14:19:42 user nova-compute[74776]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866, portal: 172.16.0.220,3260] successful.
Nov 22 14:19:42 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99d7c30a-946e-42e1-b105-fac14a5bd866 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f843a94-65be-4c5c-9e2b-fd0cb8ef4b2a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] <== disconnect_volume: return (305ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:19:42 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:19:43 user nova-compute[74776]: DEBUG nova.objects.instance [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lazy-loading 'flavor' on Instance uuid 42b00137-df98-47d9-9d02-29b4707fed30 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:19:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c0d8098a-b5cc-4ba1-8022-02a876030327 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "42b00137-df98-47d9-9d02-29b4707fed30" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.747s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:43 user nova-compute[74776]: DEBUG nova.compute.manager [req-f8a3062d-c4a4-418e-a772-d65bb83017c2 req-167a2b1a-59b9-4f6f-9f0d-a7e0ea731274 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Received event network-vif-plugged-d13f9065-d7f3-4274-929f-3ac85db8bf73 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f8a3062d-c4a4-418e-a772-d65bb83017c2 req-167a2b1a-59b9-4f6f-9f0d-a7e0ea731274 service nova] Acquiring lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f8a3062d-c4a4-418e-a772-d65bb83017c2 req-167a2b1a-59b9-4f6f-9f0d-a7e0ea731274 service nova] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f8a3062d-c4a4-418e-a772-d65bb83017c2 req-167a2b1a-59b9-4f6f-9f0d-a7e0ea731274 service nova] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:43 user nova-compute[74776]: DEBUG nova.compute.manager [req-f8a3062d-c4a4-418e-a772-d65bb83017c2 req-167a2b1a-59b9-4f6f-9f0d-a7e0ea731274 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] No waiting events found dispatching network-vif-plugged-d13f9065-d7f3-4274-929f-3ac85db8bf73 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:43 user nova-compute[74776]: WARNING nova.compute.manager [req-f8a3062d-c4a4-418e-a772-d65bb83017c2 req-167a2b1a-59b9-4f6f-9f0d-a7e0ea731274 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Received unexpected event network-vif-plugged-d13f9065-d7f3-4274-929f-3ac85db8bf73 for instance with vm_state building and task_state spawning.
Nov 22 14:19:43 user nova-compute[74776]: DEBUG nova.compute.manager [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:19:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:19:43 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Instance spawned successfully.
Nov 22 14:19:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:19:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:19:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:19:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:19:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:19:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:19:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:19:44 user nova-compute[74776]: INFO nova.compute.manager [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 22 14:19:44 user nova-compute[74776]: DEBUG nova.compute.manager [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:19:44 user nova-compute[74776]: INFO nova.compute.manager [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Took 6.65 seconds to build instance.
Nov 22 14:19:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6996d49d-cff5-4d2c-87b1-025bba4610cc tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.782s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Acquiring lock "fb5def2c-c757-4a3c-a832-142bf8c61413" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Lock "fb5def2c-c757-4a3c-a832-142bf8c61413" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Acquiring lock "fb5def2c-c757-4a3c-a832-142bf8c61413-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Lock "fb5def2c-c757-4a3c-a832-142bf8c61413-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Lock "fb5def2c-c757-4a3c-a832-142bf8c61413-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:53 user nova-compute[74776]: INFO nova.compute.manager [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Terminating instance
Nov 22 14:19:53 user nova-compute[74776]: DEBUG nova.compute.manager [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-cc5b0b39-a24c-44e6-85b8-d3618b722b57 req-12262da2-b32c-4671-9be0-18a73dc00ade service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Received event network-vif-unplugged-5ac74f62-5924-4561-9764-37baf7fb4a76 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cc5b0b39-a24c-44e6-85b8-d3618b722b57 req-12262da2-b32c-4671-9be0-18a73dc00ade service nova] Acquiring lock "fb5def2c-c757-4a3c-a832-142bf8c61413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cc5b0b39-a24c-44e6-85b8-d3618b722b57 req-12262da2-b32c-4671-9be0-18a73dc00ade service nova] Lock "fb5def2c-c757-4a3c-a832-142bf8c61413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cc5b0b39-a24c-44e6-85b8-d3618b722b57 req-12262da2-b32c-4671-9be0-18a73dc00ade service nova] Lock "fb5def2c-c757-4a3c-a832-142bf8c61413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-cc5b0b39-a24c-44e6-85b8-d3618b722b57 req-12262da2-b32c-4671-9be0-18a73dc00ade service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] No waiting events found dispatching network-vif-unplugged-5ac74f62-5924-4561-9764-37baf7fb4a76 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-cc5b0b39-a24c-44e6-85b8-d3618b722b57 req-12262da2-b32c-4671-9be0-18a73dc00ade service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Received event network-vif-unplugged-5ac74f62-5924-4561-9764-37baf7fb4a76 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:53 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Instance destroyed successfully.
Nov 22 14:19:53 user nova-compute[74776]: DEBUG nova.objects.instance [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Lazy-loading 'resources' on Instance uuid fb5def2c-c757-4a3c-a832-142bf8c61413 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1354942648',display_name='tempest-VolumesAssistedSnapshotsTest-server-1354942648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1354942648',id=8,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVpHkWub86FarFRjFCm857KS6EipDOTPTX/Hpyiz3SUT0Zzh2xYQkykAKH3UiiPPGteAEzrNP3UnwJRg/9Wg2YOh9HMxWqMY+wKZ/NVh/3XLvNXUd0Q2VwN5qwyK2Rfow==',key_name='tempest-keypair-703456416',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:16:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f11960384544c3e935913363bdb1a07',ramdisk_id='',reservation_id='r-39qdve1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1302421890',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1302421890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:17:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c56716b9718b451891b0c598480bf278',uuid=fb5def2c-c757-4a3c-a832-142bf8c61413,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ac74f62-5924-4561-9764-37baf7fb4a76", "address": "fa:16:3e:98:f8:b7", "network": {"id": "53d2e1ea-b878-4276-94e0-8cd654e520d8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1299382333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f11960384544c3e935913363bdb1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ac74f62-59", "ovs_interfaceid": "5ac74f62-5924-4561-9764-37baf7fb4a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Converting VIF {"id": "5ac74f62-5924-4561-9764-37baf7fb4a76", "address": "fa:16:3e:98:f8:b7", "network": {"id": "53d2e1ea-b878-4276-94e0-8cd654e520d8", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1299382333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f11960384544c3e935913363bdb1a07", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ac74f62-59", "ovs_interfaceid": "5ac74f62-5924-4561-9764-37baf7fb4a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:f8:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ac74f62-5924-4561-9764-37baf7fb4a76,network=Network(53d2e1ea-b878-4276-94e0-8cd654e520d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ac74f62-59') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG os_vif [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:f8:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ac74f62-5924-4561-9764-37baf7fb4a76,network=Network(53d2e1ea-b878-4276-94e0-8cd654e520d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ac74f62-59') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ac74f62-59, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cdbedb70-2ca6-4fa3-ab30-df85f03d8276) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:19:53 user nova-compute[74776]: INFO os_vif [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:f8:b7,bridge_name='br-int',has_traffic_filtering=True,id=5ac74f62-5924-4561-9764-37baf7fb4a76,network=Network(53d2e1ea-b878-4276-94e0-8cd654e520d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ac74f62-59')
Nov 22 14:19:53 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Deleting instance files /opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413_del
Nov 22 14:19:53 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Deletion of /opt/stack/data/nova/instances/fb5def2c-c757-4a3c-a832-142bf8c61413_del complete
Nov 22 14:19:54 user nova-compute[74776]: INFO nova.compute.manager [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 22 14:19:54 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:19:54 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:19:54 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:19:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:54 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:19:54 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Took 0.75 seconds to deallocate network for instance.
Nov 22 14:19:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:19:55 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:19:55 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:19:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:55 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Deleted allocations for instance fb5def2c-c757-4a3c-a832-142bf8c61413
Nov 22 14:19:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bafb7766-cd6c-4836-913b-d0476ac5ea36 tempest-VolumesAssistedSnapshotsTest-1302421890 tempest-VolumesAssistedSnapshotsTest-1302421890-project-member] Lock "fb5def2c-c757-4a3c-a832-142bf8c61413" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.234s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:55 user nova-compute[74776]: DEBUG nova.compute.manager [req-47ee694e-6297-45ec-9952-d06ebb5d2573 req-782e190e-de41-451b-8b32-fa7a04fdaed2 service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Received event network-vif-plugged-5ac74f62-5924-4561-9764-37baf7fb4a76 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-47ee694e-6297-45ec-9952-d06ebb5d2573 req-782e190e-de41-451b-8b32-fa7a04fdaed2 service nova] Acquiring lock "fb5def2c-c757-4a3c-a832-142bf8c61413-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:19:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-47ee694e-6297-45ec-9952-d06ebb5d2573 req-782e190e-de41-451b-8b32-fa7a04fdaed2 service nova] Lock "fb5def2c-c757-4a3c-a832-142bf8c61413-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:19:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-47ee694e-6297-45ec-9952-d06ebb5d2573 req-782e190e-de41-451b-8b32-fa7a04fdaed2 service nova] Lock "fb5def2c-c757-4a3c-a832-142bf8c61413-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:19:55 user nova-compute[74776]: DEBUG nova.compute.manager [req-47ee694e-6297-45ec-9952-d06ebb5d2573 req-782e190e-de41-451b-8b32-fa7a04fdaed2 service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] No waiting events found dispatching network-vif-plugged-5ac74f62-5924-4561-9764-37baf7fb4a76 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:19:55 user nova-compute[74776]: WARNING nova.compute.manager [req-47ee694e-6297-45ec-9952-d06ebb5d2573 req-782e190e-de41-451b-8b32-fa7a04fdaed2 service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Received unexpected event network-vif-plugged-5ac74f62-5924-4561-9764-37baf7fb4a76 for instance with vm_state deleted and task_state None.
Nov 22 14:19:55 user nova-compute[74776]: DEBUG nova.compute.manager [req-47ee694e-6297-45ec-9952-d06ebb5d2573 req-782e190e-de41-451b-8b32-fa7a04fdaed2 service nova] [instance: fb5def2c-c757-4a3c-a832-142bf8c61413] Received event network-vif-deleted-5ac74f62-5924-4561-9764-37baf7fb4a76 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:19:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG nova.objects.instance [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lazy-loading 'flavor' on Instance uuid e96ab1bf-6f19-4e5f-b79d-f0266988090b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "98fb9b54-c428-4a48-b1ff-a976f971b764" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG nova.objects.instance [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lazy-loading 'flavor' on Instance uuid 98fb9b54-c428-4a48-b1ff-a976f971b764 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:00 user nova-compute[74776]: INFO nova.compute.manager [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Attaching volume 80d952a7-ba34-425d-b34d-dbb03e3fb7e3 to /dev/vdb
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "98fb9b54-c428-4a48-b1ff-a976f971b764" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:00 user nova-compute[74776]: INFO nova.compute.manager [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Attaching volume b1591527-945f-4c2c-ae44-f65709df6065 to /dev/vdb
Nov 22 14:20:00 user nova-compute[74776]: DEBUG os_brick.utils [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1784f083-1797-4eec-8daa-3137bcd4d9b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG os_brick.utils [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e44747-f3a7-4050-9d34-94bfccb6e1fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4bf7c3-c437-46c8-ae6c-48bc82da50df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb2bb9f-e572-43fc-9bf6-cbbbacc36ab6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eeac059-96db-4a93-ba28-499626634766]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec1f963-a943-4e57-88ec-0daab09d2d74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:20:00 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e290a4-b548-41ac-9845-c4107053eea1]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a62493a-f912-41d3-baae-7b2f6c8f7c7a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG os_brick.utils [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Updating existing volume attachment record: c66b1bd4-b205-4fe8-9056-39c812ebea7c {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[821c6aea-f0bb-443c-b5ad-05abb80ba273]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:20:00 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:20:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf8ea5e-6b5f-41bc-b568-f8d27ccc7b78]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG os_brick.utils [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] <== get_connector_properties: return (222ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:20:00 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Updating existing volume attachment record: 1fdadc66-7b22-4716-9b3d-ccd5d7dd38c3 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:20:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:02 user nova-compute[74776]: DEBUG nova.compute.manager [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:20:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:02 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:20:02 user nova-compute[74776]: INFO nova.compute.claims [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Claim successful on node user
Nov 22 14:20:03 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:20:03 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:20:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:03 user nova-compute[74776]: DEBUG nova.compute.manager [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:20:03 user nova-compute[74776]: DEBUG nova.compute.manager [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:20:03 user nova-compute[74776]: DEBUG nova.network.neutron [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:20:03 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:20:03 user nova-compute[74776]: DEBUG nova.compute.manager [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:20:03 user nova-compute[74776]: DEBUG nova.policy [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f703bfbe762447778429bda22b74505c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3958d7be91b4bb1b9e314d8867cd8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:20:03 user nova-compute[74776]: DEBUG nova.compute.manager [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:20:03 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:20:03 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Creating image(s)
Nov 22 14:20:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "/opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "/opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:03 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:03 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.198s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:03 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.273s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk 1073741824" returned: 0 in 0.061s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.339s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Acquiring lock "62461965-8bbb-4497-81e7-d9237832f190" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "62461965-8bbb-4497-81e7-d9237832f190" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Acquiring lock "62461965-8bbb-4497-81e7-d9237832f190-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "62461965-8bbb-4497-81e7-d9237832f190-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "62461965-8bbb-4497-81e7-d9237832f190-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:04 user nova-compute[74776]: INFO nova.compute.manager [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Terminating instance
Nov 22 14:20:04 user nova-compute[74776]: DEBUG nova.compute.manager [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG nova.network.neutron [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Successfully created port: 81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.229s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Cannot resize image /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Ensure instance console log exists: /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG nova.compute.manager [req-b03d2c88-1ee3-48fd-961f-e813f6048266 req-d22bb9c7-25fa-46cf-b77b-7d849b69b865 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Received event network-vif-unplugged-fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b03d2c88-1ee3-48fd-961f-e813f6048266 req-d22bb9c7-25fa-46cf-b77b-7d849b69b865 service nova] Acquiring lock "62461965-8bbb-4497-81e7-d9237832f190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b03d2c88-1ee3-48fd-961f-e813f6048266 req-d22bb9c7-25fa-46cf-b77b-7d849b69b865 service nova] Lock "62461965-8bbb-4497-81e7-d9237832f190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b03d2c88-1ee3-48fd-961f-e813f6048266 req-d22bb9c7-25fa-46cf-b77b-7d849b69b865 service nova] Lock "62461965-8bbb-4497-81e7-d9237832f190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG nova.compute.manager [req-b03d2c88-1ee3-48fd-961f-e813f6048266 req-d22bb9c7-25fa-46cf-b77b-7d849b69b865 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] No waiting events found dispatching network-vif-unplugged-fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG nova.compute.manager [req-b03d2c88-1ee3-48fd-961f-e813f6048266 req-d22bb9c7-25fa-46cf-b77b-7d849b69b865 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Received event network-vif-unplugged-fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:20:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:05 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Instance destroyed successfully.
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.objects.instance [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lazy-loading 'resources' on Instance uuid 62461965-8bbb-4497-81e7-d9237832f190 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1315674234',display_name='tempest-TestVolumeSwap-server-1315674234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1315674234',id=7,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcEvqPUPhT4nIqn42VKV6sZXQhgNAMZ4E6hBxOakWQ5e1l2QXF2BCfDTm11500G4oKXQwTOX4eeuP35JNRDD9EPfNkuY8vdi00SJkHr+y7IBhb0E3FJ5aPwGWMs7DEt3Q==',key_name='tempest-keypair-1732866307',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:16:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='91bafa921c884ef4bf2928492c58c0d6',ramdisk_id='',reservation_id='r-100vj9ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1684556967',owner_user_name='tempest-TestVolumeSwap-1684556967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:16:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1deee15758534e7894574ba7e5e583fc',uuid=62461965-8bbb-4497-81e7-d9237832f190,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "address": "fa:16:3e:88:e5:06", "network": {"id": "27ef6736-2e02-4129-9a99-808e36b78c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2032983723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91bafa921c884ef4bf2928492c58c0d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf7b87c-b8", "ovs_interfaceid": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Converting VIF {"id": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "address": "fa:16:3e:88:e5:06", "network": {"id": "27ef6736-2e02-4129-9a99-808e36b78c69", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2032983723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "91bafa921c884ef4bf2928492c58c0d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf7b87c-b8", "ovs_interfaceid": "fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:e5:06,bridge_name='br-int',has_traffic_filtering=True,id=fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c,network=Network(27ef6736-2e02-4129-9a99-808e36b78c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf7b87c-b8') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG os_vif [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:e5:06,bridge_name='br-int',has_traffic_filtering=True,id=fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c,network=Network(27ef6736-2e02-4129-9a99-808e36b78c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf7b87c-b8') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.network.neutron [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Successfully updated port: 81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcf7b87c-b8, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "refresh_cache-d7f3ff5e-292d-4e81-af58-b9a45adfbda1" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquired lock "refresh_cache-d7f3ff5e-292d-4e81-af58-b9a45adfbda1" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.network.neutron [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55ba2e52-80fc-413d-9a71-920906e31a8a) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:05 user nova-compute[74776]: INFO os_vif [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:e5:06,bridge_name='br-int',has_traffic_filtering=True,id=fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c,network=Network(27ef6736-2e02-4129-9a99-808e36b78c69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf7b87c-b8')
Nov 22 14:20:05 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Deleting instance files /opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190_del
Nov 22 14:20:05 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Deletion of /opt/stack/data/nova/instances/62461965-8bbb-4497-81e7-d9237832f190_del complete
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.compute.manager [req-1e915233-2281-4505-8c2c-d47f8469cb9c req-1b112e9e-86d9-48f2-957e-796e2f641c28 service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Received event network-changed-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.compute.manager [req-1e915233-2281-4505-8c2c-d47f8469cb9c req-1b112e9e-86d9-48f2-957e-796e2f641c28 service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Refreshing instance network info cache due to event network-changed-81372b6e-8162-4b1f-ac94-dcaf1c8c2473. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1e915233-2281-4505-8c2c-d47f8469cb9c req-1b112e9e-86d9-48f2-957e-796e2f641c28 service nova] Acquiring lock "refresh_cache-d7f3ff5e-292d-4e81-af58-b9a45adfbda1" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:20:05 user nova-compute[74776]: INFO nova.compute.manager [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 22 14:20:05 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 62461965-8bbb-4497-81e7-d9237832f190] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.network.neutron [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.network.neutron [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Updating instance_info_cache with network_info: [{"id": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "address": "fa:16:3e:22:fe:77", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81372b6e-81", "ovs_interfaceid": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Releasing lock "refresh_cache-d7f3ff5e-292d-4e81-af58-b9a45adfbda1" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.compute.manager [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Instance network_info: |[{"id": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "address": "fa:16:3e:22:fe:77", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81372b6e-81", "ovs_interfaceid": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1e915233-2281-4505-8c2c-d47f8469cb9c req-1b112e9e-86d9-48f2-957e-796e2f641c28 service nova] Acquired lock "refresh_cache-d7f3ff5e-292d-4e81-af58-b9a45adfbda1" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.network.neutron [req-1e915233-2281-4505-8c2c-d47f8469cb9c req-1b112e9e-86d9-48f2-957e-796e2f641c28 service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Refreshing network info cache for port 81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Start _get_guest_xml network_info=[{"id": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "address": "fa:16:3e:22:fe:77", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81372b6e-81", "ovs_interfaceid": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:20:05 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:20:05 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1556564197',display_name='tempest-tempest.common.compute-instance-1556564197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1556564197',id=13,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAC9v0i+pER3cZ0Jjqv3cqTkz1HXyHfnSqpokTPMCo4Rsk1FySmrASTuu3c9HUsU6AsfF7+7FSXMyaBmojZ6N9tkTFvl0ozPbgI/kAIfW0Flf0H56UyV24UUsrzbg38lsw==',key_name='tempest-keypair-32107482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3958d7be91b4bb1b9e314d8867cd8f5',ramdisk_id='',reservation_id='r-o0y8arto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-109524404',owner_user_name='tempest-ServerActionsTestOtherA-109524404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:20:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f703bfbe762447778429bda22b74505c',uuid=d7f3ff5e-292d-4e81-af58-b9a45adfbda1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "address": "fa:16:3e:22:fe:77", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81372b6e-81", "ovs_interfaceid": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converting VIF {"id": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "address": "fa:16:3e:22:fe:77", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81372b6e-81", "ovs_interfaceid": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:fe:77,bridge_name='br-int',has_traffic_filtering=True,id=81372b6e-8162-4b1f-ac94-dcaf1c8c2473,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81372b6e-81') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.objects.instance [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lazy-loading 'pci_devices' on Instance uuid d7f3ff5e-292d-4e81-af58-b9a45adfbda1 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:20:05 user nova-compute[74776]:   <uuid>d7f3ff5e-292d-4e81-af58-b9a45adfbda1</uuid>
Nov 22 14:20:05 user nova-compute[74776]:   <name>instance-0000000d</name>
Nov 22 14:20:05 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:20:05 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:20:05 user nova-compute[74776]:   <metadata>
Nov 22 14:20:05 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:20:05 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:20:05 user nova-compute[74776]:       <nova:name>tempest-tempest.common.compute-instance-1556564197</nova:name>
Nov 22 14:20:05 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:20:05</nova:creationTime>
Nov 22 14:20:05 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:20:05 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:20:05 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:20:05 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:20:05 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:20:05 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:20:05 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:20:05 user nova-compute[74776]:       <nova:owner>
Nov 22 14:20:05 user nova-compute[74776]:         <nova:user uuid="f703bfbe762447778429bda22b74505c">tempest-ServerActionsTestOtherA-109524404-project-member</nova:user>
Nov 22 14:20:05 user nova-compute[74776]:         <nova:project uuid="a3958d7be91b4bb1b9e314d8867cd8f5">tempest-ServerActionsTestOtherA-109524404</nova:project>
Nov 22 14:20:05 user nova-compute[74776]:       </nova:owner>
Nov 22 14:20:05 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:20:05 user nova-compute[74776]:       <nova:ports>
Nov 22 14:20:05 user nova-compute[74776]:         <nova:port uuid="81372b6e-8162-4b1f-ac94-dcaf1c8c2473">
Nov 22 14:20:05 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 14:20:05 user nova-compute[74776]:         </nova:port>
Nov 22 14:20:05 user nova-compute[74776]:       </nova:ports>
Nov 22 14:20:05 user nova-compute[74776]:     </nova:instance>
Nov 22 14:20:05 user nova-compute[74776]:   </metadata>
Nov 22 14:20:05 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:20:05 user nova-compute[74776]:     <system>
Nov 22 14:20:05 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:20:05 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:20:05 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:20:05 user nova-compute[74776]:       <entry name="serial">d7f3ff5e-292d-4e81-af58-b9a45adfbda1</entry>
Nov 22 14:20:05 user nova-compute[74776]:       <entry name="uuid">d7f3ff5e-292d-4e81-af58-b9a45adfbda1</entry>
Nov 22 14:20:05 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:20:05 user nova-compute[74776]:     </system>
Nov 22 14:20:05 user nova-compute[74776]:   </sysinfo>
Nov 22 14:20:05 user nova-compute[74776]:   <os>
Nov 22 14:20:05 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:20:05 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:20:05 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:20:05 user nova-compute[74776]:   </os>
Nov 22 14:20:05 user nova-compute[74776]:   <features>
Nov 22 14:20:05 user nova-compute[74776]:     <acpi/>
Nov 22 14:20:05 user nova-compute[74776]:     <apic/>
Nov 22 14:20:05 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:20:05 user nova-compute[74776]:   </features>
Nov 22 14:20:05 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:20:05 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:20:05 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:20:05 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:20:05 user nova-compute[74776]:   </clock>
Nov 22 14:20:05 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:20:05 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:20:05 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:20:05 user nova-compute[74776]:   </cpu>
Nov 22 14:20:05 user nova-compute[74776]:   <devices>
Nov 22 14:20:05 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:20:05 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:20:05 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk"/>
Nov 22 14:20:05 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:20:05 user nova-compute[74776]:     </disk>
Nov 22 14:20:05 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:20:05 user nova-compute[74776]:       <mac address="fa:16:3e:22:fe:77"/>
Nov 22 14:20:05 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:20:05 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:20:05 user nova-compute[74776]:       <target dev="tap81372b6e-81"/>
Nov 22 14:20:05 user nova-compute[74776]:     </interface>
Nov 22 14:20:05 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:20:05 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/console.log" append="off"/>
Nov 22 14:20:05 user nova-compute[74776]:     </serial>
Nov 22 14:20:05 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:20:05 user nova-compute[74776]:     <video>
Nov 22 14:20:05 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:20:05 user nova-compute[74776]:     </video>
Nov 22 14:20:05 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:20:05 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:20:05 user nova-compute[74776]:     </rng>
Nov 22 14:20:05 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:20:05 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:20:05 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:20:05 user nova-compute[74776]:     </memballoon>
Nov 22 14:20:05 user nova-compute[74776]:   </devices>
Nov 22 14:20:05 user nova-compute[74776]: </domain>
Nov 22 14:20:05 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1556564197',display_name='tempest-tempest.common.compute-instance-1556564197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1556564197',id=13,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAC9v0i+pER3cZ0Jjqv3cqTkz1HXyHfnSqpokTPMCo4Rsk1FySmrASTuu3c9HUsU6AsfF7+7FSXMyaBmojZ6N9tkTFvl0ozPbgI/kAIfW0Flf0H56UyV24UUsrzbg38lsw==',key_name='tempest-keypair-32107482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3958d7be91b4bb1b9e314d8867cd8f5',ramdisk_id='',reservation_id='r-o0y8arto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-109524404',owner_user_name='tempest-ServerActionsTestOtherA-109524404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:20:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f703bfbe762447778429bda22b74505c',uuid=d7f3ff5e-292d-4e81-af58-b9a45adfbda1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "address": "fa:16:3e:22:fe:77", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81372b6e-81", "ovs_interfaceid": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converting VIF {"id": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "address": "fa:16:3e:22:fe:77", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81372b6e-81", "ovs_interfaceid": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:fe:77,bridge_name='br-int',has_traffic_filtering=True,id=81372b6e-8162-4b1f-ac94-dcaf1c8c2473,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81372b6e-81') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG os_vif [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:fe:77,bridge_name='br-int',has_traffic_filtering=True,id=81372b6e-8162-4b1f-ac94-dcaf1c8c2473,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81372b6e-81') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1f19de8-1309-5a7f-91c6-0adcd7a964c1', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81372b6e-81, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81372b6e-81, col_values=(('qos', UUID('b7abef39-4d3b-43bd-b3f5-1e300804ff74')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81372b6e-81, col_values=(('external_ids', {'iface-id': '81372b6e-8162-4b1f-ac94-dcaf1c8c2473', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:fe:77', 'vm-uuid': 'd7f3ff5e-292d-4e81-af58-b9a45adfbda1'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:20:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:05 user nova-compute[74776]: INFO os_vif [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:fe:77,bridge_name='br-int',has_traffic_filtering=True,id=81372b6e-8162-4b1f-ac94-dcaf1c8c2473,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81372b6e-81')
Nov 22 14:20:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:20:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] No VIF found with MAC fa:16:3e:22:fe:77, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:20:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-1892b20a-afdd-491b-830c-10034e061e10 req-b0eeb4f0-8652-4156-8a62-01f5992dd974 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Received event network-vif-plugged-fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1892b20a-afdd-491b-830c-10034e061e10 req-b0eeb4f0-8652-4156-8a62-01f5992dd974 service nova] Acquiring lock "62461965-8bbb-4497-81e7-d9237832f190-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1892b20a-afdd-491b-830c-10034e061e10 req-b0eeb4f0-8652-4156-8a62-01f5992dd974 service nova] Lock "62461965-8bbb-4497-81e7-d9237832f190-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1892b20a-afdd-491b-830c-10034e061e10 req-b0eeb4f0-8652-4156-8a62-01f5992dd974 service nova] Lock "62461965-8bbb-4497-81e7-d9237832f190-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-1892b20a-afdd-491b-830c-10034e061e10 req-b0eeb4f0-8652-4156-8a62-01f5992dd974 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] No waiting events found dispatching network-vif-plugged-fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:20:06 user nova-compute[74776]: WARNING nova.compute.manager [req-1892b20a-afdd-491b-830c-10034e061e10 req-b0eeb4f0-8652-4156-8a62-01f5992dd974 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Received unexpected event network-vif-plugged-fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c for instance with vm_state active and task_state deleting.
Nov 22 14:20:06 user nova-compute[74776]: DEBUG nova.network.neutron [req-1e915233-2281-4505-8c2c-d47f8469cb9c req-1b112e9e-86d9-48f2-957e-796e2f641c28 service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Updated VIF entry in instance network info cache for port 81372b6e-8162-4b1f-ac94-dcaf1c8c2473. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:20:06 user nova-compute[74776]: DEBUG nova.network.neutron [req-1e915233-2281-4505-8c2c-d47f8469cb9c req-1b112e9e-86d9-48f2-957e-796e2f641c28 service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Updating instance_info_cache with network_info: [{"id": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "address": "fa:16:3e:22:fe:77", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81372b6e-81", "ovs_interfaceid": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:20:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1e915233-2281-4505-8c2c-d47f8469cb9c req-1b112e9e-86d9-48f2-957e-796e2f641c28 service nova] Releasing lock "refresh_cache-d7f3ff5e-292d-4e81-af58-b9a45adfbda1" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:20:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:07 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:20:07 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Took 1.86 seconds to deallocate network for instance.
Nov 22 14:20:07 user nova-compute[74776]: DEBUG nova.compute.manager [req-a2cdc0e6-6406-4a3b-becb-1edd7c415fbe req-9c25bdf5-2d0c-474d-bca7-351a4ad157e9 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Received event network-vif-deleted-fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:07 user nova-compute[74776]: INFO nova.compute.manager [req-a2cdc0e6-6406-4a3b-becb-1edd7c415fbe req-9c25bdf5-2d0c-474d-bca7-351a4ad157e9 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Neutron deleted interface fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c; detaching it from the instance and deleting it from the info cache
Nov 22 14:20:07 user nova-compute[74776]: DEBUG nova.network.neutron [req-a2cdc0e6-6406-4a3b-becb-1edd7c415fbe req-9c25bdf5-2d0c-474d-bca7-351a4ad157e9 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:20:07 user nova-compute[74776]: DEBUG nova.compute.manager [req-a2cdc0e6-6406-4a3b-becb-1edd7c415fbe req-9c25bdf5-2d0c-474d-bca7-351a4ad157e9 service nova] [instance: 62461965-8bbb-4497-81e7-d9237832f190] Detach interface failed, port_id=fcf7b87c-b8c4-4662-b04a-1fa4d0f2d58c, reason: Instance 62461965-8bbb-4497-81e7-d9237832f190 could not be found. {{(pid=74776) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 14:20:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:07 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:20:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:07 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:20:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:07 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Deleted allocations for instance 62461965-8bbb-4497-81e7-d9237832f190
Nov 22 14:20:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-deecceea-d04e-4d7e-92d1-a09333aff36b tempest-TestVolumeSwap-1684556967 tempest-TestVolumeSwap-1684556967-project-member] Lock "62461965-8bbb-4497-81e7-d9237832f190" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.618s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQPSRHFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:20:08 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:20:08 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:20:08 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc25deb-1fe3-4bf1-becd-ef7af0f5bddd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:20:08 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3949fdd3-cea1-4ec1-9c4b-8e07dab84360]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065] added
Nov 22 14:20:08 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[151d86f0-d0f7-4c82-8439-043ead8e52df]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvAJsUuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:20:08 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b00a10a-13ef-4bce-8f2e-00dbfc5e47ef]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qQPSRHFt {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qQPSRHFt" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[294953fb-17a6-4858-97b4-9082cecea8d4]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qQPSRHFt'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4324dd5-b1f2-4eae-8903-e7b39b68aac1]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9739de6a-6ab4-42b1-b808-b98a810c9072]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 14:20:08 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 14:20:08 user nova-compute[74776]:  {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:20:08 user nova-compute[74776]: WARNING os_brick.initiator.connectors.iscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 14:20:08 user nova-compute[74776]: 
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e705e742-283d-4c24-8d5f-3fe0d36bd6fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065, portal: 172.16.0.220,3260]
Nov 22 14:20:08 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065, portal: 172.16.0.220,3260] successful.
Nov 22 14:20:08 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eb593c-24a4-4609-a47e-48fb35cf50d1]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dfb4e1-8549-496c-8139-4cf15a46c5d6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:20:08 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:20:08 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d340e1e-f62f-4737-97c7-bf512995bead]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQPSRHFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-0a7081fe-ea9a-4500-acb1-106969eda744 req-3a8bfae5-4eb5-4fa5-9224-655427b7717c service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Received event network-vif-plugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0a7081fe-ea9a-4500-acb1-106969eda744 req-3a8bfae5-4eb5-4fa5-9224-655427b7717c service nova] Acquiring lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0a7081fe-ea9a-4500-acb1-106969eda744 req-3a8bfae5-4eb5-4fa5-9224-655427b7717c service nova] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0a7081fe-ea9a-4500-acb1-106969eda744 req-3a8bfae5-4eb5-4fa5-9224-655427b7717c service nova] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-0a7081fe-ea9a-4500-acb1-106969eda744 req-3a8bfae5-4eb5-4fa5-9224-655427b7717c service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] No waiting events found dispatching network-vif-plugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:20:08 user nova-compute[74776]: WARNING nova.compute.manager [req-0a7081fe-ea9a-4500-acb1-106969eda744 req-3a8bfae5-4eb5-4fa5-9224-655427b7717c service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Received unexpected event network-vif-plugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 for instance with vm_state building and task_state spawning.
Nov 22 14:20:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-0a7081fe-ea9a-4500-acb1-106969eda744 req-3a8bfae5-4eb5-4fa5-9224-655427b7717c service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Received event network-vif-plugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0a7081fe-ea9a-4500-acb1-106969eda744 req-3a8bfae5-4eb5-4fa5-9224-655427b7717c service nova] Acquiring lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0a7081fe-ea9a-4500-acb1-106969eda744 req-3a8bfae5-4eb5-4fa5-9224-655427b7717c service nova] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0a7081fe-ea9a-4500-acb1-106969eda744 req-3a8bfae5-4eb5-4fa5-9224-655427b7717c service nova] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-0a7081fe-ea9a-4500-acb1-106969eda744 req-3a8bfae5-4eb5-4fa5-9224-655427b7717c service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] No waiting events found dispatching network-vif-plugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:20:08 user nova-compute[74776]: WARNING nova.compute.manager [req-0a7081fe-ea9a-4500-acb1-106969eda744 req-3a8bfae5-4eb5-4fa5-9224-655427b7717c service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Received unexpected event network-vif-plugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 for instance with vm_state building and task_state spawning.
Nov 22 14:20:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.709s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] <== connect_volume: return (1712ms) {'type': 'block', 'scsi_wwn': '23463323732356635', 'path': '/dev/sdb'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463323732356635', 'path': '/dev/sdb'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG nova.compute.manager [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.584s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:20:09 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:20:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:20:09 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:20:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:09 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Instance spawned successfully.
Nov 22 14:20:09 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:20:09 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:20:09 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=7933MB free_disk=25.498619079589844GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fe646c-4ae8-4625-90ba-6c256b35b11d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:20:09 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG nova.objects.instance [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lazy-loading 'flavor' on Instance uuid 98fb9b54-c428-4a48-b1ff-a976f971b764 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0852a9e6-6bb8-44eb-aa4f-ba4596fd76d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3] added
Nov 22 14:20:09 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:20:09 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:20:09 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 14:20:09 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:20:09 user nova-compute[74776]:   <serial>b1591527-945f-4c2c-ae44-f65709df6065</serial>
Nov 22 14:20:09 user nova-compute[74776]: </disk>
Nov 22 14:20:09 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1294c7cc-8582-4cc4-b912-fa4b4eaad9f9]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e672c1-c912-49fb-9b54-263c00273744]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvAJsUuN {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvAJsUuN" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb9caf9-c478-47fe-b7f6-cee06ac23b58]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZvAJsUuN'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:10 user nova-compute[74776]: INFO nova.compute.manager [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Took 6.43 seconds to spawn the instance on the hypervisor.
Nov 22 14:20:10 user nova-compute[74776]: DEBUG nova.compute.manager [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance e96ab1bf-6f19-4e5f-b79d-f0266988090b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4629d82d-fd02-4a58-a535-b362b493e7c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 98fb9b54-c428-4a48-b1ff-a976f971b764 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 25deabe8-8cfc-4d40-a734-755d4097baf5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 42b00137-df98-47d9-9d02-29b4707fed30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 913e1c5b-59ec-4d26-831e-dee562748839 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6dcf355f-759d-4a9a-9fb6-394e242c03e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance d7f3ff5e-292d-4e81-af58-b9a45adfbda1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.107s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[878dce2f-04cd-4a70-8b80-77d922342076]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c69da12-fc31-4667-aa8c-6ee4acb279da]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:20:10 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:20:10 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[083b6a89-b317-4ac4-b37b-806abb68dc7f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260]
Nov 22 14:20:10 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260] successful.
Nov 22 14:20:10 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:10 user nova-compute[74776]: INFO nova.compute.manager [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Took 7.56 seconds to build instance.
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-389f5135-ef93-4527-9f60-1c917e4e82e9 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.821s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c830bccc-3712-4ffe-9669-510c81a0efd7]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[303fe12d-fe43-43c0-b4d0-8a18d4ea9db6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:20:10 user nova-compute[74776]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:20:10 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:20:10 user nova-compute[74776]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:20:10 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.436s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.036s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbab4f8-e16b-4934-b212-ee588d30eba3]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvAJsUuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] No VIF found with MAC fa:16:3e:7c:6e:68, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.672s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-67c7a2f0-0f80-4ebd-b1fa-896710c266d3 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.147s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.500s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:20:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] <== connect_volume: return (3085ms) {'type': 'block', 'scsi_wwn': '23562313333376336', 'path': '/dev/sdc'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:20:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562313333376336', 'path': '/dev/sdc'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:20:11 user nova-compute[74776]: DEBUG nova.objects.instance [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lazy-loading 'flavor' on Instance uuid e96ab1bf-6f19-4e5f-b79d-f0266988090b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:20:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:20:11 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:20:11 user nova-compute[74776]:   <source dev="/dev/sdc"/>
Nov 22 14:20:11 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:20:11 user nova-compute[74776]:   <serial>80d952a7-ba34-425d-b34d-dbb03e3fb7e3</serial>
Nov 22 14:20:11 user nova-compute[74776]: </disk>
Nov 22 14:20:11 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:20:11 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:20:11 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:20:11 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:20:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:20:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:20:11 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:20:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:20:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:20:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] No VIF found with MAC fa:16:3e:b6:46:f7, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:20:12 user nova-compute[74776]: INFO nova.compute.manager [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Rescuing
Nov 22 14:20:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:20:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e0166bc3-7b4d-4ec2-b324-85d1147251a4 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.698s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:12 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Updating instance_info_cache with network_info: [{"id": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "address": "fa:16:3e:7c:6e:68", "network": {"id": "32c8e7a3-6995-4931-ad2d-e8c3eb351538", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92fd48cf9c34eac867c14bf962c3a0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd255982-4c", "ovs_interfaceid": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:20:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:20:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:20:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquired lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:20:12 user nova-compute[74776]: DEBUG nova.network.neutron [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:20:12 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:20:12 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:20:12 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:20:12 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:20:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:20:12 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:20:12 user nova-compute[74776]: DEBUG nova.network.neutron [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Updating instance_info_cache with network_info: [{"id": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "address": "fa:16:3e:7c:6e:68", "network": {"id": "32c8e7a3-6995-4931-ad2d-e8c3eb351538", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92fd48cf9c34eac867c14bf962c3a0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd255982-4c", "ovs_interfaceid": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:20:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Releasing lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:20:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:13 user nova-compute[74776]: DEBUG nova.compute.manager [req-c6bab89e-618b-4e0c-bec8-2f770742c59a req-079e77a0-3bf4-4710-9fe2-f8736da93a7f service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received event network-vif-unplugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c6bab89e-618b-4e0c-bec8-2f770742c59a req-079e77a0-3bf4-4710-9fe2-f8736da93a7f service nova] Acquiring lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c6bab89e-618b-4e0c-bec8-2f770742c59a req-079e77a0-3bf4-4710-9fe2-f8736da93a7f service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c6bab89e-618b-4e0c-bec8-2f770742c59a req-079e77a0-3bf4-4710-9fe2-f8736da93a7f service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:13 user nova-compute[74776]: DEBUG nova.compute.manager [req-c6bab89e-618b-4e0c-bec8-2f770742c59a req-079e77a0-3bf4-4710-9fe2-f8736da93a7f service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] No waiting events found dispatching network-vif-unplugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:20:13 user nova-compute[74776]: WARNING nova.compute.manager [req-c6bab89e-618b-4e0c-bec8-2f770742c59a req-079e77a0-3bf4-4710-9fe2-f8736da93a7f service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received unexpected event network-vif-unplugged-dd255982-4c19-4bf3-b01c-ba063b6f561e for instance with vm_state active and task_state rescuing.
Nov 22 14:20:13 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Instance destroyed successfully.
Nov 22 14:20:13 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Attempting a stable device rescue
Nov 22 14:20:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74776) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 22 14:20:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Instance directory exists: not creating {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 14:20:14 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Creating image(s)
Nov 22 14:20:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "/opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "/opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "/opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:14 user nova-compute[74776]: DEBUG nova.objects.instance [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lazy-loading 'trusted_certs' on Instance uuid 98fb9b54-c428-4a48-b1ff-a976f971b764 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:20:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "d829168599e52d2f9f6d1f32c392c0aaa6461b35" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "d829168599e52d2f9f6d1f32c392c0aaa6461b35" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d829168599e52d2f9f6d1f32c392c0aaa6461b35.part --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:15 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Stashing vm_state: active {{(pid=74776) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 22 14:20:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d829168599e52d2f9f6d1f32c392c0aaa6461b35.part --force-share --output=json" returned: 0 in 0.190s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:15 user nova-compute[74776]: DEBUG nova.virt.images [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] aaab0170-a4b9-4ba9-a157-c641a52aed0a was qcow2, converting to raw {{(pid=74776) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 14:20:15 user nova-compute[74776]: DEBUG nova.privsep.utils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74776) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 14:20:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d829168599e52d2f9f6d1f32c392c0aaa6461b35.part /opt/stack/data/nova/instances/_base/d829168599e52d2f9f6d1f32c392c0aaa6461b35.converted {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:15 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:20:15 user nova-compute[74776]: INFO nova.compute.claims [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Claim successful on node user
Nov 22 14:20:15 user nova-compute[74776]: DEBUG nova.compute.manager [req-d1a63379-5a8f-4ba2-bc6e-e2f687d7685b req-e2c849c0-03ae-43f3-936b-60606899b733 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received event network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d1a63379-5a8f-4ba2-bc6e-e2f687d7685b req-e2c849c0-03ae-43f3-936b-60606899b733 service nova] Acquiring lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d1a63379-5a8f-4ba2-bc6e-e2f687d7685b req-e2c849c0-03ae-43f3-936b-60606899b733 service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d1a63379-5a8f-4ba2-bc6e-e2f687d7685b req-e2c849c0-03ae-43f3-936b-60606899b733 service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:15 user nova-compute[74776]: DEBUG nova.compute.manager [req-d1a63379-5a8f-4ba2-bc6e-e2f687d7685b req-e2c849c0-03ae-43f3-936b-60606899b733 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] No waiting events found dispatching network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:20:15 user nova-compute[74776]: WARNING nova.compute.manager [req-d1a63379-5a8f-4ba2-bc6e-e2f687d7685b req-e2c849c0-03ae-43f3-936b-60606899b733 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received unexpected event network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e for instance with vm_state active and task_state rescuing.
Nov 22 14:20:15 user nova-compute[74776]: INFO nova.compute.resource_tracker [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Updating resource usage from migration 707b0dc0-e28a-44c9-99f4-67d5ce9be5e5
Nov 22 14:20:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d829168599e52d2f9f6d1f32c392c0aaa6461b35.part /opt/stack/data/nova/instances/_base/d829168599e52d2f9f6d1f32c392c0aaa6461b35.converted" returned: 0 in 0.349s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d829168599e52d2f9f6d1f32c392c0aaa6461b35.converted --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d829168599e52d2f9f6d1f32c392c0aaa6461b35.converted --force-share --output=json" returned: 0 in 0.242s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "d829168599e52d2f9f6d1f32c392c0aaa6461b35" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.017s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "d829168599e52d2f9f6d1f32c392c0aaa6461b35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "d829168599e52d2f9f6d1f32c392c0aaa6461b35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d829168599e52d2f9f6d1f32c392c0aaa6461b35 --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.626s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:16 user nova-compute[74776]: INFO nova.compute.manager [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Migrating
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:20:16 user nova-compute[74776]: INFO nova.compute.rpcapi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d829168599e52d2f9f6d1f32c392c0aaa6461b35 --force-share --output=json" returned: 0 in 0.212s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d829168599e52d2f9f6d1f32c392c0aaa6461b35,backing_fmt=raw /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk.rescue {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquired lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.network.neutron [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d829168599e52d2f9f6d1f32c392c0aaa6461b35,backing_fmt=raw /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk.rescue" returned: 0 in 0.055s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "d829168599e52d2f9f6d1f32c392c0aaa6461b35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.objects.instance [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lazy-loading 'migration_context' on Instance uuid 98fb9b54-c428-4a48-b1ff-a976f971b764 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.objects.base [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Object Instance<98fb9b54-c428-4a48-b1ff-a976f971b764> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Start _get_guest_xml network_info=[{"id": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "address": "fa:16:3e:7c:6e:68", "network": {"id": "32c8e7a3-6995-4931-ad2d-e8c3eb351538", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "vif_mac": "fa:16:3e:7c:6e:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92fd48cf9c34eac867c14bf962c3a0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd255982-4c", "ovs_interfaceid": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'aaab0170-a4b9-4ba9-a157-c641a52aed0a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1fdadc66-7b22-4716-9b3d-ccd5d7dd38c3', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQPSRHFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '98fb9b54-c428-4a48-b1ff-a976f971b764', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1591527-945f-4c2c-ae44-f65709df6065', 'serial': 'b1591527-945f-4c2c-ae44-f65709df6065'}, 'boot_index': None, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.objects.instance [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lazy-loading 'resources' on Instance uuid 98fb9b54-c428-4a48-b1ff-a976f971b764 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.objects.base [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Object Instance<98fb9b54-c428-4a48-b1ff-a976f971b764> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.objects.instance [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lazy-loading 'numa_topology' on Instance uuid 98fb9b54-c428-4a48-b1ff-a976f971b764 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.objects.base [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Object Instance<98fb9b54-c428-4a48-b1ff-a976f971b764> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:16 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:20:16 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.objects.instance [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lazy-loading 'vcpu_model' on Instance uuid 98fb9b54-c428-4a48-b1ff-a976f971b764 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.objects.base [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Object Instance<98fb9b54-c428-4a48-b1ff-a976f971b764> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQPSRHFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:20:16 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:20:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:20:16 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:20:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:20:16 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:16 user nova-compute[74776]: INFO nova.compute.manager [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] instance snapshotting
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f97f73-a77c-479b-93e3-2c9117498c00]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = qQPSRHFt\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 22 14:20:16 user nova-compute[74776]: node.name = iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065
Nov 22 14:20:16 user nova-compute[74776]: node.tpgt = -1
Nov 22 14:20:16 user nova-compute[74776]: node.startup = automatic
Nov 22 14:20:16 user nova-compute[74776]: node.leading_login = No
Nov 22 14:20:16 user nova-compute[74776]: iface.iscsi_ifacename = default
Nov 22 14:20:16 user nova-compute[74776]: iface.net_ifacename = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.ipaddress = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.prefix_len = 0
Nov 22 14:20:16 user nova-compute[74776]: iface.hwaddress = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.transport_name = tcp
Nov 22 14:20:16 user nova-compute[74776]: iface.initiatorname = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.state = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.vlan_id = 0
Nov 22 14:20:16 user nova-compute[74776]: iface.vlan_priority = 0
Nov 22 14:20:16 user nova-compute[74776]: iface.vlan_state = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.iface_num = 0
Nov 22 14:20:16 user nova-compute[74776]: iface.mtu = 0
Nov 22 14:20:16 user nova-compute[74776]: iface.port = 0
Nov 22 14:20:16 user nova-compute[74776]: iface.bootproto = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.subnet_mask = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.gateway = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.dhcp_alt_client_id_state = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.dhcp_alt_client_id = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.dhcp_dns = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.dhcp_learn_iqn = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.dhcp_req_vendor_id_state = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.dhcp_vendor_id_state = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.dhcp_vendor_id = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.dhcp_slp_da = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.fragmentation = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.gratuitous_arp = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.incoming_forwarding = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.tos_state = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.tos = 0
Nov 22 14:20:16 user nova-compute[74776]: iface.ttl = 0
Nov 22 14:20:16 user nova-compute[74776]: iface.delayed_ack = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.tcp_nagle = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.tcp_wsf_state = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.tcp_wsf = 0
Nov 22 14:20:16 user nova-compute[74776]: iface.tcp_timer_scale = 0
Nov 22 14:20:16 user nova-compute[74776]: iface.tcp_timestamp = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.redirect = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.def_task_mgmt_timeout = 0
Nov 22 14:20:16 user nova-compute[74776]: iface.header_digest = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.data_digest = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.immediate_data = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.initial_r2t = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.data_seq_inorder = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.data_pdu_inorder = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.erl = 0
Nov 22 14:20:16 user nova-compute[74776]: iface.max_receive_data_len = 0
Nov 22 14:20:16 user nova-compute[74776]: iface.first_burst_len = 0
Nov 22 14:20:16 user nova-compute[74776]: iface.max_outstanding_r2t = 0
Nov 22 14:20:16 user nova-compute[74776]: iface.max_burst_len = 0
Nov 22 14:20:16 user nova-compute[74776]: iface.chap_auth = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.bidi_chap = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.strict_login_compliance = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.discovery_auth = <empty>
Nov 22 14:20:16 user nova-compute[74776]: iface.discovery_logout = <empty>
Nov 22 14:20:16 user nova-compute[74776]: node.discovery_address = <empty>
Nov 22 14:20:16 user nova-compute[74776]: node.discovery_port = 0
Nov 22 14:20:16 user nova-compute[74776]: node.discovery_type = static
Nov 22 14:20:16 user nova-compute[74776]: node.session.initial_cmdsn = 0
Nov 22 14:20:16 user nova-compute[74776]: node.session.initial_login_retry_max = 8
Nov 22 14:20:16 user nova-compute[74776]: node.session.xmit_thread_priority = -20
Nov 22 14:20:16 user nova-compute[74776]: node.session.cmds_max = 128
Nov 22 14:20:16 user nova-compute[74776]: node.session.queue_depth = 32
Nov 22 14:20:16 user nova-compute[74776]: node.session.nr_sessions = 1
Nov 22 14:20:16 user nova-compute[74776]: node.session.auth.authmethod = CHAP
Nov 22 14:20:16 user nova-compute[74776]: node.session.auth.username = qQPSRHFt
Nov 22 14:20:16 user nova-compute[74776]: node.session.auth.password = ***
Nov 22 14:20:16 user nova-compute[74776]: node.session.auth.username_in = <empty>
Nov 22 14:20:16 user nova-compute[74776]: node.session.auth.password_in = <empty>
Nov 22 14:20:16 user nova-compute[74776]: node.session.auth.chap_algs = MD5
Nov 22 14:20:16 user nova-compute[74776]: node.session.timeo.replacement_timeout = 120
Nov 22 14:20:16 user nova-compute[74776]: node.session.err_timeo.abort_timeout = 15
Nov 22 14:20:16 user nova-compute[74776]: node.session.err_timeo.lu_reset_timeout = 30
Nov 22 14:20:16 user nova-compute[74776]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 22 14:20:16 user nova-compute[74776]: node.session.err_timeo.host_reset_timeout = 60
Nov 22 14:20:16 user nova-compute[74776]: node.session.iscsi.FastAbort = Yes
Nov 22 14:20:16 user nova-compute[74776]: node.session.iscsi.InitialR2T = No
Nov 22 14:20:16 user nova-compute[74776]: node.session.iscsi.ImmediateData = Yes
Nov 22 14:20:16 user nova-compute[74776]: node.session.iscsi.FirstBurstLength = 262144
Nov 22 14:20:16 user nova-compute[74776]: node.session.iscsi.MaxBurstLength = 16776192
Nov 22 14:20:16 user nova-compute[74776]: node.session.iscsi.DefaultTime2Retain = 0
Nov 22 14:20:16 user nova-compute[74776]: node.session.iscsi.DefaultTime2Wait = 2
Nov 22 14:20:16 user nova-compute[74776]: node.session.iscsi.MaxConnections = 1
Nov 22 14:20:16 user nova-compute[74776]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 22 14:20:16 user nova-compute[74776]: node.session.iscsi.ERL = 0
Nov 22 14:20:16 user nova-compute[74776]: node.session.scan = manual
Nov 22 14:20:16 user nova-compute[74776]: node.session.reopen_max = 0
Nov 22 14:20:16 user nova-compute[74776]: node.conn[0].address = 172.16.0.220
Nov 22 14:20:16 user nova-compute[74776]: node.conn[0].port = 3260
Nov 22 14:20:16 user nova-compute[74776]: node.conn[0].startup = manual
Nov 22 14:20:16 user nova-compute[74776]: node.conn[0].tcp.window_size = 524288
Nov 22 14:20:16 user nova-compute[74776]: node.conn[0].tcp.type_of_service = 0
Nov 22 14:20:16 user nova-compute[74776]: node.conn[0].timeo.logout_timeout = 15
Nov 22 14:20:16 user nova-compute[74776]: node.conn[0].timeo.login_timeout = 15
Nov 22 14:20:16 user nova-compute[74776]: node.conn[0].timeo.auth_timeout = 45
Nov 22 14:20:16 user nova-compute[74776]: node.conn[0].timeo.noop_out_interval = 5
Nov 22 14:20:16 user nova-compute[74776]: node.conn[0].timeo.noop_out_timeout = 5
Nov 22 14:20:16 user nova-compute[74776]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 22 14:20:16 user nova-compute[74776]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 22 14:20:16 user nova-compute[74776]: node.conn[0].iscsi.HeaderDigest = None
Nov 22 14:20:16 user nova-compute[74776]: node.conn[0].iscsi.DataDigest = None
Nov 22 14:20:16 user nova-compute[74776]: node.conn[0].iscsi.IFMarker = No
Nov 22 14:20:16 user nova-compute[74776]: node.conn[0].iscsi.OFMarker = No
Nov 22 14:20:16 user nova-compute[74776]: # END RECORD
Nov 22 14:20:16 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d465b97-96aa-44e8-b7c6-10555af7f8ab]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f2c064-953c-48a4-98fb-61245bff75ac]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qQPSRHFt {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:16 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Beginning live snapshot process
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qQPSRHFt" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a69ee1-0f73-450d-a39a-45a19ba3dfd9]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qQPSRHFt'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea6065a-2b64-4cc4-90a7-c01dd49efabb]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ca8446-ed49-4baa-ae5c-0303e7a3559f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:20:16 user nova-compute[74776]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:20:16 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:20:16 user nova-compute[74776]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:20:16 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.166s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] HCTL ('33', '0', '0', 0) found on session 13 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a4e20d-da11-48bd-b552-be1bf4b505b3]: (4, ('0 0 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Searching for a device in session 13 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQPSRHFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.193s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] <== connect_volume: return (195ms) {'type': 'block', 'scsi_wwn': '23463323732356635', 'path': '/dev/sdb'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463323732356635', 'path': '/dev/sdb'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-804906559',display_name='tempest-ServerStableDeviceRescueTest-server-804906559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-804906559',id=4,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAszFWs96WQDQ4zYntrFAx3Zcw0snWwm1TTQJlxZEpXPnyU1gHlkBcEFtwU06oa8C/AZE8SlO743T94XNGt69XQf2jZZS+I5C2FccEUKDASTvZnvk1o9fr1Z+E+wPYuW1Q==',key_name='tempest-keypair-1870049157',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:16:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a92fd48cf9c34eac867c14bf962c3a0c',ramdisk_id='',reservation_id='r-s4c0loch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1477734383',owner_user_name='tempest-ServerStableDeviceRescueTest-1477734383-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:18:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='385e459f09fd41d4bba0ad13430dc0fd',uuid=98fb9b54-c428-4a48-b1ff-a976f971b764,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "address": "fa:16:3e:7c:6e:68", "network": {"id": "32c8e7a3-6995-4931-ad2d-e8c3eb351538", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "vif_mac": "fa:16:3e:7c:6e:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92fd48cf9c34eac867c14bf962c3a0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd255982-4c", "ovs_interfaceid": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Converting VIF {"id": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "address": "fa:16:3e:7c:6e:68", "network": {"id": "32c8e7a3-6995-4931-ad2d-e8c3eb351538", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "vif_mac": "fa:16:3e:7c:6e:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92fd48cf9c34eac867c14bf962c3a0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd255982-4c", "ovs_interfaceid": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:6e:68,bridge_name='br-int',has_traffic_filtering=True,id=dd255982-4c19-4bf3-b01c-ba063b6f561e,network=Network(32c8e7a3-6995-4931-ad2d-e8c3eb351538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd255982-4c') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.objects.instance [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lazy-loading 'pci_devices' on Instance uuid 98fb9b54-c428-4a48-b1ff-a976f971b764 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.objects.base [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Object Instance<98fb9b54-c428-4a48-b1ff-a976f971b764> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:20:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:20:16 user nova-compute[74776]:   <uuid>98fb9b54-c428-4a48-b1ff-a976f971b764</uuid>
Nov 22 14:20:16 user nova-compute[74776]:   <name>instance-00000004</name>
Nov 22 14:20:16 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:20:16 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:20:16 user nova-compute[74776]:   <metadata>
Nov 22 14:20:16 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:20:16 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:20:16 user nova-compute[74776]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-804906559</nova:name>
Nov 22 14:20:16 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:20:16</nova:creationTime>
Nov 22 14:20:16 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:20:16 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:20:16 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:20:16 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:20:16 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:20:16 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:20:16 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:20:16 user nova-compute[74776]:       <nova:owner>
Nov 22 14:20:16 user nova-compute[74776]:         <nova:user uuid="385e459f09fd41d4bba0ad13430dc0fd">tempest-ServerStableDeviceRescueTest-1477734383-project-member</nova:user>
Nov 22 14:20:16 user nova-compute[74776]:         <nova:project uuid="a92fd48cf9c34eac867c14bf962c3a0c">tempest-ServerStableDeviceRescueTest-1477734383</nova:project>
Nov 22 14:20:16 user nova-compute[74776]:       </nova:owner>
Nov 22 14:20:16 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:20:16 user nova-compute[74776]:       <nova:ports>
Nov 22 14:20:16 user nova-compute[74776]:         <nova:port uuid="dd255982-4c19-4bf3-b01c-ba063b6f561e">
Nov 22 14:20:16 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 14:20:16 user nova-compute[74776]:         </nova:port>
Nov 22 14:20:16 user nova-compute[74776]:       </nova:ports>
Nov 22 14:20:16 user nova-compute[74776]:     </nova:instance>
Nov 22 14:20:16 user nova-compute[74776]:   </metadata>
Nov 22 14:20:16 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:20:16 user nova-compute[74776]:     <system>
Nov 22 14:20:16 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:20:16 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:20:16 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:20:16 user nova-compute[74776]:       <entry name="serial">98fb9b54-c428-4a48-b1ff-a976f971b764</entry>
Nov 22 14:20:16 user nova-compute[74776]:       <entry name="uuid">98fb9b54-c428-4a48-b1ff-a976f971b764</entry>
Nov 22 14:20:16 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:20:16 user nova-compute[74776]:     </system>
Nov 22 14:20:16 user nova-compute[74776]:   </sysinfo>
Nov 22 14:20:16 user nova-compute[74776]:   <os>
Nov 22 14:20:16 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:20:16 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:20:16 user nova-compute[74776]:   </os>
Nov 22 14:20:16 user nova-compute[74776]:   <features>
Nov 22 14:20:16 user nova-compute[74776]:     <acpi/>
Nov 22 14:20:16 user nova-compute[74776]:     <apic/>
Nov 22 14:20:16 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:20:16 user nova-compute[74776]:   </features>
Nov 22 14:20:16 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:20:16 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:20:16 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:20:16 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:20:16 user nova-compute[74776]:   </clock>
Nov 22 14:20:16 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:20:16 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:20:16 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:20:16 user nova-compute[74776]:   </cpu>
Nov 22 14:20:16 user nova-compute[74776]:   <devices>
Nov 22 14:20:16 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:20:16 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:20:16 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk"/>
Nov 22 14:20:16 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:20:16 user nova-compute[74776]:     </disk>
Nov 22 14:20:16 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:20:16 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:20:16 user nova-compute[74776]:       <source dev="/dev/sdb"/>
Nov 22 14:20:16 user nova-compute[74776]:       <target dev="vdb" bus="virtio"/>
Nov 22 14:20:16 user nova-compute[74776]:       <serial>b1591527-945f-4c2c-ae44-f65709df6065</serial>
Nov 22 14:20:16 user nova-compute[74776]:     </disk>
Nov 22 14:20:16 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:20:16 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:20:16 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk.rescue"/>
Nov 22 14:20:16 user nova-compute[74776]:       <target dev="vdc" bus="virtio"/>
Nov 22 14:20:16 user nova-compute[74776]:       <boot order="1"/>
Nov 22 14:20:16 user nova-compute[74776]:     </disk>
Nov 22 14:20:16 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:20:16 user nova-compute[74776]:       <mac address="fa:16:3e:7c:6e:68"/>
Nov 22 14:20:16 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:20:16 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:20:16 user nova-compute[74776]:       <target dev="tapdd255982-4c"/>
Nov 22 14:20:16 user nova-compute[74776]:     </interface>
Nov 22 14:20:16 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:20:16 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/console.log" append="off"/>
Nov 22 14:20:16 user nova-compute[74776]:     </serial>
Nov 22 14:20:16 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:20:16 user nova-compute[74776]:     <video>
Nov 22 14:20:16 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:20:16 user nova-compute[74776]:     </video>
Nov 22 14:20:16 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:20:16 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:20:16 user nova-compute[74776]:     </rng>
Nov 22 14:20:16 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:20:16 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:20:16 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:20:16 user nova-compute[74776]:     </memballoon>
Nov 22 14:20:16 user nova-compute[74776]:   </devices>
Nov 22 14:20:16 user nova-compute[74776]: </domain>
Nov 22 14:20:16 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:20:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json -f qcow2 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:17 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Instance destroyed successfully.
Nov 22 14:20:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:20:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:20:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:20:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] No VIF found with MAC fa:16:3e:7c:6e:68, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:20:17 user nova-compute[74776]: DEBUG nova.network.neutron [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Updating instance_info_cache with network_info: [{"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:20:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Releasing lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:20:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json -f qcow2" returned: 0 in 0.248s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json -f qcow2 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Starting migrate_disk_and_power_off {{(pid=74776) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 22 14:20:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json -f qcow2" returned: 0 in 0.208s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.253s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjb7_8nl6/9c72af109a1e4c3fa4272a70d5001f89.delta 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjb7_8nl6/9c72af109a1e4c3fa4272a70d5001f89.delta 1073741824" returned: 0 in 0.065s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:17 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 22 14:20:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-e086e605-6140-4077-9984-fe6869e121c8 req-da3aea1a-ac8d-4470-af31-6c40621f1e6d service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received event network-vif-unplugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e086e605-6140-4077-9984-fe6869e121c8 req-da3aea1a-ac8d-4470-af31-6c40621f1e6d service nova] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e086e605-6140-4077-9984-fe6869e121c8 req-da3aea1a-ac8d-4470-af31-6c40621f1e6d service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e086e605-6140-4077-9984-fe6869e121c8 req-da3aea1a-ac8d-4470-af31-6c40621f1e6d service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-e086e605-6140-4077-9984-fe6869e121c8 req-da3aea1a-ac8d-4470-af31-6c40621f1e6d service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] No waiting events found dispatching network-vif-unplugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:20:17 user nova-compute[74776]: WARNING nova.compute.manager [req-e086e605-6140-4077-9984-fe6869e121c8 req-da3aea1a-ac8d-4470-af31-6c40621f1e6d service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received unexpected event network-vif-unplugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 for instance with vm_state active and task_state resize_migrating.
Nov 22 14:20:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] COPY block job progress, current cursor: 47841280 final cursor: 75563008 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:20:19 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Instance destroyed successfully.
Nov 22 14:20:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1644694208',display_name='tempest-ServerActionsTestOtherB-server-1644694208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1644694208',id=2,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNubZ7Gk5h0q4OD6Enksl8Cxk/zzd+sbOwMvtIBBZUt9W+DL2N76A0FAo5K8lTdtosYaw4CTfnxfM5nY6xMBLxjo0J1fnDDgRvxTybxKH1mCAazzdEjSajoOw371LIwgmw==',key_name='tempest-keypair-1933513143',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:16:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ba1b35da14434fa09c3331d9c44d63fb',ramdisk_id='',reservation_id='r-fmg969sn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1073417585',owner_user_name='tempest-ServerActionsTestOtherB-1073417585-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84f6a2d2d72f42f1ba0ee9b623a0a9ca',uuid=e96ab1bf-6f19-4e5f-b79d-f0266988090b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-588979287-network", "vif_mac": "fa:16:3e:b6:46:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Converting VIF {"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-588979287-network", "vif_mac": "fa:16:3e:b6:46:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:46:f7,bridge_name='br-int',has_traffic_filtering=True,id=5911a175-03ae-4ed9-8c40-fc54c69233b4,network=Network(1287337f-aeac-4c5f-a6f0-3af84b13c33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5911a175-03') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG os_vif [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:46:f7,bridge_name='br-int',has_traffic_filtering=True,id=5911a175-03ae-4ed9-8c40-fc54c69233b4,network=Network(1287337f-aeac-4c5f-a6f0-3af84b13c33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5911a175-03') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5911a175-03, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cdf47b0b-03ef-4c53-80aa-01c6dee1bb42) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:19 user nova-compute[74776]: INFO os_vif [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:46:f7,bridge_name='br-int',has_traffic_filtering=True,id=5911a175-03ae-4ed9-8c40-fc54c69233b4,network=Network(1287337f-aeac-4c5f-a6f0-3af84b13c33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5911a175-03')
Nov 22 14:20:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvAJsUuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:20:19 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:20:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2682c786-7eea-4cfc-88a7-098d8ab79824]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:20:19 user nova-compute[74776]: No targets found.
Nov 22 14:20:19 user nova-compute[74776]: iSNS:
Nov 22 14:20:19 user nova-compute[74776]: No targets found.
Nov 22 14:20:19 user nova-compute[74776]: STATIC:
Nov 22 14:20:19 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3
Nov 22 14:20:19 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:20:19 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:20:19 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065
Nov 22 14:20:19 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:20:19 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:20:19 user nova-compute[74776]: FIRMWARE:
Nov 22 14:20:19 user nova-compute[74776]: No targets found.
Nov 22 14:20:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:20:19 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:20:19 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bc763d-a627-40ea-9dca-868e2669784b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[083f070b-624b-4353-9dc9-2b351a12e8af]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:20:19 user nova-compute[74776]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:20:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:20:19 user nova-compute[74776]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:20:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c58610dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3'): ({'sdc'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Removing single pathed devices sdc {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[06355217-d9fd-4682-8bb2-b012749081c5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.036s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[12339497-4241-41c9-911a-bfd700c112bd]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Flushing IO for device /dev/sdc {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.027s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c07427-0879-49f0-9d18-198f82bcd3c8]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:20:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.065s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[427afc66-7e11-437e-80ee-a8c2c9a2dac5]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-df4c50cd-a4ff-4aa4-8a88-e2f84d12389b req-1d4d5201-b45e-47a7-aeb3-2cc89fc4b66f service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-df4c50cd-a4ff-4aa4-8a88-e2f84d12389b req-1d4d5201-b45e-47a7-aeb3-2cc89fc4b66f service nova] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-df4c50cd-a4ff-4aa4-8a88-e2f84d12389b req-1d4d5201-b45e-47a7-aeb3-2cc89fc4b66f service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-df4c50cd-a4ff-4aa4-8a88-e2f84d12389b req-1d4d5201-b45e-47a7-aeb3-2cc89fc4b66f service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-df4c50cd-a4ff-4aa4-8a88-e2f84d12389b req-1d4d5201-b45e-47a7-aeb3-2cc89fc4b66f service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] No waiting events found dispatching network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:20:20 user nova-compute[74776]: WARNING nova.compute.manager [req-df4c50cd-a4ff-4aa4-8a88-e2f84d12389b req-1d4d5201-b45e-47a7-aeb3-2cc89fc4b66f service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received unexpected event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 for instance with vm_state active and task_state resize_migrating.
Nov 22 14:20:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:20:20 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 22 14:20:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[135f7f2b-ba73-439b-93af-e9eb18bb87e4]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd7443b-4469-45b2-909d-dca8830d4a84]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260]
Nov 22 14:20:20 user nova-compute[74776]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260] successful.
Nov 22 14:20:20 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acfcf46-f464-416c-b2d6-f4dfc943fadf]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] <== disconnect_volume: return (398ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG nova.privsep.utils [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74776) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjb7_8nl6/9c72af109a1e4c3fa4272a70d5001f89.delta /opt/stack/data/nova/instances/snapshots/tmpjb7_8nl6/9c72af109a1e4c3fa4272a70d5001f89 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b_resize/disk /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjb7_8nl6/9c72af109a1e4c3fa4272a70d5001f89.delta /opt/stack/data/nova/instances/snapshots/tmpjb7_8nl6/9c72af109a1e4c3fa4272a70d5001f89" returned: 0 in 0.768s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:20 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Snapshot extracted, beginning image upload
Nov 22 14:20:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] CMD "cp -r /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b_resize/disk /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk" returned: 0 in 0.606s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b_resize/disk.info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk.info {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] CMD "cp -r /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b_resize/disk.info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk.info" returned: 0 in 0.038s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "525baf66-82cc-4e8d-a37a-c92c51d4673d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:21 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:20:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:20:21 user nova-compute[74776]: INFO nova.compute.claims [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Claim successful on node user
Nov 22 14:20:22 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG nova.compute.manager [req-8a5833a2-1c6f-4143-8a16-e0105d54fe6e req-9a4f00ac-fa51-40f5-a834-0418e5ce39e6 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received event network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8a5833a2-1c6f-4143-8a16-e0105d54fe6e req-9a4f00ac-fa51-40f5-a834-0418e5ce39e6 service nova] Acquiring lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8a5833a2-1c6f-4143-8a16-e0105d54fe6e req-9a4f00ac-fa51-40f5-a834-0418e5ce39e6 service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8a5833a2-1c6f-4143-8a16-e0105d54fe6e req-9a4f00ac-fa51-40f5-a834-0418e5ce39e6 service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG nova.compute.manager [req-8a5833a2-1c6f-4143-8a16-e0105d54fe6e req-9a4f00ac-fa51-40f5-a834-0418e5ce39e6 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] No waiting events found dispatching network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:20:22 user nova-compute[74776]: WARNING nova.compute.manager [req-8a5833a2-1c6f-4143-8a16-e0105d54fe6e req-9a4f00ac-fa51-40f5-a834-0418e5ce39e6 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received unexpected event network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e for instance with vm_state active and task_state rescuing.
Nov 22 14:20:22 user nova-compute[74776]: DEBUG nova.compute.manager [req-8a5833a2-1c6f-4143-8a16-e0105d54fe6e req-9a4f00ac-fa51-40f5-a834-0418e5ce39e6 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received event network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8a5833a2-1c6f-4143-8a16-e0105d54fe6e req-9a4f00ac-fa51-40f5-a834-0418e5ce39e6 service nova] Acquiring lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8a5833a2-1c6f-4143-8a16-e0105d54fe6e req-9a4f00ac-fa51-40f5-a834-0418e5ce39e6 service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8a5833a2-1c6f-4143-8a16-e0105d54fe6e req-9a4f00ac-fa51-40f5-a834-0418e5ce39e6 service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG nova.compute.manager [req-8a5833a2-1c6f-4143-8a16-e0105d54fe6e req-9a4f00ac-fa51-40f5-a834-0418e5ce39e6 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] No waiting events found dispatching network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:20:22 user nova-compute[74776]: WARNING nova.compute.manager [req-8a5833a2-1c6f-4143-8a16-e0105d54fe6e req-9a4f00ac-fa51-40f5-a834-0418e5ce39e6 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received unexpected event network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e for instance with vm_state active and task_state rescuing.
Nov 22 14:20:22 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.918s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG nova.network.neutron [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG nova.compute.manager [None req-92817b09-d029-418f-b8a3-2dbf4e6c96cb tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:20:22 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:20:22 user nova-compute[74776]: DEBUG nova.network.neutron [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Port 5911a175-03ae-4ed9-8c40-fc54c69233b4 binding to destination host user is already ACTIVE {{(pid=74776) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG nova.compute.manager [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG nova.policy [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd686d08dc36a49fa80192546c4f68940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f36a88fd7b403d9c2dd29bcd64aac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:20:22 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Creating image(s)
Nov 22 14:20:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "/opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "/opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "/opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:22 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:20:22 user nova-compute[74776]: INFO nova.compute.claims [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Claim successful on node user
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquired lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG nova.network.neutron [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.244s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.206s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk 1073741824" returned: 0 in 0.063s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.198s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Checking if we can resize image /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.658s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG nova.compute.manager [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG nova.network.neutron [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Updating instance_info_cache with network_info: [{"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG nova.compute.manager [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG nova.network.neutron [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Releasing lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:20:23 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:20:23 user nova-compute[74776]: DEBUG nova.compute.manager [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG nova.network.neutron [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Successfully created port: ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Cannot resize image /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Ensure instance console log exists: /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG nova.policy [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd686d08dc36a49fa80192546c4f68940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f36a88fd7b403d9c2dd29bcd64aac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG os_brick.utils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3950f55-69c3-4a71-917e-d421643751d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db87c59-ac1d-4d7a-a0d4-b445a6736da7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG nova.compute.manager [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:20:23 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Creating image(s)
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "/opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "/opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a05896-b3b6-4a78-aa11-a3605af6a552]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2955bbf3-e6eb-40b4-89ae-dbb690b056d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:20:23 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:20:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[66803a44-23ed-4e4a-a919-5f8d9ce1d9e7]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:20:23 user nova-compute[74776]: DEBUG os_brick.utils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] <== get_connector_properties: return (200ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.237s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.209s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk 1073741824" returned: 0 in 0.070s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG nova.network.neutron [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Successfully created port: c83b6599-820f-462a-bd26-af48014d7d7d {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.213s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG nova.network.neutron [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Successfully updated port: ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "refresh_cache-525baf66-82cc-4e8d-a37a-c92c51d4673d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquired lock "refresh_cache-525baf66-82cc-4e8d-a37a-c92c51d4673d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG nova.network.neutron [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Cannot resize image /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Ensure instance console log exists: /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-dc8a457c-831c-4fd0-a697-e6b2e4a1d34b req-0afeaa35-4d8c-4560-989f-c4f020b3e1c6 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received event network-changed-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-dc8a457c-831c-4fd0-a697-e6b2e4a1d34b req-0afeaa35-4d8c-4560-989f-c4f020b3e1c6 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Refreshing instance network info cache due to event network-changed-ac898a82-d482-4299-b86b-db6aacf8175a. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dc8a457c-831c-4fd0-a697-e6b2e4a1d34b req-0afeaa35-4d8c-4560-989f-c4f020b3e1c6 service nova] Acquiring lock "refresh_cache-525baf66-82cc-4e8d-a37a-c92c51d4673d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:20:24 user nova-compute[74776]: DEBUG nova.network.neutron [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.network.neutron [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Successfully updated port: c83b6599-820f-462a-bd26-af48014d7d7d {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "refresh_cache-6f2ce4b2-660c-431f-b951-c6ec5090ef7e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquired lock "refresh_cache-6f2ce4b2-660c-431f-b951-c6ec5090ef7e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.network.neutron [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-dd8565a1-48f2-4daa-8bd1-5719435f8328 req-1a42f5f9-d91c-4f7e-94f7-10894fce0db2 service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Received event network-changed-c83b6599-820f-462a-bd26-af48014d7d7d {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-dd8565a1-48f2-4daa-8bd1-5719435f8328 req-1a42f5f9-d91c-4f7e-94f7-10894fce0db2 service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Refreshing instance network info cache due to event network-changed-c83b6599-820f-462a-bd26-af48014d7d7d. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dd8565a1-48f2-4daa-8bd1-5719435f8328 req-1a42f5f9-d91c-4f7e-94f7-10894fce0db2 service nova] Acquiring lock "refresh_cache-6f2ce4b2-660c-431f-b951-c6ec5090ef7e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.network.neutron [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.network.neutron [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Updating instance_info_cache with network_info: [{"id": "ac898a82-d482-4299-b86b-db6aacf8175a", "address": "fa:16:3e:38:af:39", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac898a82-d4", "ovs_interfaceid": "ac898a82-d482-4299-b86b-db6aacf8175a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Releasing lock "refresh_cache-525baf66-82cc-4e8d-a37a-c92c51d4673d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Instance network_info: |[{"id": "ac898a82-d482-4299-b86b-db6aacf8175a", "address": "fa:16:3e:38:af:39", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac898a82-d4", "ovs_interfaceid": "ac898a82-d482-4299-b86b-db6aacf8175a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dc8a457c-831c-4fd0-a697-e6b2e4a1d34b req-0afeaa35-4d8c-4560-989f-c4f020b3e1c6 service nova] Acquired lock "refresh_cache-525baf66-82cc-4e8d-a37a-c92c51d4673d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.network.neutron [req-dc8a457c-831c-4fd0-a697-e6b2e4a1d34b req-0afeaa35-4d8c-4560-989f-c4f020b3e1c6 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Refreshing network info cache for port ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Start _get_guest_xml network_info=[{"id": "ac898a82-d482-4299-b86b-db6aacf8175a", "address": "fa:16:3e:38:af:39", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac898a82-d4", "ovs_interfaceid": "ac898a82-d482-4299-b86b-db6aacf8175a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:20:25 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:20:25 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:20:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-248863747',display_name='tempest-ServerRescueNegativeTestJSON-server-248863747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-248863747',id=14,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36f36a88fd7b403d9c2dd29bcd64aac6',ramdisk_id='',reservation_id='r-qlinlrt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1360515217',owner_user_name='tempest-ServerRescueNegativeTestJSON-1360515217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:20:23Z,user_data=None,user_id='d686d08dc36a49fa80192546c4f68940',uuid=525baf66-82cc-4e8d-a37a-c92c51d4673d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac898a82-d482-4299-b86b-db6aacf8175a", "address": "fa:16:3e:38:af:39", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac898a82-d4", "ovs_interfaceid": "ac898a82-d482-4299-b86b-db6aacf8175a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converting VIF {"id": "ac898a82-d482-4299-b86b-db6aacf8175a", "address": "fa:16:3e:38:af:39", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac898a82-d4", "ovs_interfaceid": "ac898a82-d482-4299-b86b-db6aacf8175a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:af:39,bridge_name='br-int',has_traffic_filtering=True,id=ac898a82-d482-4299-b86b-db6aacf8175a,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac898a82-d4') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.objects.instance [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'pci_devices' on Instance uuid 525baf66-82cc-4e8d-a37a-c92c51d4673d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:20:25 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Snapshot image upload complete
Nov 22 14:20:25 user nova-compute[74776]: INFO nova.compute.manager [None req-dc40cc46-1646-4d1f-bd51-f9a211a50236 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Took 8.80 seconds to snapshot the instance on the hypervisor.
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:20:25 user nova-compute[74776]:   <uuid>525baf66-82cc-4e8d-a37a-c92c51d4673d</uuid>
Nov 22 14:20:25 user nova-compute[74776]:   <name>instance-0000000e</name>
Nov 22 14:20:25 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:20:25 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:20:25 user nova-compute[74776]:   <metadata>
Nov 22 14:20:25 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:20:25 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:20:25 user nova-compute[74776]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-248863747</nova:name>
Nov 22 14:20:25 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:20:25</nova:creationTime>
Nov 22 14:20:25 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:20:25 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:20:25 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:20:25 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:20:25 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:20:25 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:20:25 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:20:25 user nova-compute[74776]:       <nova:owner>
Nov 22 14:20:25 user nova-compute[74776]:         <nova:user uuid="d686d08dc36a49fa80192546c4f68940">tempest-ServerRescueNegativeTestJSON-1360515217-project-member</nova:user>
Nov 22 14:20:25 user nova-compute[74776]:         <nova:project uuid="36f36a88fd7b403d9c2dd29bcd64aac6">tempest-ServerRescueNegativeTestJSON-1360515217</nova:project>
Nov 22 14:20:25 user nova-compute[74776]:       </nova:owner>
Nov 22 14:20:25 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:20:25 user nova-compute[74776]:       <nova:ports>
Nov 22 14:20:25 user nova-compute[74776]:         <nova:port uuid="ac898a82-d482-4299-b86b-db6aacf8175a">
Nov 22 14:20:25 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 14:20:25 user nova-compute[74776]:         </nova:port>
Nov 22 14:20:25 user nova-compute[74776]:       </nova:ports>
Nov 22 14:20:25 user nova-compute[74776]:     </nova:instance>
Nov 22 14:20:25 user nova-compute[74776]:   </metadata>
Nov 22 14:20:25 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:20:25 user nova-compute[74776]:     <system>
Nov 22 14:20:25 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:20:25 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:20:25 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:20:25 user nova-compute[74776]:       <entry name="serial">525baf66-82cc-4e8d-a37a-c92c51d4673d</entry>
Nov 22 14:20:25 user nova-compute[74776]:       <entry name="uuid">525baf66-82cc-4e8d-a37a-c92c51d4673d</entry>
Nov 22 14:20:25 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:20:25 user nova-compute[74776]:     </system>
Nov 22 14:20:25 user nova-compute[74776]:   </sysinfo>
Nov 22 14:20:25 user nova-compute[74776]:   <os>
Nov 22 14:20:25 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:20:25 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:20:25 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:20:25 user nova-compute[74776]:   </os>
Nov 22 14:20:25 user nova-compute[74776]:   <features>
Nov 22 14:20:25 user nova-compute[74776]:     <acpi/>
Nov 22 14:20:25 user nova-compute[74776]:     <apic/>
Nov 22 14:20:25 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:20:25 user nova-compute[74776]:   </features>
Nov 22 14:20:25 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:20:25 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:20:25 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:20:25 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:20:25 user nova-compute[74776]:   </clock>
Nov 22 14:20:25 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:20:25 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:20:25 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:20:25 user nova-compute[74776]:   </cpu>
Nov 22 14:20:25 user nova-compute[74776]:   <devices>
Nov 22 14:20:25 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:20:25 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:20:25 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk"/>
Nov 22 14:20:25 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:20:25 user nova-compute[74776]:     </disk>
Nov 22 14:20:25 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:20:25 user nova-compute[74776]:       <mac address="fa:16:3e:38:af:39"/>
Nov 22 14:20:25 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:20:25 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:20:25 user nova-compute[74776]:       <target dev="tapac898a82-d4"/>
Nov 22 14:20:25 user nova-compute[74776]:     </interface>
Nov 22 14:20:25 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:20:25 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/console.log" append="off"/>
Nov 22 14:20:25 user nova-compute[74776]:     </serial>
Nov 22 14:20:25 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:20:25 user nova-compute[74776]:     <video>
Nov 22 14:20:25 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:20:25 user nova-compute[74776]:     </video>
Nov 22 14:20:25 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:20:25 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:20:25 user nova-compute[74776]:     </rng>
Nov 22 14:20:25 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:20:25 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:20:25 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:20:25 user nova-compute[74776]:     </memballoon>
Nov 22 14:20:25 user nova-compute[74776]:   </devices>
Nov 22 14:20:25 user nova-compute[74776]: </domain>
Nov 22 14:20:25 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:20:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-248863747',display_name='tempest-ServerRescueNegativeTestJSON-server-248863747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-248863747',id=14,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36f36a88fd7b403d9c2dd29bcd64aac6',ramdisk_id='',reservation_id='r-qlinlrt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1360515217',owner_user_name='tempest-ServerRescueNegativeTestJSON-1360515217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:20:23Z,user_data=None,user_id='d686d08dc36a49fa80192546c4f68940',uuid=525baf66-82cc-4e8d-a37a-c92c51d4673d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac898a82-d482-4299-b86b-db6aacf8175a", "address": "fa:16:3e:38:af:39", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac898a82-d4", "ovs_interfaceid": "ac898a82-d482-4299-b86b-db6aacf8175a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converting VIF {"id": "ac898a82-d482-4299-b86b-db6aacf8175a", "address": "fa:16:3e:38:af:39", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac898a82-d4", "ovs_interfaceid": "ac898a82-d482-4299-b86b-db6aacf8175a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:af:39,bridge_name='br-int',has_traffic_filtering=True,id=ac898a82-d482-4299-b86b-db6aacf8175a,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac898a82-d4') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG os_vif [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:af:39,bridge_name='br-int',has_traffic_filtering=True,id=ac898a82-d482-4299-b86b-db6aacf8175a,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac898a82-d4') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a23632a-79ed-50c2-af3e-279d749020e9', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac898a82-d4, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac898a82-d4, col_values=(('qos', UUID('512580c2-c5af-4c84-86fc-8936b372415e')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac898a82-d4, col_values=(('external_ids', {'iface-id': 'ac898a82-d482-4299-b86b-db6aacf8175a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:af:39', 'vm-uuid': '525baf66-82cc-4e8d-a37a-c92c51d4673d'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:25 user nova-compute[74776]: INFO os_vif [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:af:39,bridge_name='br-int',has_traffic_filtering=True,id=ac898a82-d482-4299-b86b-db6aacf8175a,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac898a82-d4')
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] No VIF found with MAC fa:16:3e:38:af:39, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.network.neutron [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Updating instance_info_cache with network_info: [{"id": "c83b6599-820f-462a-bd26-af48014d7d7d", "address": "fa:16:3e:18:32:09", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b6599-82", "ovs_interfaceid": "c83b6599-820f-462a-bd26-af48014d7d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Releasing lock "refresh_cache-6f2ce4b2-660c-431f-b951-c6ec5090ef7e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.compute.manager [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Instance network_info: |[{"id": "c83b6599-820f-462a-bd26-af48014d7d7d", "address": "fa:16:3e:18:32:09", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b6599-82", "ovs_interfaceid": "c83b6599-820f-462a-bd26-af48014d7d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dd8565a1-48f2-4daa-8bd1-5719435f8328 req-1a42f5f9-d91c-4f7e-94f7-10894fce0db2 service nova] Acquired lock "refresh_cache-6f2ce4b2-660c-431f-b951-c6ec5090ef7e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.network.neutron [req-dd8565a1-48f2-4daa-8bd1-5719435f8328 req-1a42f5f9-d91c-4f7e-94f7-10894fce0db2 service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Refreshing network info cache for port c83b6599-820f-462a-bd26-af48014d7d7d {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Start _get_guest_xml network_info=[{"id": "c83b6599-820f-462a-bd26-af48014d7d7d", "address": "fa:16:3e:18:32:09", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b6599-82", "ovs_interfaceid": "c83b6599-820f-462a-bd26-af48014d7d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:20:25 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:20:25 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:20:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-143378724',display_name='tempest-ServerRescueNegativeTestJSON-server-143378724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-143378724',id=15,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36f36a88fd7b403d9c2dd29bcd64aac6',ramdisk_id='',reservation_id='r-mtmgdtqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1360515217',owner_user_name='tempest-ServerRescueNegativeTestJSON-1360515217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:20:24Z,user_data=None,user_id='d686d08dc36a49fa80192546c4f68940',uuid=6f2ce4b2-660c-431f-b951-c6ec5090ef7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c83b6599-820f-462a-bd26-af48014d7d7d", "address": "fa:16:3e:18:32:09", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b6599-82", "ovs_interfaceid": "c83b6599-820f-462a-bd26-af48014d7d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converting VIF {"id": "c83b6599-820f-462a-bd26-af48014d7d7d", "address": "fa:16:3e:18:32:09", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b6599-82", "ovs_interfaceid": "c83b6599-820f-462a-bd26-af48014d7d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:32:09,bridge_name='br-int',has_traffic_filtering=True,id=c83b6599-820f-462a-bd26-af48014d7d7d,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b6599-82') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.objects.instance [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f2ce4b2-660c-431f-b951-c6ec5090ef7e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:20:25 user nova-compute[74776]:   <uuid>6f2ce4b2-660c-431f-b951-c6ec5090ef7e</uuid>
Nov 22 14:20:25 user nova-compute[74776]:   <name>instance-0000000f</name>
Nov 22 14:20:25 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:20:25 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:20:25 user nova-compute[74776]:   <metadata>
Nov 22 14:20:25 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:20:25 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:20:25 user nova-compute[74776]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-143378724</nova:name>
Nov 22 14:20:25 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:20:25</nova:creationTime>
Nov 22 14:20:25 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:20:25 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:20:25 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:20:25 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:20:25 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:20:25 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:20:25 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:20:25 user nova-compute[74776]:       <nova:owner>
Nov 22 14:20:25 user nova-compute[74776]:         <nova:user uuid="d686d08dc36a49fa80192546c4f68940">tempest-ServerRescueNegativeTestJSON-1360515217-project-member</nova:user>
Nov 22 14:20:25 user nova-compute[74776]:         <nova:project uuid="36f36a88fd7b403d9c2dd29bcd64aac6">tempest-ServerRescueNegativeTestJSON-1360515217</nova:project>
Nov 22 14:20:25 user nova-compute[74776]:       </nova:owner>
Nov 22 14:20:25 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:20:25 user nova-compute[74776]:       <nova:ports>
Nov 22 14:20:25 user nova-compute[74776]:         <nova:port uuid="c83b6599-820f-462a-bd26-af48014d7d7d">
Nov 22 14:20:25 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 14:20:25 user nova-compute[74776]:         </nova:port>
Nov 22 14:20:25 user nova-compute[74776]:       </nova:ports>
Nov 22 14:20:25 user nova-compute[74776]:     </nova:instance>
Nov 22 14:20:25 user nova-compute[74776]:   </metadata>
Nov 22 14:20:25 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:20:25 user nova-compute[74776]:     <system>
Nov 22 14:20:25 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:20:25 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:20:25 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:20:25 user nova-compute[74776]:       <entry name="serial">6f2ce4b2-660c-431f-b951-c6ec5090ef7e</entry>
Nov 22 14:20:25 user nova-compute[74776]:       <entry name="uuid">6f2ce4b2-660c-431f-b951-c6ec5090ef7e</entry>
Nov 22 14:20:25 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:20:25 user nova-compute[74776]:     </system>
Nov 22 14:20:25 user nova-compute[74776]:   </sysinfo>
Nov 22 14:20:25 user nova-compute[74776]:   <os>
Nov 22 14:20:25 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:20:25 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:20:25 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:20:25 user nova-compute[74776]:   </os>
Nov 22 14:20:25 user nova-compute[74776]:   <features>
Nov 22 14:20:25 user nova-compute[74776]:     <acpi/>
Nov 22 14:20:25 user nova-compute[74776]:     <apic/>
Nov 22 14:20:25 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:20:25 user nova-compute[74776]:   </features>
Nov 22 14:20:25 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:20:25 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:20:25 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:20:25 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:20:25 user nova-compute[74776]:   </clock>
Nov 22 14:20:25 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:20:25 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:20:25 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:20:25 user nova-compute[74776]:   </cpu>
Nov 22 14:20:25 user nova-compute[74776]:   <devices>
Nov 22 14:20:25 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:20:25 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:20:25 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk"/>
Nov 22 14:20:25 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:20:25 user nova-compute[74776]:     </disk>
Nov 22 14:20:25 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:20:25 user nova-compute[74776]:       <mac address="fa:16:3e:18:32:09"/>
Nov 22 14:20:25 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:20:25 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:20:25 user nova-compute[74776]:       <target dev="tapc83b6599-82"/>
Nov 22 14:20:25 user nova-compute[74776]:     </interface>
Nov 22 14:20:25 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:20:25 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/console.log" append="off"/>
Nov 22 14:20:25 user nova-compute[74776]:     </serial>
Nov 22 14:20:25 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:20:25 user nova-compute[74776]:     <video>
Nov 22 14:20:25 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:20:25 user nova-compute[74776]:     </video>
Nov 22 14:20:25 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:20:25 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:20:25 user nova-compute[74776]:     </rng>
Nov 22 14:20:25 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:20:25 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:20:25 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:20:25 user nova-compute[74776]:     </memballoon>
Nov 22 14:20:25 user nova-compute[74776]:   </devices>
Nov 22 14:20:25 user nova-compute[74776]: </domain>
Nov 22 14:20:25 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:20:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-143378724',display_name='tempest-ServerRescueNegativeTestJSON-server-143378724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-143378724',id=15,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36f36a88fd7b403d9c2dd29bcd64aac6',ramdisk_id='',reservation_id='r-mtmgdtqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1360515217',owner_user_name='tempest-ServerRescueNegativeTestJSON-1360515217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:20:24Z,user_data=None,user_id='d686d08dc36a49fa80192546c4f68940',uuid=6f2ce4b2-660c-431f-b951-c6ec5090ef7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c83b6599-820f-462a-bd26-af48014d7d7d", "address": "fa:16:3e:18:32:09", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b6599-82", "ovs_interfaceid": "c83b6599-820f-462a-bd26-af48014d7d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converting VIF {"id": "c83b6599-820f-462a-bd26-af48014d7d7d", "address": "fa:16:3e:18:32:09", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b6599-82", "ovs_interfaceid": "c83b6599-820f-462a-bd26-af48014d7d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:32:09,bridge_name='br-int',has_traffic_filtering=True,id=c83b6599-820f-462a-bd26-af48014d7d7d,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b6599-82') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG os_vif [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:32:09,bridge_name='br-int',has_traffic_filtering=True,id=c83b6599-820f-462a-bd26-af48014d7d7d,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b6599-82') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93f96f3e-9bd2-5a0b-9a15-a983e799e786', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc83b6599-82, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc83b6599-82, col_values=(('qos', UUID('5ef937a9-82f4-4ee6-b8af-018d257a3458')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc83b6599-82, col_values=(('external_ids', {'iface-id': 'c83b6599-820f-462a-bd26-af48014d7d7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:32:09', 'vm-uuid': '6f2ce4b2-660c-431f-b951-c6ec5090ef7e'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:25 user nova-compute[74776]: INFO os_vif [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:32:09,bridge_name='br-int',has_traffic_filtering=True,id=c83b6599-820f-462a-bd26-af48014d7d7d,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b6599-82')
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.network.neutron [req-dc8a457c-831c-4fd0-a697-e6b2e4a1d34b req-0afeaa35-4d8c-4560-989f-c4f020b3e1c6 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Updated VIF entry in instance network info cache for port ac898a82-d482-4299-b86b-db6aacf8175a. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.network.neutron [req-dc8a457c-831c-4fd0-a697-e6b2e4a1d34b req-0afeaa35-4d8c-4560-989f-c4f020b3e1c6 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Updating instance_info_cache with network_info: [{"id": "ac898a82-d482-4299-b86b-db6aacf8175a", "address": "fa:16:3e:38:af:39", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac898a82-d4", "ovs_interfaceid": "ac898a82-d482-4299-b86b-db6aacf8175a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dc8a457c-831c-4fd0-a697-e6b2e4a1d34b req-0afeaa35-4d8c-4560-989f-c4f020b3e1c6 service nova] Releasing lock "refresh_cache-525baf66-82cc-4e8d-a37a-c92c51d4673d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:20:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] No VIF found with MAC fa:16:3e:18:32:09, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:20:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:26 user nova-compute[74776]: DEBUG nova.network.neutron [req-dd8565a1-48f2-4daa-8bd1-5719435f8328 req-1a42f5f9-d91c-4f7e-94f7-10894fce0db2 service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Updated VIF entry in instance network info cache for port c83b6599-820f-462a-bd26-af48014d7d7d. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:20:26 user nova-compute[74776]: DEBUG nova.network.neutron [req-dd8565a1-48f2-4daa-8bd1-5719435f8328 req-1a42f5f9-d91c-4f7e-94f7-10894fce0db2 service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Updating instance_info_cache with network_info: [{"id": "c83b6599-820f-462a-bd26-af48014d7d7d", "address": "fa:16:3e:18:32:09", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b6599-82", "ovs_interfaceid": "c83b6599-820f-462a-bd26-af48014d7d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:20:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dd8565a1-48f2-4daa-8bd1-5719435f8328 req-1a42f5f9-d91c-4f7e-94f7-10894fce0db2 service nova] Releasing lock "refresh_cache-6f2ce4b2-660c-431f-b951-c6ec5090ef7e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:20:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:28 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:20:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:28 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:20:28 user nova-compute[74776]: INFO nova.compute.claims [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Claim successful on node user
Nov 22 14:20:28 user nova-compute[74776]: DEBUG nova.compute.manager [req-e482c71a-a06c-4475-b2ee-d19913fa0849 req-89ea3e0d-8e7b-4183-b2ea-5281b4d67ce8 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received event network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e482c71a-a06c-4475-b2ee-d19913fa0849 req-89ea3e0d-8e7b-4183-b2ea-5281b4d67ce8 service nova] Acquiring lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e482c71a-a06c-4475-b2ee-d19913fa0849 req-89ea3e0d-8e7b-4183-b2ea-5281b4d67ce8 service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e482c71a-a06c-4475-b2ee-d19913fa0849 req-89ea3e0d-8e7b-4183-b2ea-5281b4d67ce8 service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:28 user nova-compute[74776]: DEBUG nova.compute.manager [req-e482c71a-a06c-4475-b2ee-d19913fa0849 req-89ea3e0d-8e7b-4183-b2ea-5281b4d67ce8 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] No waiting events found dispatching network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:20:28 user nova-compute[74776]: WARNING nova.compute.manager [req-e482c71a-a06c-4475-b2ee-d19913fa0849 req-89ea3e0d-8e7b-4183-b2ea-5281b4d67ce8 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received unexpected event network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a for instance with vm_state building and task_state spawning.
Nov 22 14:20:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:28 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:20:29 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:20:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.911s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:29 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:20:29 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:20:29 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:20:29 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:20:29 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:20:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:29 user nova-compute[74776]: DEBUG nova.policy [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bdc62f686c7b496cb093b91dcd2d7e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396c01f7adaa4f2dbc6963bd855597f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:20:29 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:20:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:20:29 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Creating image(s)
Nov 22 14:20:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "/opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "/opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "/opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "765f2d1acf409d7bb1ca2b154aaeec1f40881f9b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "765f2d1acf409d7bb1ca2b154aaeec1f40881f9b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765f2d1acf409d7bb1ca2b154aaeec1f40881f9b.part --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:30 user nova-compute[74776]: DEBUG nova.compute.manager [req-1d188c0b-7f26-4994-b311-9921f265fb39 req-0f3a08c5-dedc-4380-ba51-fa52d4b08a77 service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Received event network-vif-plugged-c83b6599-820f-462a-bd26-af48014d7d7d {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1d188c0b-7f26-4994-b311-9921f265fb39 req-0f3a08c5-dedc-4380-ba51-fa52d4b08a77 service nova] Acquiring lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1d188c0b-7f26-4994-b311-9921f265fb39 req-0f3a08c5-dedc-4380-ba51-fa52d4b08a77 service nova] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1d188c0b-7f26-4994-b311-9921f265fb39 req-0f3a08c5-dedc-4380-ba51-fa52d4b08a77 service nova] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:30 user nova-compute[74776]: DEBUG nova.compute.manager [req-1d188c0b-7f26-4994-b311-9921f265fb39 req-0f3a08c5-dedc-4380-ba51-fa52d4b08a77 service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] No waiting events found dispatching network-vif-plugged-c83b6599-820f-462a-bd26-af48014d7d7d {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:20:30 user nova-compute[74776]: WARNING nova.compute.manager [req-1d188c0b-7f26-4994-b311-9921f265fb39 req-0f3a08c5-dedc-4380-ba51-fa52d4b08a77 service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Received unexpected event network-vif-plugged-c83b6599-820f-462a-bd26-af48014d7d7d for instance with vm_state building and task_state spawning.
Nov 22 14:20:30 user nova-compute[74776]: DEBUG nova.compute.manager [req-2280765b-e737-4d0e-93b7-eb19612f4a40 req-6ce93f9a-59d0-479f-b274-ea3344626882 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received event network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2280765b-e737-4d0e-93b7-eb19612f4a40 req-6ce93f9a-59d0-479f-b274-ea3344626882 service nova] Acquiring lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2280765b-e737-4d0e-93b7-eb19612f4a40 req-6ce93f9a-59d0-479f-b274-ea3344626882 service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2280765b-e737-4d0e-93b7-eb19612f4a40 req-6ce93f9a-59d0-479f-b274-ea3344626882 service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:30 user nova-compute[74776]: DEBUG nova.compute.manager [req-2280765b-e737-4d0e-93b7-eb19612f4a40 req-6ce93f9a-59d0-479f-b274-ea3344626882 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] No waiting events found dispatching network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:20:30 user nova-compute[74776]: WARNING nova.compute.manager [req-2280765b-e737-4d0e-93b7-eb19612f4a40 req-6ce93f9a-59d0-479f-b274-ea3344626882 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received unexpected event network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a for instance with vm_state building and task_state spawning.
Nov 22 14:20:30 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Successfully created port: bc0c53a4-0e99-4794-863a-3dd7e2fd6622 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:20:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765f2d1acf409d7bb1ca2b154aaeec1f40881f9b.part --force-share --output=json" returned: 0 in 0.239s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:30 user nova-compute[74776]: DEBUG nova.virt.images [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] 5160a80a-adc3-4180-83fe-466ff64d15be was qcow2, converting to raw {{(pid=74776) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 14:20:30 user nova-compute[74776]: DEBUG nova.privsep.utils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74776) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 14:20:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/765f2d1acf409d7bb1ca2b154aaeec1f40881f9b.part /opt/stack/data/nova/instances/_base/765f2d1acf409d7bb1ca2b154aaeec1f40881f9b.converted {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/765f2d1acf409d7bb1ca2b154aaeec1f40881f9b.part /opt/stack/data/nova/instances/_base/765f2d1acf409d7bb1ca2b154aaeec1f40881f9b.converted" returned: 0 in 0.360s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765f2d1acf409d7bb1ca2b154aaeec1f40881f9b.converted --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Starting finish_migration {{(pid=74776) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Instance directory exists: not creating {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 14:20:31 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Creating image(s)
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765f2d1acf409d7bb1ca2b154aaeec1f40881f9b.converted --force-share --output=json" returned: 0 in 0.237s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "765f2d1acf409d7bb1ca2b154aaeec1f40881f9b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.975s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765f2d1acf409d7bb1ca2b154aaeec1f40881f9b --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Successfully updated port: bc0c53a4-0e99-4794-863a-3dd7e2fd6622 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:20:31 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Instance spawned successfully.
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "refresh_cache-4246c1b7-6873-421a-ab2a-59dfb6adcb38" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquired lock "refresh_cache-4246c1b7-6873-421a-ab2a-59dfb6adcb38" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.195s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk. size=21474836480 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:20:31 user nova-compute[74776]: INFO nova.compute.manager [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Took 8.80 seconds to spawn the instance on the hypervisor.
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765f2d1acf409d7bb1ca2b154aaeec1f40881f9b --force-share --output=json" returned: 0 in 0.202s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "765f2d1acf409d7bb1ca2b154aaeec1f40881f9b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "765f2d1acf409d7bb1ca2b154aaeec1f40881f9b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765f2d1acf409d7bb1ca2b154aaeec1f40881f9b --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk 21474836480 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:31 user nova-compute[74776]: INFO nova.compute.manager [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Took 10.43 seconds to build instance.
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk 21474836480" returned: 0 in 0.082s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Did not create local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Ensure instance console log exists: /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Start _get_guest_xml network_info=[{"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-588979287-network", "vif_mac": "fa:16:3e:b6:46:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9cfeb5a2-d39e-401c-b882-2ddbb8125eaf', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvAJsUuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e96ab1bf-6f19-4e5f-b79d-f0266988090b', 'attached_at': '2023-11-22T14:20:31.000000', 'detached_at': '', 'volume_id': '80d952a7-ba34-425d-b34d-dbb03e3fb7e3', 'serial': '80d952a7-ba34-425d-b34d-dbb03e3fb7e3'}, 'boot_index': None, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca4797ec-f61e-4f7f-9edf-bc18b8759d50 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.563s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765f2d1acf409d7bb1ca2b154aaeec1f40881f9b --force-share --output=json" returned: 0 in 0.246s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765f2d1acf409d7bb1ca2b154aaeec1f40881f9b,backing_fmt=raw /opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-25b78186-0f5e-4e81-9f1d-857900f28dda req-bb2245f2-3e68-4f82-915b-a2ecbd296292 service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Received event network-vif-plugged-c83b6599-820f-462a-bd26-af48014d7d7d {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-25b78186-0f5e-4e81-9f1d-857900f28dda req-bb2245f2-3e68-4f82-915b-a2ecbd296292 service nova] Acquiring lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-25b78186-0f5e-4e81-9f1d-857900f28dda req-bb2245f2-3e68-4f82-915b-a2ecbd296292 service nova] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-25b78186-0f5e-4e81-9f1d-857900f28dda req-bb2245f2-3e68-4f82-915b-a2ecbd296292 service nova] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-25b78186-0f5e-4e81-9f1d-857900f28dda req-bb2245f2-3e68-4f82-915b-a2ecbd296292 service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] No waiting events found dispatching network-vif-plugged-c83b6599-820f-462a-bd26-af48014d7d7d {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:20:31 user nova-compute[74776]: WARNING nova.compute.manager [req-25b78186-0f5e-4e81-9f1d-857900f28dda req-bb2245f2-3e68-4f82-915b-a2ecbd296292 service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Received unexpected event network-vif-plugged-c83b6599-820f-462a-bd26-af48014d7d7d for instance with vm_state building and task_state spawning.
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-25b78186-0f5e-4e81-9f1d-857900f28dda req-bb2245f2-3e68-4f82-915b-a2ecbd296292 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Received event network-changed-bc0c53a4-0e99-4794-863a-3dd7e2fd6622 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-25b78186-0f5e-4e81-9f1d-857900f28dda req-bb2245f2-3e68-4f82-915b-a2ecbd296292 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Refreshing instance network info cache due to event network-changed-bc0c53a4-0e99-4794-863a-3dd7e2fd6622. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-25b78186-0f5e-4e81-9f1d-857900f28dda req-bb2245f2-3e68-4f82-915b-a2ecbd296292 service nova] Acquiring lock "refresh_cache-4246c1b7-6873-421a-ab2a-59dfb6adcb38" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765f2d1acf409d7bb1ca2b154aaeec1f40881f9b,backing_fmt=raw /opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38/disk 1073741824" returned: 0 in 0.085s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "765f2d1acf409d7bb1ca2b154aaeec1f40881f9b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765f2d1acf409d7bb1ca2b154aaeec1f40881f9b --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:31 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:20:31 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:20:31 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvAJsUuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:20:32 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:20:32 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:20:32 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.compute.manager [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:32 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Instance spawned successfully.
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Updating instance_info_cache with network_info: [{"id": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "address": "fa:16:3e:85:36:3e", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c53a4-0e", "ovs_interfaceid": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da3cf9f-d6d5-4436-b6ba-6390573223db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:20:32 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Releasing lock "refresh_cache-4246c1b7-6873-421a-ab2a-59dfb6adcb38" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Instance network_info: |[{"id": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "address": "fa:16:3e:85:36:3e", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c53a4-0e", "ovs_interfaceid": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-25b78186-0f5e-4e81-9f1d-857900f28dda req-bb2245f2-3e68-4f82-915b-a2ecbd296292 service nova] Acquired lock "refresh_cache-4246c1b7-6873-421a-ab2a-59dfb6adcb38" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.network.neutron [req-25b78186-0f5e-4e81-9f1d-857900f28dda req-bb2245f2-3e68-4f82-915b-a2ecbd296292 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Refreshing network info cache for port bc0c53a4-0e99-4794-863a-3dd7e2fd6622 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca46184f-57c5-4346-9bc0-2a8ba6a4218e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3] added
Nov 22 14:20:32 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[216ccd6f-5bb9-4ca2-bc6d-e03285b842b2]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765f2d1acf409d7bb1ca2b154aaeec1f40881f9b --force-share --output=json" returned: 0 in 0.228s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Ensure instance console log exists: /opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Start _get_guest_xml network_info=[{"id": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "address": "fa:16:3e:85:36:3e", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c53a4-0e", "ovs_interfaceid": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='a6c94aa0d63036535237e6b6f1098e83',container_format='bare',created_at=2023-11-22T14:20:16Z,direct_url=<?>,disk_format='qcow2',id=5160a80a-adc3-4180-83fe-466ff64d15be,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1272995928',owner='396c01f7adaa4f2dbc6963bd855597f3',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-22T14:20:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '5160a80a-adc3-4180-83fe-466ff64d15be'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[734adc50-0951-48ab-bc61-7b56f2b1b686]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvAJsUuN {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:32 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:20:32 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a6c94aa0d63036535237e6b6f1098e83',container_format='bare',created_at=2023-11-22T14:20:16Z,direct_url=<?>,disk_format='qcow2',id=5160a80a-adc3-4180-83fe-466ff64d15be,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1272995928',owner='396c01f7adaa4f2dbc6963bd855597f3',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-22T14:20:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:20:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-944267041',display_name='tempest-TestStampPattern-server-944267041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-944267041',id=16,image_ref='5160a80a-adc3-4180-83fe-466ff64d15be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwcdcEEHtV9OzSZWCbIN6wDgtlsxdHeeQue3/BMNcqHGBrCc/qx2sDq1Kmpv63TRxJ4I9ODFDrCABhThEkbpTezW8oRAjWlGjr+Las3LmrBBrpcK0n2dEwRuG9SNI1g0w==',key_name='tempest-TestStampPattern-1537282025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='396c01f7adaa4f2dbc6963bd855597f3',ramdisk_id='',reservation_id='r-ybe5z66g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='42b00137-df98-47d9-9d02-29b4707fed30',image_min_disk='1',image_min_ram='0',image_owner_id='396c01f7adaa4f2dbc6963bd855597f3',image_owner_project_name='tempest-TestStampPattern-19907094',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-19907094-project-member',image_user_id='bdc62f686c7b496cb093b91dcd2d7e02',network_allocated='True',owner_project_name='tempest-TestStampPattern-19907094',owner_user_name='tempest-TestStampPattern-19907094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:20:29Z,user_data=None,user_id='bdc62f686c7b496cb093b91dcd2d7e02',uuid=4246c1b7-6873-421a-ab2a-59dfb6adcb38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "address": "fa:16:3e:85:36:3e", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c53a4-0e", "ovs_interfaceid": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Converting VIF {"id": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "address": "fa:16:3e:85:36:3e", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c53a4-0e", "ovs_interfaceid": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:36:3e,bridge_name='br-int',has_traffic_filtering=True,id=bc0c53a4-0e99-4794-863a-3dd7e2fd6622,network=Network(d8fe5b03-bd5e-42d1-b634-8150f8a9f32b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc0c53a4-0e') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.objects.instance [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lazy-loading 'pci_devices' on Instance uuid 4246c1b7-6873-421a-ab2a-59dfb6adcb38 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvAJsUuN" returned: 0 in 0.027s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4572fc42-4395-4b54-bb4d-fc9d20a8f90c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZvAJsUuN'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:32 user nova-compute[74776]: INFO nova.compute.manager [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Took 8.36 seconds to spawn the instance on the hypervisor.
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.compute.manager [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:20:32 user nova-compute[74776]:   <uuid>4246c1b7-6873-421a-ab2a-59dfb6adcb38</uuid>
Nov 22 14:20:32 user nova-compute[74776]:   <name>instance-00000010</name>
Nov 22 14:20:32 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:20:32 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:20:32 user nova-compute[74776]:   <metadata>
Nov 22 14:20:32 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:20:32 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:20:32 user nova-compute[74776]:       <nova:name>tempest-TestStampPattern-server-944267041</nova:name>
Nov 22 14:20:32 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:20:32</nova:creationTime>
Nov 22 14:20:32 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:20:32 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:20:32 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:20:32 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:20:32 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:20:32 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:20:32 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:20:32 user nova-compute[74776]:       <nova:owner>
Nov 22 14:20:32 user nova-compute[74776]:         <nova:user uuid="bdc62f686c7b496cb093b91dcd2d7e02">tempest-TestStampPattern-19907094-project-member</nova:user>
Nov 22 14:20:32 user nova-compute[74776]:         <nova:project uuid="396c01f7adaa4f2dbc6963bd855597f3">tempest-TestStampPattern-19907094</nova:project>
Nov 22 14:20:32 user nova-compute[74776]:       </nova:owner>
Nov 22 14:20:32 user nova-compute[74776]:       <nova:root type="image" uuid="5160a80a-adc3-4180-83fe-466ff64d15be"/>
Nov 22 14:20:32 user nova-compute[74776]:       <nova:ports>
Nov 22 14:20:32 user nova-compute[74776]:         <nova:port uuid="bc0c53a4-0e99-4794-863a-3dd7e2fd6622">
Nov 22 14:20:32 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 14:20:32 user nova-compute[74776]:         </nova:port>
Nov 22 14:20:32 user nova-compute[74776]:       </nova:ports>
Nov 22 14:20:32 user nova-compute[74776]:     </nova:instance>
Nov 22 14:20:32 user nova-compute[74776]:   </metadata>
Nov 22 14:20:32 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:20:32 user nova-compute[74776]:     <system>
Nov 22 14:20:32 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:20:32 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:20:32 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:20:32 user nova-compute[74776]:       <entry name="serial">4246c1b7-6873-421a-ab2a-59dfb6adcb38</entry>
Nov 22 14:20:32 user nova-compute[74776]:       <entry name="uuid">4246c1b7-6873-421a-ab2a-59dfb6adcb38</entry>
Nov 22 14:20:32 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:20:32 user nova-compute[74776]:     </system>
Nov 22 14:20:32 user nova-compute[74776]:   </sysinfo>
Nov 22 14:20:32 user nova-compute[74776]:   <os>
Nov 22 14:20:32 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:20:32 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:20:32 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:20:32 user nova-compute[74776]:   </os>
Nov 22 14:20:32 user nova-compute[74776]:   <features>
Nov 22 14:20:32 user nova-compute[74776]:     <acpi/>
Nov 22 14:20:32 user nova-compute[74776]:     <apic/>
Nov 22 14:20:32 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:20:32 user nova-compute[74776]:   </features>
Nov 22 14:20:32 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:20:32 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:20:32 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:20:32 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:20:32 user nova-compute[74776]:   </clock>
Nov 22 14:20:32 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:20:32 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:20:32 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:20:32 user nova-compute[74776]:   </cpu>
Nov 22 14:20:32 user nova-compute[74776]:   <devices>
Nov 22 14:20:32 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:20:32 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:20:32 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38/disk"/>
Nov 22 14:20:32 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:20:32 user nova-compute[74776]:     </disk>
Nov 22 14:20:32 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:20:32 user nova-compute[74776]:       <mac address="fa:16:3e:85:36:3e"/>
Nov 22 14:20:32 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:20:32 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:20:32 user nova-compute[74776]:       <target dev="tapbc0c53a4-0e"/>
Nov 22 14:20:32 user nova-compute[74776]:     </interface>
Nov 22 14:20:32 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:20:32 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38/console.log" append="off"/>
Nov 22 14:20:32 user nova-compute[74776]:     </serial>
Nov 22 14:20:32 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:20:32 user nova-compute[74776]:     <video>
Nov 22 14:20:32 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:20:32 user nova-compute[74776]:     </video>
Nov 22 14:20:32 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:20:32 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:20:32 user nova-compute[74776]:     </rng>
Nov 22 14:20:32 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:20:32 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:20:32 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:20:32 user nova-compute[74776]:     </memballoon>
Nov 22 14:20:32 user nova-compute[74776]:   </devices>
Nov 22 14:20:32 user nova-compute[74776]: </domain>
Nov 22 14:20:32 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:20:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-944267041',display_name='tempest-TestStampPattern-server-944267041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-944267041',id=16,image_ref='5160a80a-adc3-4180-83fe-466ff64d15be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwcdcEEHtV9OzSZWCbIN6wDgtlsxdHeeQue3/BMNcqHGBrCc/qx2sDq1Kmpv63TRxJ4I9ODFDrCABhThEkbpTezW8oRAjWlGjr+Las3LmrBBrpcK0n2dEwRuG9SNI1g0w==',key_name='tempest-TestStampPattern-1537282025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='396c01f7adaa4f2dbc6963bd855597f3',ramdisk_id='',reservation_id='r-ybe5z66g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='42b00137-df98-47d9-9d02-29b4707fed30',image_min_disk='1',image_min_ram='0',image_owner_id='396c01f7adaa4f2dbc6963bd855597f3',image_owner_project_name='tempest-TestStampPattern-19907094',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-19907094-project-member',image_user_id='bdc62f686c7b496cb093b91dcd2d7e02',network_allocated='True',owner_project_name='tempest-TestStampPattern-19907094',owner_user_name='tempest-TestStampPattern-19907094-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:20:29Z,user_data=None,user_id='bdc62f686c7b496cb093b91dcd2d7e02',uuid=4246c1b7-6873-421a-ab2a-59dfb6adcb38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "address": "fa:16:3e:85:36:3e", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c53a4-0e", "ovs_interfaceid": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Converting VIF {"id": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "address": "fa:16:3e:85:36:3e", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c53a4-0e", "ovs_interfaceid": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:36:3e,bridge_name='br-int',has_traffic_filtering=True,id=bc0c53a4-0e99-4794-863a-3dd7e2fd6622,network=Network(d8fe5b03-bd5e-42d1-b634-8150f8a9f32b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc0c53a4-0e') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_vif [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:36:3e,bridge_name='br-int',has_traffic_filtering=True,id=bc0c53a4-0e99-4794-863a-3dd7e2fd6622,network=Network(d8fe5b03-bd5e-42d1-b634-8150f8a9f32b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc0c53a4-0e') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2d88fde-19c0-5cf5-bbcd-514ce3028fb3', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c816383-d303-4f54-87be-6aba928fe55f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc0c53a4-0e, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc0c53a4-0e, col_values=(('qos', UUID('32ee33a0-24e6-4f4f-98d7-62c0ff3189f8')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc0c53a4-0e, col_values=(('external_ids', {'iface-id': 'bc0c53a4-0e99-4794-863a-3dd7e2fd6622', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:36:3e', 'vm-uuid': '4246c1b7-6873-421a-ab2a-59dfb6adcb38'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:32 user nova-compute[74776]: INFO os_vif [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:36:3e,bridge_name='br-int',has_traffic_filtering=True,id=bc0c53a4-0e99-4794-863a-3dd7e2fd6622,network=Network(d8fe5b03-bd5e-42d1-b634-8150f8a9f32b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc0c53a4-0e')
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9941985b-981e-4f23-ba04-4393c385955a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:20:32 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:20:32 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:32 user nova-compute[74776]: INFO nova.compute.manager [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Took 9.46 seconds to build instance.
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-80662d50-fe85-4363-b5eb-77fac2df1433 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.686s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.114s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[16544611-4d64-425d-8065-874e5bb6f024]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260]
Nov 22 14:20:32 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260] successful.
Nov 22 14:20:32 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] No VIF found with MAC fa:16:3e:85:36:3e, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b290a850-40cd-4af4-a863-fe16fc44397c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4be5a88-0b5b-4e9e-b1c5-eb3c09f71152]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:20:32 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:20:32 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:20:32 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:20:32 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.452s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3764b7f-8072-4a72-9add-9a43e90f8eba]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvAJsUuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.network.neutron [req-25b78186-0f5e-4e81-9f1d-857900f28dda req-bb2245f2-3e68-4f82-915b-a2ecbd296292 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Updated VIF entry in instance network info cache for port bc0c53a4-0e99-4794-863a-3dd7e2fd6622. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG nova.network.neutron [req-25b78186-0f5e-4e81-9f1d-857900f28dda req-bb2245f2-3e68-4f82-915b-a2ecbd296292 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Updating instance_info_cache with network_info: [{"id": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "address": "fa:16:3e:85:36:3e", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c53a4-0e", "ovs_interfaceid": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:20:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-25b78186-0f5e-4e81-9f1d-857900f28dda req-bb2245f2-3e68-4f82-915b-a2ecbd296292 service nova] Releasing lock "refresh_cache-4246c1b7-6873-421a-ab2a-59dfb6adcb38" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.494s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] <== connect_volume: return (1496ms) {'type': 'block', 'scsi_wwn': '23562313333376336', 'path': '/dev/sdc'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562313333376336', 'path': '/dev/sdc'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1644694208',display_name='tempest-ServerActionsTestOtherB-server-1644694208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1644694208',id=2,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNubZ7Gk5h0q4OD6Enksl8Cxk/zzd+sbOwMvtIBBZUt9W+DL2N76A0FAo5K8lTdtosYaw4CTfnxfM5nY6xMBLxjo0J1fnDDgRvxTybxKH1mCAazzdEjSajoOw371LIwgmw==',key_name='tempest-keypair-1933513143',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:16:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ba1b35da14434fa09c3331d9c44d63fb',ramdisk_id='',reservation_id='r-fmg969sn',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1073417585',owner_user_name='tempest-ServerActionsTestOtherB-1073417585-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:20:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84f6a2d2d72f42f1ba0ee9b623a0a9ca',uuid=e96ab1bf-6f19-4e5f-b79d-f0266988090b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-588979287-network", "vif_mac": "fa:16:3e:b6:46:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Converting VIF {"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-588979287-network", "vif_mac": "fa:16:3e:b6:46:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:46:f7,bridge_name='br-int',has_traffic_filtering=True,id=5911a175-03ae-4ed9-8c40-fc54c69233b4,network=Network(1287337f-aeac-4c5f-a6f0-3af84b13c33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5911a175-03') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:20:33 user nova-compute[74776]:   <uuid>e96ab1bf-6f19-4e5f-b79d-f0266988090b</uuid>
Nov 22 14:20:33 user nova-compute[74776]:   <name>instance-00000002</name>
Nov 22 14:20:33 user nova-compute[74776]:   <memory>2097152</memory>
Nov 22 14:20:33 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:20:33 user nova-compute[74776]:   <metadata>
Nov 22 14:20:33 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:20:33 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:20:33 user nova-compute[74776]:       <nova:name>tempest-ServerActionsTestOtherB-server-1644694208</nova:name>
Nov 22 14:20:33 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:20:31</nova:creationTime>
Nov 22 14:20:33 user nova-compute[74776]:       <nova:flavor name="m1.small">
Nov 22 14:20:33 user nova-compute[74776]:         <nova:memory>2048</nova:memory>
Nov 22 14:20:33 user nova-compute[74776]:         <nova:disk>20</nova:disk>
Nov 22 14:20:33 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:20:33 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:20:33 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:20:33 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:20:33 user nova-compute[74776]:       <nova:owner>
Nov 22 14:20:33 user nova-compute[74776]:         <nova:user uuid="84f6a2d2d72f42f1ba0ee9b623a0a9ca">tempest-ServerActionsTestOtherB-1073417585-project-member</nova:user>
Nov 22 14:20:33 user nova-compute[74776]:         <nova:project uuid="ba1b35da14434fa09c3331d9c44d63fb">tempest-ServerActionsTestOtherB-1073417585</nova:project>
Nov 22 14:20:33 user nova-compute[74776]:       </nova:owner>
Nov 22 14:20:33 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:20:33 user nova-compute[74776]:       <nova:ports>
Nov 22 14:20:33 user nova-compute[74776]:         <nova:port uuid="5911a175-03ae-4ed9-8c40-fc54c69233b4">
Nov 22 14:20:33 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 22 14:20:33 user nova-compute[74776]:         </nova:port>
Nov 22 14:20:33 user nova-compute[74776]:       </nova:ports>
Nov 22 14:20:33 user nova-compute[74776]:     </nova:instance>
Nov 22 14:20:33 user nova-compute[74776]:   </metadata>
Nov 22 14:20:33 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:20:33 user nova-compute[74776]:     <system>
Nov 22 14:20:33 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:20:33 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:20:33 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:20:33 user nova-compute[74776]:       <entry name="serial">e96ab1bf-6f19-4e5f-b79d-f0266988090b</entry>
Nov 22 14:20:33 user nova-compute[74776]:       <entry name="uuid">e96ab1bf-6f19-4e5f-b79d-f0266988090b</entry>
Nov 22 14:20:33 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:20:33 user nova-compute[74776]:     </system>
Nov 22 14:20:33 user nova-compute[74776]:   </sysinfo>
Nov 22 14:20:33 user nova-compute[74776]:   <os>
Nov 22 14:20:33 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:20:33 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:20:33 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:20:33 user nova-compute[74776]:   </os>
Nov 22 14:20:33 user nova-compute[74776]:   <features>
Nov 22 14:20:33 user nova-compute[74776]:     <acpi/>
Nov 22 14:20:33 user nova-compute[74776]:     <apic/>
Nov 22 14:20:33 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:20:33 user nova-compute[74776]:   </features>
Nov 22 14:20:33 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:20:33 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:20:33 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:20:33 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:20:33 user nova-compute[74776]:   </clock>
Nov 22 14:20:33 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:20:33 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:20:33 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:20:33 user nova-compute[74776]:   </cpu>
Nov 22 14:20:33 user nova-compute[74776]:   <devices>
Nov 22 14:20:33 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:20:33 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:20:33 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk"/>
Nov 22 14:20:33 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:20:33 user nova-compute[74776]:     </disk>
Nov 22 14:20:33 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:20:33 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:20:33 user nova-compute[74776]:       <source dev="/dev/sdc"/>
Nov 22 14:20:33 user nova-compute[74776]:       <target dev="vdb" bus="virtio"/>
Nov 22 14:20:33 user nova-compute[74776]:       <serial>80d952a7-ba34-425d-b34d-dbb03e3fb7e3</serial>
Nov 22 14:20:33 user nova-compute[74776]:     </disk>
Nov 22 14:20:33 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:20:33 user nova-compute[74776]:       <mac address="fa:16:3e:b6:46:f7"/>
Nov 22 14:20:33 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:20:33 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:20:33 user nova-compute[74776]:       <target dev="tap5911a175-03"/>
Nov 22 14:20:33 user nova-compute[74776]:     </interface>
Nov 22 14:20:33 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:20:33 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/console.log" append="off"/>
Nov 22 14:20:33 user nova-compute[74776]:     </serial>
Nov 22 14:20:33 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:20:33 user nova-compute[74776]:     <video>
Nov 22 14:20:33 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:20:33 user nova-compute[74776]:     </video>
Nov 22 14:20:33 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:20:33 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:20:33 user nova-compute[74776]:     </rng>
Nov 22 14:20:33 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:20:33 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:20:33 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:20:33 user nova-compute[74776]:     </memballoon>
Nov 22 14:20:33 user nova-compute[74776]:   </devices>
Nov 22 14:20:33 user nova-compute[74776]: </domain>
Nov 22 14:20:33 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1644694208',display_name='tempest-ServerActionsTestOtherB-server-1644694208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1644694208',id=2,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNubZ7Gk5h0q4OD6Enksl8Cxk/zzd+sbOwMvtIBBZUt9W+DL2N76A0FAo5K8lTdtosYaw4CTfnxfM5nY6xMBLxjo0J1fnDDgRvxTybxKH1mCAazzdEjSajoOw371LIwgmw==',key_name='tempest-keypair-1933513143',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:16:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ba1b35da14434fa09c3331d9c44d63fb',ramdisk_id='',reservation_id='r-fmg969sn',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1073417585',owner_user_name='tempest-ServerActionsTestOtherB-1073417585-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:20:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84f6a2d2d72f42f1ba0ee9b623a0a9ca',uuid=e96ab1bf-6f19-4e5f-b79d-f0266988090b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-588979287-network", "vif_mac": "fa:16:3e:b6:46:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Converting VIF {"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-588979287-network", "vif_mac": "fa:16:3e:b6:46:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:46:f7,bridge_name='br-int',has_traffic_filtering=True,id=5911a175-03ae-4ed9-8c40-fc54c69233b4,network=Network(1287337f-aeac-4c5f-a6f0-3af84b13c33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5911a175-03') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG os_vif [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:46:f7,bridge_name='br-int',has_traffic_filtering=True,id=5911a175-03ae-4ed9-8c40-fc54c69233b4,network=Network(1287337f-aeac-4c5f-a6f0-3af84b13c33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5911a175-03') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c74d6a55-b22d-59ad-82db-70b347dcfa06', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5911a175-03, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5911a175-03, col_values=(('qos', UUID('126c78e7-c210-459e-88c1-73f0ad1358f1')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5911a175-03, col_values=(('external_ids', {'iface-id': '5911a175-03ae-4ed9-8c40-fc54c69233b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:46:f7', 'vm-uuid': 'e96ab1bf-6f19-4e5f-b79d-f0266988090b'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:33 user nova-compute[74776]: INFO os_vif [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:46:f7,bridge_name='br-int',has_traffic_filtering=True,id=5911a175-03ae-4ed9-8c40-fc54c69233b4,network=Network(1287337f-aeac-4c5f-a6f0-3af84b13c33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5911a175-03')
Nov 22 14:20:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:20:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] No VIF found with MAC fa:16:3e:b6:46:f7, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:20:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:34 user nova-compute[74776]: DEBUG nova.compute.manager [req-03573147-0987-4d27-8888-8428e077a0ca req-a05c379a-35c0-4839-a254-19d3096b64ad service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Received event network-vif-plugged-bc0c53a4-0e99-4794-863a-3dd7e2fd6622 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-03573147-0987-4d27-8888-8428e077a0ca req-a05c379a-35c0-4839-a254-19d3096b64ad service nova] Acquiring lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-03573147-0987-4d27-8888-8428e077a0ca req-a05c379a-35c0-4839-a254-19d3096b64ad service nova] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-03573147-0987-4d27-8888-8428e077a0ca req-a05c379a-35c0-4839-a254-19d3096b64ad service nova] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:34 user nova-compute[74776]: DEBUG nova.compute.manager [req-03573147-0987-4d27-8888-8428e077a0ca req-a05c379a-35c0-4839-a254-19d3096b64ad service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] No waiting events found dispatching network-vif-plugged-bc0c53a4-0e99-4794-863a-3dd7e2fd6622 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:20:34 user nova-compute[74776]: WARNING nova.compute.manager [req-03573147-0987-4d27-8888-8428e077a0ca req-a05c379a-35c0-4839-a254-19d3096b64ad service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Received unexpected event network-vif-plugged-bc0c53a4-0e99-4794-863a-3dd7e2fd6622 for instance with vm_state building and task_state spawning.
Nov 22 14:20:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:36 user nova-compute[74776]: DEBUG nova.compute.manager [req-eb82be04-fcb5-4090-ab2a-c463ad1181c9 req-e4d8b58e-1e53-4aee-adf2-8ee8ea2956de service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-eb82be04-fcb5-4090-ab2a-c463ad1181c9 req-e4d8b58e-1e53-4aee-adf2-8ee8ea2956de service nova] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-eb82be04-fcb5-4090-ab2a-c463ad1181c9 req-e4d8b58e-1e53-4aee-adf2-8ee8ea2956de service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-eb82be04-fcb5-4090-ab2a-c463ad1181c9 req-e4d8b58e-1e53-4aee-adf2-8ee8ea2956de service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:36 user nova-compute[74776]: DEBUG nova.compute.manager [req-eb82be04-fcb5-4090-ab2a-c463ad1181c9 req-e4d8b58e-1e53-4aee-adf2-8ee8ea2956de service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] No waiting events found dispatching network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:20:36 user nova-compute[74776]: WARNING nova.compute.manager [req-eb82be04-fcb5-4090-ab2a-c463ad1181c9 req-e4d8b58e-1e53-4aee-adf2-8ee8ea2956de service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received unexpected event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 for instance with vm_state active and task_state resize_finish.
Nov 22 14:20:36 user nova-compute[74776]: DEBUG nova.compute.manager [req-0bd80261-b0f5-4f0f-9346-a48efcba3793 req-72c97011-90dc-4f6f-b322-afd9fc77d5f4 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Received event network-vif-plugged-bc0c53a4-0e99-4794-863a-3dd7e2fd6622 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0bd80261-b0f5-4f0f-9346-a48efcba3793 req-72c97011-90dc-4f6f-b322-afd9fc77d5f4 service nova] Acquiring lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0bd80261-b0f5-4f0f-9346-a48efcba3793 req-72c97011-90dc-4f6f-b322-afd9fc77d5f4 service nova] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0bd80261-b0f5-4f0f-9346-a48efcba3793 req-72c97011-90dc-4f6f-b322-afd9fc77d5f4 service nova] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:36 user nova-compute[74776]: DEBUG nova.compute.manager [req-0bd80261-b0f5-4f0f-9346-a48efcba3793 req-72c97011-90dc-4f6f-b322-afd9fc77d5f4 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] No waiting events found dispatching network-vif-plugged-bc0c53a4-0e99-4794-863a-3dd7e2fd6622 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:20:36 user nova-compute[74776]: WARNING nova.compute.manager [req-0bd80261-b0f5-4f0f-9346-a48efcba3793 req-72c97011-90dc-4f6f-b322-afd9fc77d5f4 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Received unexpected event network-vif-plugged-bc0c53a4-0e99-4794-863a-3dd7e2fd6622 for instance with vm_state building and task_state spawning.
Nov 22 14:20:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:38 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:20:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:20:38 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Instance spawned successfully.
Nov 22 14:20:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:20:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:38 user nova-compute[74776]: INFO nova.compute.manager [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Took 8.91 seconds to spawn the instance on the hypervisor.
Nov 22 14:20:38 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:20:38 user nova-compute[74776]: DEBUG nova.compute.manager [req-b57aa944-d7f6-4df4-86e2-89fa9cb925db req-98141e6c-906a-43b1-b5a0-b18f3b7940b1 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b57aa944-d7f6-4df4-86e2-89fa9cb925db req-98141e6c-906a-43b1-b5a0-b18f3b7940b1 service nova] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b57aa944-d7f6-4df4-86e2-89fa9cb925db req-98141e6c-906a-43b1-b5a0-b18f3b7940b1 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b57aa944-d7f6-4df4-86e2-89fa9cb925db req-98141e6c-906a-43b1-b5a0-b18f3b7940b1 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:38 user nova-compute[74776]: DEBUG nova.compute.manager [req-b57aa944-d7f6-4df4-86e2-89fa9cb925db req-98141e6c-906a-43b1-b5a0-b18f3b7940b1 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] No waiting events found dispatching network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:20:38 user nova-compute[74776]: WARNING nova.compute.manager [req-b57aa944-d7f6-4df4-86e2-89fa9cb925db req-98141e6c-906a-43b1-b5a0-b18f3b7940b1 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received unexpected event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 for instance with vm_state active and task_state resize_finish.
Nov 22 14:20:38 user nova-compute[74776]: INFO nova.compute.manager [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Took 10.31 seconds to build instance.
Nov 22 14:20:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0aad9641-0e60-46ae-add1-060031a44f6f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.438s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:38 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:20:38 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Instance running successfully.
Nov 22 14:20:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Failed to set time: agent not configured {{(pid=74776) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 22 14:20:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ce5b6c91-3e5a-449b-89b0-bb819aeb6808 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] finish_migration finished successfully. {{(pid=74776) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 22 14:20:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "370f25d8-d6f4-4de8-b356-d23e6d599f82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:42 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:20:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:42 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:20:42 user nova-compute[74776]: INFO nova.compute.claims [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Claim successful on node user
Nov 22 14:20:43 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:20:43 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:20:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.634s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:43 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:20:43 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:20:43 user nova-compute[74776]: DEBUG nova.network.neutron [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:20:43 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:20:43 user nova-compute[74776]: DEBUG nova.policy [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1807bb240de749499809fd3dfb520d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee58d331979425eb9d48d2a52fc1f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:20:43 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:20:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:43 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:20:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:20:43 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Creating image(s)
Nov 22 14:20:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "/opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "/opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "/opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.276s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.250s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk 1073741824" returned: 0 in 0.081s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.341s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:44 user nova-compute[74776]: DEBUG nova.network.neutron [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Successfully created port: f8b7835a-016f-47b2-beee-46b3cb6f3391 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:20:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.226s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:44 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Checking if we can resize image /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:20:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:20:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:20:44 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Cannot resize image /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:20:44 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:20:44 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Ensure instance console log exists: /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:20:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.network.neutron [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Successfully updated port: f8b7835a-016f-47b2-beee-46b3cb6f3391 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "refresh_cache-370f25d8-d6f4-4de8-b356-d23e6d599f82" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquired lock "refresh_cache-370f25d8-d6f4-4de8-b356-d23e6d599f82" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.network.neutron [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.compute.manager [req-89a1863e-cdc6-406a-a4ce-20e1db7ca031 req-9c712647-3768-4471-900a-7fdc8797e282 service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Received event network-changed-f8b7835a-016f-47b2-beee-46b3cb6f3391 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.compute.manager [req-89a1863e-cdc6-406a-a4ce-20e1db7ca031 req-9c712647-3768-4471-900a-7fdc8797e282 service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Refreshing instance network info cache due to event network-changed-f8b7835a-016f-47b2-beee-46b3cb6f3391. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-89a1863e-cdc6-406a-a4ce-20e1db7ca031 req-9c712647-3768-4471-900a-7fdc8797e282 service nova] Acquiring lock "refresh_cache-370f25d8-d6f4-4de8-b356-d23e6d599f82" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.network.neutron [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.network.neutron [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Updating instance_info_cache with network_info: [{"id": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "address": "fa:16:3e:81:7b:fe", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b7835a-01", "ovs_interfaceid": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Releasing lock "refresh_cache-370f25d8-d6f4-4de8-b356-d23e6d599f82" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Instance network_info: |[{"id": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "address": "fa:16:3e:81:7b:fe", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b7835a-01", "ovs_interfaceid": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-89a1863e-cdc6-406a-a4ce-20e1db7ca031 req-9c712647-3768-4471-900a-7fdc8797e282 service nova] Acquired lock "refresh_cache-370f25d8-d6f4-4de8-b356-d23e6d599f82" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.network.neutron [req-89a1863e-cdc6-406a-a4ce-20e1db7ca031 req-9c712647-3768-4471-900a-7fdc8797e282 service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Refreshing network info cache for port f8b7835a-016f-47b2-beee-46b3cb6f3391 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Start _get_guest_xml network_info=[{"id": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "address": "fa:16:3e:81:7b:fe", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b7835a-01", "ovs_interfaceid": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:20:45 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:20:45 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1238762216',display_name='tempest-AttachVolumeNegativeTest-server-1238762216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1238762216',id=17,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjoRiEHaLOhNdxtIZ/d/tQ/DxPGxUEGZHPirmUVpCWjg2IoFMzlolqY3pLtCnZx1/h8VHGx4MxVWrsFandyObmXjC1QfG5Zx6tBd7ecWQXl5J52jFD5G/cx8Pm2b7HSHA==',key_name='tempest-keypair-143503295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dee58d331979425eb9d48d2a52fc1f68',ramdisk_id='',reservation_id='r-j04gnq22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-577275639',owner_user_name='tempest-AttachVolumeNegativeTest-577275639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1807bb240de749499809fd3dfb520d78',uuid=370f25d8-d6f4-4de8-b356-d23e6d599f82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "address": "fa:16:3e:81:7b:fe", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b7835a-01", "ovs_interfaceid": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converting VIF {"id": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "address": "fa:16:3e:81:7b:fe", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b7835a-01", "ovs_interfaceid": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:7b:fe,bridge_name='br-int',has_traffic_filtering=True,id=f8b7835a-016f-47b2-beee-46b3cb6f3391,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8b7835a-01') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.objects.instance [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lazy-loading 'pci_devices' on Instance uuid 370f25d8-d6f4-4de8-b356-d23e6d599f82 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:20:45 user nova-compute[74776]:   <uuid>370f25d8-d6f4-4de8-b356-d23e6d599f82</uuid>
Nov 22 14:20:45 user nova-compute[74776]:   <name>instance-00000011</name>
Nov 22 14:20:45 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:20:45 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:20:45 user nova-compute[74776]:   <metadata>
Nov 22 14:20:45 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:20:45 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:20:45 user nova-compute[74776]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1238762216</nova:name>
Nov 22 14:20:45 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:20:45</nova:creationTime>
Nov 22 14:20:45 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:20:45 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:20:45 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:20:45 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:20:45 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:20:45 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:20:45 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:20:45 user nova-compute[74776]:       <nova:owner>
Nov 22 14:20:45 user nova-compute[74776]:         <nova:user uuid="1807bb240de749499809fd3dfb520d78">tempest-AttachVolumeNegativeTest-577275639-project-member</nova:user>
Nov 22 14:20:45 user nova-compute[74776]:         <nova:project uuid="dee58d331979425eb9d48d2a52fc1f68">tempest-AttachVolumeNegativeTest-577275639</nova:project>
Nov 22 14:20:45 user nova-compute[74776]:       </nova:owner>
Nov 22 14:20:45 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:20:45 user nova-compute[74776]:       <nova:ports>
Nov 22 14:20:45 user nova-compute[74776]:         <nova:port uuid="f8b7835a-016f-47b2-beee-46b3cb6f3391">
Nov 22 14:20:45 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 14:20:45 user nova-compute[74776]:         </nova:port>
Nov 22 14:20:45 user nova-compute[74776]:       </nova:ports>
Nov 22 14:20:45 user nova-compute[74776]:     </nova:instance>
Nov 22 14:20:45 user nova-compute[74776]:   </metadata>
Nov 22 14:20:45 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:20:45 user nova-compute[74776]:     <system>
Nov 22 14:20:45 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:20:45 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:20:45 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:20:45 user nova-compute[74776]:       <entry name="serial">370f25d8-d6f4-4de8-b356-d23e6d599f82</entry>
Nov 22 14:20:45 user nova-compute[74776]:       <entry name="uuid">370f25d8-d6f4-4de8-b356-d23e6d599f82</entry>
Nov 22 14:20:45 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:20:45 user nova-compute[74776]:     </system>
Nov 22 14:20:45 user nova-compute[74776]:   </sysinfo>
Nov 22 14:20:45 user nova-compute[74776]:   <os>
Nov 22 14:20:45 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:20:45 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:20:45 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:20:45 user nova-compute[74776]:   </os>
Nov 22 14:20:45 user nova-compute[74776]:   <features>
Nov 22 14:20:45 user nova-compute[74776]:     <acpi/>
Nov 22 14:20:45 user nova-compute[74776]:     <apic/>
Nov 22 14:20:45 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:20:45 user nova-compute[74776]:   </features>
Nov 22 14:20:45 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:20:45 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:20:45 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:20:45 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:20:45 user nova-compute[74776]:   </clock>
Nov 22 14:20:45 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:20:45 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:20:45 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:20:45 user nova-compute[74776]:   </cpu>
Nov 22 14:20:45 user nova-compute[74776]:   <devices>
Nov 22 14:20:45 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:20:45 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:20:45 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk"/>
Nov 22 14:20:45 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:20:45 user nova-compute[74776]:     </disk>
Nov 22 14:20:45 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:20:45 user nova-compute[74776]:       <mac address="fa:16:3e:81:7b:fe"/>
Nov 22 14:20:45 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:20:45 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:20:45 user nova-compute[74776]:       <target dev="tapf8b7835a-01"/>
Nov 22 14:20:45 user nova-compute[74776]:     </interface>
Nov 22 14:20:45 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:20:45 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/console.log" append="off"/>
Nov 22 14:20:45 user nova-compute[74776]:     </serial>
Nov 22 14:20:45 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:20:45 user nova-compute[74776]:     <video>
Nov 22 14:20:45 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:20:45 user nova-compute[74776]:     </video>
Nov 22 14:20:45 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:20:45 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:20:45 user nova-compute[74776]:     </rng>
Nov 22 14:20:45 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:20:45 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:20:45 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:20:45 user nova-compute[74776]:     </memballoon>
Nov 22 14:20:45 user nova-compute[74776]:   </devices>
Nov 22 14:20:45 user nova-compute[74776]: </domain>
Nov 22 14:20:45 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1238762216',display_name='tempest-AttachVolumeNegativeTest-server-1238762216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1238762216',id=17,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjoRiEHaLOhNdxtIZ/d/tQ/DxPGxUEGZHPirmUVpCWjg2IoFMzlolqY3pLtCnZx1/h8VHGx4MxVWrsFandyObmXjC1QfG5Zx6tBd7ecWQXl5J52jFD5G/cx8Pm2b7HSHA==',key_name='tempest-keypair-143503295',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dee58d331979425eb9d48d2a52fc1f68',ramdisk_id='',reservation_id='r-j04gnq22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-577275639',owner_user_name='tempest-AttachVolumeNegativeTest-577275639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1807bb240de749499809fd3dfb520d78',uuid=370f25d8-d6f4-4de8-b356-d23e6d599f82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "address": "fa:16:3e:81:7b:fe", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b7835a-01", "ovs_interfaceid": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converting VIF {"id": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "address": "fa:16:3e:81:7b:fe", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b7835a-01", "ovs_interfaceid": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:7b:fe,bridge_name='br-int',has_traffic_filtering=True,id=f8b7835a-016f-47b2-beee-46b3cb6f3391,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8b7835a-01') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG os_vif [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:7b:fe,bridge_name='br-int',has_traffic_filtering=True,id=f8b7835a-016f-47b2-beee-46b3cb6f3391,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8b7835a-01') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5bd26635-a3d9-521c-a869-87a5e79b38f5', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:20:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8b7835a-01, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8b7835a-01, col_values=(('qos', UUID('3b70c55f-585d-4409-91de-cd20a5b25f67')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8b7835a-01, col_values=(('external_ids', {'iface-id': 'f8b7835a-016f-47b2-beee-46b3cb6f3391', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:7b:fe', 'vm-uuid': '370f25d8-d6f4-4de8-b356-d23e6d599f82'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:20:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:20:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:46 user nova-compute[74776]: INFO os_vif [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:7b:fe,bridge_name='br-int',has_traffic_filtering=True,id=f8b7835a-016f-47b2-beee-46b3cb6f3391,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8b7835a-01')
Nov 22 14:20:46 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:20:46 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] No VIF found with MAC fa:16:3e:81:7b:fe, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:20:46 user nova-compute[74776]: DEBUG nova.network.neutron [req-89a1863e-cdc6-406a-a4ce-20e1db7ca031 req-9c712647-3768-4471-900a-7fdc8797e282 service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Updated VIF entry in instance network info cache for port f8b7835a-016f-47b2-beee-46b3cb6f3391. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:20:46 user nova-compute[74776]: DEBUG nova.network.neutron [req-89a1863e-cdc6-406a-a4ce-20e1db7ca031 req-9c712647-3768-4471-900a-7fdc8797e282 service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Updating instance_info_cache with network_info: [{"id": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "address": "fa:16:3e:81:7b:fe", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b7835a-01", "ovs_interfaceid": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:20:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-89a1863e-cdc6-406a-a4ce-20e1db7ca031 req-9c712647-3768-4471-900a-7fdc8797e282 service nova] Releasing lock "refresh_cache-370f25d8-d6f4-4de8-b356-d23e6d599f82" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:20:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:48 user nova-compute[74776]: DEBUG nova.compute.manager [req-51b87e80-7e78-4c20-963a-2e83ca36c1f9 req-d520dbb1-f8d5-4154-b90c-0aa46e4c15b0 service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Received event network-vif-plugged-f8b7835a-016f-47b2-beee-46b3cb6f3391 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-51b87e80-7e78-4c20-963a-2e83ca36c1f9 req-d520dbb1-f8d5-4154-b90c-0aa46e4c15b0 service nova] Acquiring lock "370f25d8-d6f4-4de8-b356-d23e6d599f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-51b87e80-7e78-4c20-963a-2e83ca36c1f9 req-d520dbb1-f8d5-4154-b90c-0aa46e4c15b0 service nova] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-51b87e80-7e78-4c20-963a-2e83ca36c1f9 req-d520dbb1-f8d5-4154-b90c-0aa46e4c15b0 service nova] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:48 user nova-compute[74776]: DEBUG nova.compute.manager [req-51b87e80-7e78-4c20-963a-2e83ca36c1f9 req-d520dbb1-f8d5-4154-b90c-0aa46e4c15b0 service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] No waiting events found dispatching network-vif-plugged-f8b7835a-016f-47b2-beee-46b3cb6f3391 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:20:48 user nova-compute[74776]: WARNING nova.compute.manager [req-51b87e80-7e78-4c20-963a-2e83ca36c1f9 req-d520dbb1-f8d5-4154-b90c-0aa46e4c15b0 service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Received unexpected event network-vif-plugged-f8b7835a-016f-47b2-beee-46b3cb6f3391 for instance with vm_state building and task_state spawning.
Nov 22 14:20:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:49 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:20:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:20:49 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Instance spawned successfully.
Nov 22 14:20:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:20:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:20:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:50 user nova-compute[74776]: INFO nova.compute.manager [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Took 6.45 seconds to spawn the instance on the hypervisor.
Nov 22 14:20:50 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:20:50 user nova-compute[74776]: INFO nova.compute.manager [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Took 7.67 seconds to build instance.
Nov 22 14:20:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3e7c31ab-dc9f-4884-ba68-1b4e3c173ff7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.802s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-9beea606-954b-479b-abb8-703f31cb8154 req-760cb31b-7f48-432e-9c5d-a46115a43a02 service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Received event network-vif-plugged-f8b7835a-016f-47b2-beee-46b3cb6f3391 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:20:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9beea606-954b-479b-abb8-703f31cb8154 req-760cb31b-7f48-432e-9c5d-a46115a43a02 service nova] Acquiring lock "370f25d8-d6f4-4de8-b356-d23e6d599f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:20:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9beea606-954b-479b-abb8-703f31cb8154 req-760cb31b-7f48-432e-9c5d-a46115a43a02 service nova] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:20:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9beea606-954b-479b-abb8-703f31cb8154 req-760cb31b-7f48-432e-9c5d-a46115a43a02 service nova] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:20:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-9beea606-954b-479b-abb8-703f31cb8154 req-760cb31b-7f48-432e-9c5d-a46115a43a02 service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] No waiting events found dispatching network-vif-plugged-f8b7835a-016f-47b2-beee-46b3cb6f3391 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:20:50 user nova-compute[74776]: WARNING nova.compute.manager [req-9beea606-954b-479b-abb8-703f31cb8154 req-760cb31b-7f48-432e-9c5d-a46115a43a02 service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Received unexpected event network-vif-plugged-f8b7835a-016f-47b2-beee-46b3cb6f3391 for instance with vm_state active and task_state None.
Nov 22 14:20:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:20:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:06 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:21:06 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:21:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:21:06 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:21:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:21:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:21:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Acquiring lock "97fa95f1-f856-4b65-917f-9808bac6e576" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "97fa95f1-f856-4b65-917f-9808bac6e576" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:21:12 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:21:12 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:21:12 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=6953MB free_disk=25.093795776367188GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Applying migration context for instance e96ab1bf-6f19-4e5f-b79d-f0266988090b as it has an incoming, in-progress migration 707b0dc0-e28a-44c9-99f4-67d5ce9be5e5. Migration status is finished {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 22 14:21:12 user nova-compute[74776]: INFO nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Updating resource usage from migration 707b0dc0-e28a-44c9-99f4-67d5ce9be5e5
Nov 22 14:21:12 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4629d82d-fd02-4a58-a535-b362b493e7c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 98fb9b54-c428-4a48-b1ff-a976f971b764 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 25deabe8-8cfc-4d40-a734-755d4097baf5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 42b00137-df98-47d9-9d02-29b4707fed30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 913e1c5b-59ec-4d26-831e-dee562748839 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6dcf355f-759d-4a9a-9fb6-394e242c03e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance d7f3ff5e-292d-4e81-af58-b9a45adfbda1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Migration 707b0dc0-e28a-44c9-99f4-67d5ce9be5e5 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance e96ab1bf-6f19-4e5f-b79d-f0266988090b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 525baf66-82cc-4e8d-a37a-c92c51d4673d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6f2ce4b2-660c-431f-b951-c6ec5090ef7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4246c1b7-6873-421a-ab2a-59dfb6adcb38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 370f25d8-d6f4-4de8-b356-d23e6d599f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 97fa95f1-f856-4b65-917f-9808bac6e576 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:21:12 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:21:13 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:21:13 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:21:13 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:21:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.636s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:21:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.627s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:13 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:21:13 user nova-compute[74776]: INFO nova.compute.claims [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Claim successful on node user
Nov 22 14:21:13 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:21:13 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:21:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:21:13 user nova-compute[74776]: DEBUG nova.compute.manager [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:21:13 user nova-compute[74776]: DEBUG nova.compute.manager [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:21:13 user nova-compute[74776]: DEBUG nova.network.neutron [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:21:13 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:21:13 user nova-compute[74776]: DEBUG nova.compute.manager [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:21:13 user nova-compute[74776]: INFO nova.virt.block_device [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Booting with volume 9f6f309a-fb40-466e-af42-74fa8649a83f at /dev/vda
Nov 22 14:21:13 user nova-compute[74776]: DEBUG os_brick.utils [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:21:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[db41aeb9-1fb5-41d5-94b1-8d60d341571a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2009f1ce-603f-4b13-8b07-8086cde061a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG nova.policy [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a9bb1ba0806f4157873e2ef88d7c832f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722073efd41d4ff2a3354a6dd1f6093a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f13532e-9b8b-43c5-a84b-532e664c971c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[82336294-7c46-457d-8a78-b18402ecff50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:21:14 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad10018-e073-4594-91dd-771adcf57531]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG os_brick.utils [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Updating existing volume attachment record: 9809029f-2b8c-45ff-bd91-f2a016e912cb {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-25deabe8-8cfc-4d40-a734-755d4097baf5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-25deabe8-8cfc-4d40-a734-755d4097baf5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG nova.network.neutron [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Successfully created port: 2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Updating instance_info_cache with network_info: [{"id": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "address": "fa:16:3e:98:ce:04", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08471f51-9b", "ovs_interfaceid": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-25deabe8-8cfc-4d40-a734-755d4097baf5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:21:14 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:21:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:15 user nova-compute[74776]: DEBUG nova.network.neutron [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Successfully updated port: 2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:21:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Acquiring lock "refresh_cache-97fa95f1-f856-4b65-917f-9808bac6e576" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:21:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Acquired lock "refresh_cache-97fa95f1-f856-4b65-917f-9808bac6e576" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:21:15 user nova-compute[74776]: DEBUG nova.network.neutron [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:21:15 user nova-compute[74776]: DEBUG nova.compute.manager [req-65c0860c-c00d-4657-aedb-1fbc2db37a98 req-11d4fc3f-09e7-45c7-bf06-359be54e88b8 service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Received event network-changed-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:21:15 user nova-compute[74776]: DEBUG nova.compute.manager [req-65c0860c-c00d-4657-aedb-1fbc2db37a98 req-11d4fc3f-09e7-45c7-bf06-359be54e88b8 service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Refreshing instance network info cache due to event network-changed-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:21:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-65c0860c-c00d-4657-aedb-1fbc2db37a98 req-11d4fc3f-09e7-45c7-bf06-359be54e88b8 service nova] Acquiring lock "refresh_cache-97fa95f1-f856-4b65-917f-9808bac6e576" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:21:15 user nova-compute[74776]: DEBUG nova.network.neutron [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:21:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:16 user nova-compute[74776]: DEBUG nova.network.neutron [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Updating instance_info_cache with network_info: [{"id": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "address": "fa:16:3e:30:f8:d1", "network": {"id": "f55f24e7-af68-4a8b-af50-ff18023189dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717554397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722073efd41d4ff2a3354a6dd1f6093a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1e50d-19", "ovs_interfaceid": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:21:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Releasing lock "refresh_cache-97fa95f1-f856-4b65-917f-9808bac6e576" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:21:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Instance network_info: |[{"id": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "address": "fa:16:3e:30:f8:d1", "network": {"id": "f55f24e7-af68-4a8b-af50-ff18023189dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717554397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722073efd41d4ff2a3354a6dd1f6093a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1e50d-19", "ovs_interfaceid": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:21:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-65c0860c-c00d-4657-aedb-1fbc2db37a98 req-11d4fc3f-09e7-45c7-bf06-359be54e88b8 service nova] Acquired lock "refresh_cache-97fa95f1-f856-4b65-917f-9808bac6e576" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:21:16 user nova-compute[74776]: DEBUG nova.network.neutron [req-65c0860c-c00d-4657-aedb-1fbc2db37a98 req-11d4fc3f-09e7-45c7-bf06-359be54e88b8 service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Refreshing network info cache for port 2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:21:16 user nova-compute[74776]: DEBUG nova.network.neutron [req-65c0860c-c00d-4657-aedb-1fbc2db37a98 req-11d4fc3f-09e7-45c7-bf06-359be54e88b8 service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Updated VIF entry in instance network info cache for port 2ce1e50d-19f9-474c-9f47-2dc4eca12fb4. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:21:16 user nova-compute[74776]: DEBUG nova.network.neutron [req-65c0860c-c00d-4657-aedb-1fbc2db37a98 req-11d4fc3f-09e7-45c7-bf06-359be54e88b8 service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Updating instance_info_cache with network_info: [{"id": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "address": "fa:16:3e:30:f8:d1", "network": {"id": "f55f24e7-af68-4a8b-af50-ff18023189dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717554397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722073efd41d4ff2a3354a6dd1f6093a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1e50d-19", "ovs_interfaceid": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:21:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-65c0860c-c00d-4657-aedb-1fbc2db37a98 req-11d4fc3f-09e7-45c7-bf06-359be54e88b8 service nova] Releasing lock "refresh_cache-97fa95f1-f856-4b65-917f-9808bac6e576" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:21:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.compute.manager [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:21:20 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Creating image(s)
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Did not create local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Ensure instance console log exists: /opt/stack/data/nova/instances/97fa95f1-f856-4b65-917f-9808bac6e576/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Start _get_guest_xml network_info=[{"id": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "address": "fa:16:3e:30:f8:d1", "network": {"id": "f55f24e7-af68-4a8b-af50-ff18023189dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717554397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722073efd41d4ff2a3354a6dd1f6093a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1e50d-19", "ovs_interfaceid": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9809029f-2b8c-45ff-bd91-f2a016e912cb', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uoiazveY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '97fa95f1-f856-4b65-917f-9808bac6e576', 'attached_at': '', 'detached_at': '', 'volume_id': '9f6f309a-fb40-466e-af42-74fa8649a83f', 'serial': '9f6f309a-fb40-466e-af42-74fa8649a83f'}, 'boot_index': 0, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:21:20 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:21:20 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uoiazveY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:21:20 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:21:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:21:20 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:21:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:21:20 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260" returned: 21 in 0.041s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ab2d46-fe2e-4bfa-8759-68147bf855da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:21:20 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf39531-e48f-4cb5-9025-bb9690f16502]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f] added
Nov 22 14:21:20 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68a87a6-8148-4b80-8e0b-51db2c543974]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d25d0e-835d-4118-ad0a-d89ba399b8a4]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uoiazveY {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uoiazveY" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bc3dff-0aca-4650-9b77-78427d185fe6]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uoiazveY'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.066s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8f1ecd-d86c-46a9-bd2d-db5fb49d06d3]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eceb33e-9fd3-453e-b697-01811f7d8d41]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:21:20 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:21:20 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:21:20 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:21:20 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4fc592-8ab8-480e-9537-7394a3329658]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f, portal: 172.16.0.220,3260]
Nov 22 14:21:20 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f, portal: 172.16.0.220,3260] successful.
Nov 22 14:21:20 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:21:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[51237b14-6966-4416-a125-cb0ad3079009]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:21:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[199debc3-792a-49fe-b6c6-8dea51463853]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:21:21 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:21:21 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:21:21 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:21:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:21:21 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:21:21 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:21:21 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:21:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:21:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:21:21 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:21:21 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:21:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbc10ea-3139-4027-ba54-223c1c98ae87]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:21 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:21:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uoiazveY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:21:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23162353131336333', 'path': '/dev/sdd'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162353131336333', 'path': '/dev/sdd'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-701035597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-701035597',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYkU/2rQfSqsHtxK4fuxV+C9ojLZCEgNPlys0mLUFyCMchJcZzHAHb+3FUbvc2xdk3gHibee1w4iVYXBMvTV3V9mrEhNV3Yx2m3WYA430lr+k5smV5pmrxj35fa4s3h8g==',key_name='tempest-keypair-1544757416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='722073efd41d4ff2a3354a6dd1f6093a',ramdisk_id='',reservation_id='r-4zg0peg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1866761054',owner_user_name='tempest-ServerActionsV293TestJSON-1866761054-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9bb1ba0806f4157873e2ef88d7c832f',uuid=97fa95f1-f856-4b65-917f-9808bac6e576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "address": "fa:16:3e:30:f8:d1", "network": {"id": "f55f24e7-af68-4a8b-af50-ff18023189dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717554397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722073efd41d4ff2a3354a6dd1f6093a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1e50d-19", "ovs_interfaceid": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Converting VIF {"id": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "address": "fa:16:3e:30:f8:d1", "network": {"id": "f55f24e7-af68-4a8b-af50-ff18023189dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717554397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722073efd41d4ff2a3354a6dd1f6093a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1e50d-19", "ovs_interfaceid": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:f8:d1,bridge_name='br-int',has_traffic_filtering=True,id=2ce1e50d-19f9-474c-9f47-2dc4eca12fb4,network=Network(f55f24e7-af68-4a8b-af50-ff18023189dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1e50d-19') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG nova.objects.instance [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lazy-loading 'pci_devices' on Instance uuid 97fa95f1-f856-4b65-917f-9808bac6e576 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:21:22 user nova-compute[74776]:   <uuid>97fa95f1-f856-4b65-917f-9808bac6e576</uuid>
Nov 22 14:21:22 user nova-compute[74776]:   <name>instance-00000012</name>
Nov 22 14:21:22 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:21:22 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:21:22 user nova-compute[74776]:   <metadata>
Nov 22 14:21:22 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:21:22 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:21:22 user nova-compute[74776]:       <nova:name>tempest-ServerActionsV293TestJSON-server-701035597</nova:name>
Nov 22 14:21:22 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:21:20</nova:creationTime>
Nov 22 14:21:22 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:21:22 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:21:22 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:21:22 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:21:22 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:21:22 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:21:22 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:21:22 user nova-compute[74776]:       <nova:owner>
Nov 22 14:21:22 user nova-compute[74776]:         <nova:user uuid="a9bb1ba0806f4157873e2ef88d7c832f">tempest-ServerActionsV293TestJSON-1866761054-project-member</nova:user>
Nov 22 14:21:22 user nova-compute[74776]:         <nova:project uuid="722073efd41d4ff2a3354a6dd1f6093a">tempest-ServerActionsV293TestJSON-1866761054</nova:project>
Nov 22 14:21:22 user nova-compute[74776]:       </nova:owner>
Nov 22 14:21:22 user nova-compute[74776]:       <nova:ports>
Nov 22 14:21:22 user nova-compute[74776]:         <nova:port uuid="2ce1e50d-19f9-474c-9f47-2dc4eca12fb4">
Nov 22 14:21:22 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 14:21:22 user nova-compute[74776]:         </nova:port>
Nov 22 14:21:22 user nova-compute[74776]:       </nova:ports>
Nov 22 14:21:22 user nova-compute[74776]:     </nova:instance>
Nov 22 14:21:22 user nova-compute[74776]:   </metadata>
Nov 22 14:21:22 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:21:22 user nova-compute[74776]:     <system>
Nov 22 14:21:22 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:21:22 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:21:22 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:21:22 user nova-compute[74776]:       <entry name="serial">97fa95f1-f856-4b65-917f-9808bac6e576</entry>
Nov 22 14:21:22 user nova-compute[74776]:       <entry name="uuid">97fa95f1-f856-4b65-917f-9808bac6e576</entry>
Nov 22 14:21:22 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:21:22 user nova-compute[74776]:     </system>
Nov 22 14:21:22 user nova-compute[74776]:   </sysinfo>
Nov 22 14:21:22 user nova-compute[74776]:   <os>
Nov 22 14:21:22 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:21:22 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:21:22 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:21:22 user nova-compute[74776]:   </os>
Nov 22 14:21:22 user nova-compute[74776]:   <features>
Nov 22 14:21:22 user nova-compute[74776]:     <acpi/>
Nov 22 14:21:22 user nova-compute[74776]:     <apic/>
Nov 22 14:21:22 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:21:22 user nova-compute[74776]:   </features>
Nov 22 14:21:22 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:21:22 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:21:22 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:21:22 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:21:22 user nova-compute[74776]:   </clock>
Nov 22 14:21:22 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:21:22 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:21:22 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:21:22 user nova-compute[74776]:   </cpu>
Nov 22 14:21:22 user nova-compute[74776]:   <devices>
Nov 22 14:21:22 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:21:22 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:21:22 user nova-compute[74776]:       <source dev="/dev/sdd"/>
Nov 22 14:21:22 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:21:22 user nova-compute[74776]:       <serial>9f6f309a-fb40-466e-af42-74fa8649a83f</serial>
Nov 22 14:21:22 user nova-compute[74776]:     </disk>
Nov 22 14:21:22 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:21:22 user nova-compute[74776]:       <mac address="fa:16:3e:30:f8:d1"/>
Nov 22 14:21:22 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:21:22 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:21:22 user nova-compute[74776]:       <target dev="tap2ce1e50d-19"/>
Nov 22 14:21:22 user nova-compute[74776]:     </interface>
Nov 22 14:21:22 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:21:22 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/97fa95f1-f856-4b65-917f-9808bac6e576/console.log" append="off"/>
Nov 22 14:21:22 user nova-compute[74776]:     </serial>
Nov 22 14:21:22 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:21:22 user nova-compute[74776]:     <video>
Nov 22 14:21:22 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:21:22 user nova-compute[74776]:     </video>
Nov 22 14:21:22 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:21:22 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:21:22 user nova-compute[74776]:     </rng>
Nov 22 14:21:22 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:21:22 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:21:22 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:21:22 user nova-compute[74776]:     </memballoon>
Nov 22 14:21:22 user nova-compute[74776]:   </devices>
Nov 22 14:21:22 user nova-compute[74776]: </domain>
Nov 22 14:21:22 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-701035597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-701035597',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYkU/2rQfSqsHtxK4fuxV+C9ojLZCEgNPlys0mLUFyCMchJcZzHAHb+3FUbvc2xdk3gHibee1w4iVYXBMvTV3V9mrEhNV3Yx2m3WYA430lr+k5smV5pmrxj35fa4s3h8g==',key_name='tempest-keypair-1544757416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='722073efd41d4ff2a3354a6dd1f6093a',ramdisk_id='',reservation_id='r-4zg0peg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1866761054',owner_user_name='tempest-ServerActionsV293TestJSON-1866761054-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9bb1ba0806f4157873e2ef88d7c832f',uuid=97fa95f1-f856-4b65-917f-9808bac6e576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "address": "fa:16:3e:30:f8:d1", "network": {"id": "f55f24e7-af68-4a8b-af50-ff18023189dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717554397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722073efd41d4ff2a3354a6dd1f6093a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1e50d-19", "ovs_interfaceid": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Converting VIF {"id": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "address": "fa:16:3e:30:f8:d1", "network": {"id": "f55f24e7-af68-4a8b-af50-ff18023189dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717554397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722073efd41d4ff2a3354a6dd1f6093a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1e50d-19", "ovs_interfaceid": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:f8:d1,bridge_name='br-int',has_traffic_filtering=True,id=2ce1e50d-19f9-474c-9f47-2dc4eca12fb4,network=Network(f55f24e7-af68-4a8b-af50-ff18023189dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1e50d-19') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG os_vif [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:f8:d1,bridge_name='br-int',has_traffic_filtering=True,id=2ce1e50d-19f9-474c-9f47-2dc4eca12fb4,network=Network(f55f24e7-af68-4a8b-af50-ff18023189dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1e50d-19') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83112e88-6101-578d-ab30-e2a5360937b5', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ce1e50d-19, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ce1e50d-19, col_values=(('qos', UUID('579eb7c4-a1f1-44cd-808e-ca1515b6121d')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ce1e50d-19, col_values=(('external_ids', {'iface-id': '2ce1e50d-19f9-474c-9f47-2dc4eca12fb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:f8:d1', 'vm-uuid': '97fa95f1-f856-4b65-917f-9808bac6e576'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:22 user nova-compute[74776]: INFO os_vif [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:f8:d1,bridge_name='br-int',has_traffic_filtering=True,id=2ce1e50d-19f9-474c-9f47-2dc4eca12fb4,network=Network(f55f24e7-af68-4a8b-af50-ff18023189dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1e50d-19')
Nov 22 14:21:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:21:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] No VIF found with MAC fa:16:3e:30:f8:d1, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:21:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-184c4242-ffce-4d25-b4a3-8184cf437f4d req-cf6280f9-22db-44a6-8cd9-53a0cfc6da04 service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Received event network-vif-plugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:21:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-184c4242-ffce-4d25-b4a3-8184cf437f4d req-cf6280f9-22db-44a6-8cd9-53a0cfc6da04 service nova] Acquiring lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-184c4242-ffce-4d25-b4a3-8184cf437f4d req-cf6280f9-22db-44a6-8cd9-53a0cfc6da04 service nova] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-184c4242-ffce-4d25-b4a3-8184cf437f4d req-cf6280f9-22db-44a6-8cd9-53a0cfc6da04 service nova] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:21:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-184c4242-ffce-4d25-b4a3-8184cf437f4d req-cf6280f9-22db-44a6-8cd9-53a0cfc6da04 service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] No waiting events found dispatching network-vif-plugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:21:23 user nova-compute[74776]: WARNING nova.compute.manager [req-184c4242-ffce-4d25-b4a3-8184cf437f4d req-cf6280f9-22db-44a6-8cd9-53a0cfc6da04 service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Received unexpected event network-vif-plugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 for instance with vm_state building and task_state spawning.
Nov 22 14:21:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:25 user nova-compute[74776]: DEBUG nova.compute.manager [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:21:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:21:25 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Instance spawned successfully.
Nov 22 14:21:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:21:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:21:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:21:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:21:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:21:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:21:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:21:25 user nova-compute[74776]: INFO nova.compute.manager [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 22 14:21:25 user nova-compute[74776]: DEBUG nova.compute.manager [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:21:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-74297736-66ed-4d97-80e0-a2eb3f79ac85 req-be857807-f1a4-4b8d-b735-8fc0f9db33ad service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Received event network-vif-plugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:21:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-74297736-66ed-4d97-80e0-a2eb3f79ac85 req-be857807-f1a4-4b8d-b735-8fc0f9db33ad service nova] Acquiring lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-74297736-66ed-4d97-80e0-a2eb3f79ac85 req-be857807-f1a4-4b8d-b735-8fc0f9db33ad service nova] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-74297736-66ed-4d97-80e0-a2eb3f79ac85 req-be857807-f1a4-4b8d-b735-8fc0f9db33ad service nova] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:21:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-74297736-66ed-4d97-80e0-a2eb3f79ac85 req-be857807-f1a4-4b8d-b735-8fc0f9db33ad service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] No waiting events found dispatching network-vif-plugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:21:26 user nova-compute[74776]: WARNING nova.compute.manager [req-74297736-66ed-4d97-80e0-a2eb3f79ac85 req-be857807-f1a4-4b8d-b735-8fc0f9db33ad service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Received unexpected event network-vif-plugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 for instance with vm_state building and task_state spawning.
Nov 22 14:21:26 user nova-compute[74776]: INFO nova.compute.manager [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Took 13.49 seconds to build instance.
Nov 22 14:21:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e4f1d50-7bed-4831-9b0b-40a57c68ea0a tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "97fa95f1-f856-4b65-917f-9808bac6e576" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.995s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:21:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:28 user nova-compute[74776]: DEBUG nova.compute.manager [req-65f4fd70-cc77-422c-8edf-1081278e133f req-c67716e6-6044-4434-ac40-1b1422da74cb service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Received event network-changed-d13f9065-d7f3-4274-929f-3ac85db8bf73 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:21:28 user nova-compute[74776]: DEBUG nova.compute.manager [req-65f4fd70-cc77-422c-8edf-1081278e133f req-c67716e6-6044-4434-ac40-1b1422da74cb service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Refreshing instance network info cache due to event network-changed-d13f9065-d7f3-4274-929f-3ac85db8bf73. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:21:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-65f4fd70-cc77-422c-8edf-1081278e133f req-c67716e6-6044-4434-ac40-1b1422da74cb service nova] Acquiring lock "refresh_cache-6dcf355f-759d-4a9a-9fb6-394e242c03e4" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:21:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-65f4fd70-cc77-422c-8edf-1081278e133f req-c67716e6-6044-4434-ac40-1b1422da74cb service nova] Acquired lock "refresh_cache-6dcf355f-759d-4a9a-9fb6-394e242c03e4" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:21:28 user nova-compute[74776]: DEBUG nova.network.neutron [req-65f4fd70-cc77-422c-8edf-1081278e133f req-c67716e6-6044-4434-ac40-1b1422da74cb service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Refreshing network info cache for port d13f9065-d7f3-4274-929f-3ac85db8bf73 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "913e1c5b-59ec-4d26-831e-dee562748839" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "913e1c5b-59ec-4d26-831e-dee562748839" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "913e1c5b-59ec-4d26-831e-dee562748839-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "913e1c5b-59ec-4d26-831e-dee562748839-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "913e1c5b-59ec-4d26-831e-dee562748839-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:21:29 user nova-compute[74776]: INFO nova.compute.manager [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Terminating instance
Nov 22 14:21:29 user nova-compute[74776]: DEBUG nova.compute.manager [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquiring lock "interface-6dcf355f-759d-4a9a-9fb6-394e242c03e4-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "interface-6dcf355f-759d-4a9a-9fb6-394e242c03e4-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG nova.objects.instance [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lazy-loading 'flavor' on Instance uuid 6dcf355f-759d-4a9a-9fb6-394e242c03e4 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG nova.network.neutron [req-65f4fd70-cc77-422c-8edf-1081278e133f req-c67716e6-6044-4434-ac40-1b1422da74cb service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Updated VIF entry in instance network info cache for port d13f9065-d7f3-4274-929f-3ac85db8bf73. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG nova.network.neutron [req-65f4fd70-cc77-422c-8edf-1081278e133f req-c67716e6-6044-4434-ac40-1b1422da74cb service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Updating instance_info_cache with network_info: [{"id": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "address": "fa:16:3e:0f:a0:64", "network": {"id": "2fd2ca6a-6401-4865-99d6-647854bec84d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1799040535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13f9065-d7", "ovs_interfaceid": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG nova.compute.manager [req-ec415167-3441-4e1b-bf0e-b9cbe89f4451 req-4039be37-1bde-42b9-a24e-8bb2db724761 service nova] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Received event network-vif-unplugged-12ea19bb-0c98-4450-acb2-5acf20af9e66 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ec415167-3441-4e1b-bf0e-b9cbe89f4451 req-4039be37-1bde-42b9-a24e-8bb2db724761 service nova] Acquiring lock "913e1c5b-59ec-4d26-831e-dee562748839-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ec415167-3441-4e1b-bf0e-b9cbe89f4451 req-4039be37-1bde-42b9-a24e-8bb2db724761 service nova] Lock "913e1c5b-59ec-4d26-831e-dee562748839-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ec415167-3441-4e1b-bf0e-b9cbe89f4451 req-4039be37-1bde-42b9-a24e-8bb2db724761 service nova] Lock "913e1c5b-59ec-4d26-831e-dee562748839-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG nova.compute.manager [req-ec415167-3441-4e1b-bf0e-b9cbe89f4451 req-4039be37-1bde-42b9-a24e-8bb2db724761 service nova] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] No waiting events found dispatching network-vif-unplugged-12ea19bb-0c98-4450-acb2-5acf20af9e66 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG nova.compute.manager [req-ec415167-3441-4e1b-bf0e-b9cbe89f4451 req-4039be37-1bde-42b9-a24e-8bb2db724761 service nova] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Received event network-vif-unplugged-12ea19bb-0c98-4450-acb2-5acf20af9e66 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-65f4fd70-cc77-422c-8edf-1081278e133f req-c67716e6-6044-4434-ac40-1b1422da74cb service nova] Releasing lock "refresh_cache-6dcf355f-759d-4a9a-9fb6-394e242c03e4" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG nova.objects.instance [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lazy-loading 'pci_requests' on Instance uuid 6dcf355f-759d-4a9a-9fb6-394e242c03e4 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG nova.objects.base [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Object Instance<6dcf355f-759d-4a9a-9fb6-394e242c03e4> lazy-loaded attributes: flavor,pci_requests {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG nova.policy [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d173b822df3448bb49245f30afc0e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '027310982a0047d9a0d06c29b5b6e1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:21:29 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Instance destroyed successfully.
Nov 22 14:21:29 user nova-compute[74776]: DEBUG nova.objects.instance [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lazy-loading 'resources' on Instance uuid 913e1c5b-59ec-4d26-831e-dee562748839 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:19:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1646307772',display_name='tempest-VolumesAdminNegativeTest-server-1646307772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1646307772',id=11,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:19:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e84f31ee687a47558c74cf007bd17175',ramdisk_id='',reservation_id='r-82ukf107',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1815512001',owner_user_name='tempest-VolumesAdminNegativeTest-1815512001-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:19:38Z,user_data=None,user_id='3d30d915576746b0a9f38789a2e74f03',uuid=913e1c5b-59ec-4d26-831e-dee562748839,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12ea19bb-0c98-4450-acb2-5acf20af9e66", "address": "fa:16:3e:8d:5e:0a", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ea19bb-0c", "ovs_interfaceid": "12ea19bb-0c98-4450-acb2-5acf20af9e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Converting VIF {"id": "12ea19bb-0c98-4450-acb2-5acf20af9e66", "address": "fa:16:3e:8d:5e:0a", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12ea19bb-0c", "ovs_interfaceid": "12ea19bb-0c98-4450-acb2-5acf20af9e66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:5e:0a,bridge_name='br-int',has_traffic_filtering=True,id=12ea19bb-0c98-4450-acb2-5acf20af9e66,network=Network(59cbde16-cdcd-4761-9c50-b31b4f2387b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ea19bb-0c') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG os_vif [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:5e:0a,bridge_name='br-int',has_traffic_filtering=True,id=12ea19bb-0c98-4450-acb2-5acf20af9e66,network=Network(59cbde16-cdcd-4761-9c50-b31b4f2387b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ea19bb-0c') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12ea19bb-0c, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:21:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=94f7942a-782b-4428-a92e-42b8eb60d1cd) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:21:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:30 user nova-compute[74776]: INFO os_vif [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:5e:0a,bridge_name='br-int',has_traffic_filtering=True,id=12ea19bb-0c98-4450-acb2-5acf20af9e66,network=Network(59cbde16-cdcd-4761-9c50-b31b4f2387b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12ea19bb-0c')
Nov 22 14:21:30 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Deleting instance files /opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839_del
Nov 22 14:21:30 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Deletion of /opt/stack/data/nova/instances/913e1c5b-59ec-4d26-831e-dee562748839_del complete
Nov 22 14:21:30 user nova-compute[74776]: INFO nova.compute.manager [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 22 14:21:30 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:21:30 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:21:30 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:21:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:30 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:21:30 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Took 0.51 seconds to deallocate network for instance.
Nov 22 14:21:30 user nova-compute[74776]: DEBUG nova.compute.manager [req-7ff2d44a-471c-4953-a027-9f1bab66d4b0 req-1aeedab7-002f-4ccc-b6e4-912dc18a22eb service nova] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Received event network-vif-deleted-12ea19bb-0c98-4450-acb2-5acf20af9e66 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:21:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:30 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Successfully created port: b25ae5ba-034e-4c8f-b11a-570458c20dfe {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.482s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:21:31 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Deleted allocations for instance 913e1c5b-59ec-4d26-831e-dee562748839
Nov 22 14:21:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9390402d-e6cc-46d5-a74a-3b7d6ceb6c9d tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "913e1c5b-59ec-4d26-831e-dee562748839" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.253s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Successfully updated port: b25ae5ba-034e-4c8f-b11a-570458c20dfe {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquiring lock "refresh_cache-6dcf355f-759d-4a9a-9fb6-394e242c03e4" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquired lock "refresh_cache-6dcf355f-759d-4a9a-9fb6-394e242c03e4" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-9bd2a13f-b5a7-4b46-8df5-9984f4b5199c req-b0002843-b16f-4868-b094-398778868550 service nova] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Received event network-vif-plugged-12ea19bb-0c98-4450-acb2-5acf20af9e66 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9bd2a13f-b5a7-4b46-8df5-9984f4b5199c req-b0002843-b16f-4868-b094-398778868550 service nova] Acquiring lock "913e1c5b-59ec-4d26-831e-dee562748839-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9bd2a13f-b5a7-4b46-8df5-9984f4b5199c req-b0002843-b16f-4868-b094-398778868550 service nova] Lock "913e1c5b-59ec-4d26-831e-dee562748839-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9bd2a13f-b5a7-4b46-8df5-9984f4b5199c req-b0002843-b16f-4868-b094-398778868550 service nova] Lock "913e1c5b-59ec-4d26-831e-dee562748839-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-9bd2a13f-b5a7-4b46-8df5-9984f4b5199c req-b0002843-b16f-4868-b094-398778868550 service nova] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] No waiting events found dispatching network-vif-plugged-12ea19bb-0c98-4450-acb2-5acf20af9e66 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:21:31 user nova-compute[74776]: WARNING nova.compute.manager [req-9bd2a13f-b5a7-4b46-8df5-9984f4b5199c req-b0002843-b16f-4868-b094-398778868550 service nova] [instance: 913e1c5b-59ec-4d26-831e-dee562748839] Received unexpected event network-vif-plugged-12ea19bb-0c98-4450-acb2-5acf20af9e66 for instance with vm_state deleted and task_state None.
Nov 22 14:21:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-9bd2a13f-b5a7-4b46-8df5-9984f4b5199c req-b0002843-b16f-4868-b094-398778868550 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Received event network-changed-b25ae5ba-034e-4c8f-b11a-570458c20dfe {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-9bd2a13f-b5a7-4b46-8df5-9984f4b5199c req-b0002843-b16f-4868-b094-398778868550 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Refreshing instance network info cache due to event network-changed-b25ae5ba-034e-4c8f-b11a-570458c20dfe. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9bd2a13f-b5a7-4b46-8df5-9984f4b5199c req-b0002843-b16f-4868-b094-398778868550 service nova] Acquiring lock "refresh_cache-6dcf355f-759d-4a9a-9fb6-394e242c03e4" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Updating instance_info_cache with network_info: [{"id": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "address": "fa:16:3e:0f:a0:64", "network": {"id": "2fd2ca6a-6401-4865-99d6-647854bec84d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1799040535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13f9065-d7", "ovs_interfaceid": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b25ae5ba-034e-4c8f-b11a-570458c20dfe", "address": "fa:16:3e:7a:a2:a1", "network": {"id": "ac41ca40-21af-4bcd-a64f-afc65a8556f3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-121572572", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb25ae5ba-03", "ovs_interfaceid": "b25ae5ba-034e-4c8f-b11a-570458c20dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Releasing lock "refresh_cache-6dcf355f-759d-4a9a-9fb6-394e242c03e4" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9bd2a13f-b5a7-4b46-8df5-9984f4b5199c req-b0002843-b16f-4868-b094-398778868550 service nova] Acquired lock "refresh_cache-6dcf355f-759d-4a9a-9fb6-394e242c03e4" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG nova.network.neutron [req-9bd2a13f-b5a7-4b46-8df5-9984f4b5199c req-b0002843-b16f-4868-b094-398778868550 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Refreshing network info cache for port b25ae5ba-034e-4c8f-b11a-570458c20dfe {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1295290313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1295290313',id=12,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOi2wt6bwWC52YfMKFz0ZOdIihoSozV9972X7DtLjMCaPcI7UTCrW5QcIACFjc56Pj6b7cRSH9i47OvgkdTcAES+2IVEx2e8rM0Q9iF4eOSwA6MrKwoAcVhYd6C5lAkb1w==',key_name='tempest-keypair-973400344',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:19:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='027310982a0047d9a0d06c29b5b6e1f2',ramdisk_id='',reservation_id='r-n0ic6hqp',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2066916431',owner_user_name='tempest-TaggedAttachmentsTest-2066916431-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:19:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d173b822df3448bb49245f30afc0e17',uuid=6dcf355f-759d-4a9a-9fb6-394e242c03e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b25ae5ba-034e-4c8f-b11a-570458c20dfe", "address": "fa:16:3e:7a:a2:a1", "network": {"id": "ac41ca40-21af-4bcd-a64f-afc65a8556f3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-121572572", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb25ae5ba-03", "ovs_interfaceid": "b25ae5ba-034e-4c8f-b11a-570458c20dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Converting VIF {"id": "b25ae5ba-034e-4c8f-b11a-570458c20dfe", "address": "fa:16:3e:7a:a2:a1", "network": {"id": "ac41ca40-21af-4bcd-a64f-afc65a8556f3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-121572572", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb25ae5ba-03", "ovs_interfaceid": "b25ae5ba-034e-4c8f-b11a-570458c20dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a2:a1,bridge_name='br-int',has_traffic_filtering=True,id=b25ae5ba-034e-4c8f-b11a-570458c20dfe,network=Network(ac41ca40-21af-4bcd-a64f-afc65a8556f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb25ae5ba-03') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG os_vif [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a2:a1,bridge_name='br-int',has_traffic_filtering=True,id=b25ae5ba-034e-4c8f-b11a-570458c20dfe,network=Network(ac41ca40-21af-4bcd-a64f-afc65a8556f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb25ae5ba-03') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b51e9df-64d1-5489-a377-a543af11b5ea', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb25ae5ba-03, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb25ae5ba-03, col_values=(('qos', UUID('e4698bbc-ceb1-4ac3-9739-7fbc430c9cba')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb25ae5ba-03, col_values=(('external_ids', {'iface-id': 'b25ae5ba-034e-4c8f-b11a-570458c20dfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:a2:a1', 'vm-uuid': '6dcf355f-759d-4a9a-9fb6-394e242c03e4'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:21:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:31 user nova-compute[74776]: INFO os_vif [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a2:a1,bridge_name='br-int',has_traffic_filtering=True,id=b25ae5ba-034e-4c8f-b11a-570458c20dfe,network=Network(ac41ca40-21af-4bcd-a64f-afc65a8556f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb25ae5ba-03')
Nov 22 14:21:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1295290313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1295290313',id=12,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOi2wt6bwWC52YfMKFz0ZOdIihoSozV9972X7DtLjMCaPcI7UTCrW5QcIACFjc56Pj6b7cRSH9i47OvgkdTcAES+2IVEx2e8rM0Q9iF4eOSwA6MrKwoAcVhYd6C5lAkb1w==',key_name='tempest-keypair-973400344',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:19:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='027310982a0047d9a0d06c29b5b6e1f2',ramdisk_id='',reservation_id='r-n0ic6hqp',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2066916431',owner_user_name='tempest-TaggedAttachmentsTest-2066916431-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:19:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d173b822df3448bb49245f30afc0e17',uuid=6dcf355f-759d-4a9a-9fb6-394e242c03e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b25ae5ba-034e-4c8f-b11a-570458c20dfe", "address": "fa:16:3e:7a:a2:a1", "network": {"id": "ac41ca40-21af-4bcd-a64f-afc65a8556f3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-121572572", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb25ae5ba-03", "ovs_interfaceid": "b25ae5ba-034e-4c8f-b11a-570458c20dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Converting VIF {"id": "b25ae5ba-034e-4c8f-b11a-570458c20dfe", "address": "fa:16:3e:7a:a2:a1", "network": {"id": "ac41ca40-21af-4bcd-a64f-afc65a8556f3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-121572572", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb25ae5ba-03", "ovs_interfaceid": "b25ae5ba-034e-4c8f-b11a-570458c20dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a2:a1,bridge_name='br-int',has_traffic_filtering=True,id=b25ae5ba-034e-4c8f-b11a-570458c20dfe,network=Network(ac41ca40-21af-4bcd-a64f-afc65a8556f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb25ae5ba-03') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] attach device xml: <interface type="ethernet">
Nov 22 14:21:32 user nova-compute[74776]:   <mac address="fa:16:3e:7a:a2:a1"/>
Nov 22 14:21:32 user nova-compute[74776]:   <model type="virtio"/>
Nov 22 14:21:32 user nova-compute[74776]:   <mtu size="1442"/>
Nov 22 14:21:32 user nova-compute[74776]:   <target dev="tapb25ae5ba-03"/>
Nov 22 14:21:32 user nova-compute[74776]: </interface>
Nov 22 14:21:32 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] No BDM found with device name hda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] No VIF found with MAC fa:16:3e:0f:a0:64, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG nova.network.neutron [req-9bd2a13f-b5a7-4b46-8df5-9984f4b5199c req-b0002843-b16f-4868-b094-398778868550 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Updated VIF entry in instance network info cache for port b25ae5ba-034e-4c8f-b11a-570458c20dfe. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG nova.network.neutron [req-9bd2a13f-b5a7-4b46-8df5-9984f4b5199c req-b0002843-b16f-4868-b094-398778868550 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Updating instance_info_cache with network_info: [{"id": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "address": "fa:16:3e:0f:a0:64", "network": {"id": "2fd2ca6a-6401-4865-99d6-647854bec84d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1799040535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13f9065-d7", "ovs_interfaceid": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b25ae5ba-034e-4c8f-b11a-570458c20dfe", "address": "fa:16:3e:7a:a2:a1", "network": {"id": "ac41ca40-21af-4bcd-a64f-afc65a8556f3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-121572572", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb25ae5ba-03", "ovs_interfaceid": "b25ae5ba-034e-4c8f-b11a-570458c20dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9bd2a13f-b5a7-4b46-8df5-9984f4b5199c req-b0002843-b16f-4868-b094-398778868550 service nova] Releasing lock "refresh_cache-6dcf355f-759d-4a9a-9fb6-394e242c03e4" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:21:32 user nova-compute[74776]:   <nova:package version="0.0.0"/>
Nov 22 14:21:32 user nova-compute[74776]:   <nova:name>tempest-device-tagging-server-1295290313</nova:name>
Nov 22 14:21:32 user nova-compute[74776]:   <nova:creationTime>2023-11-22 14:21:32</nova:creationTime>
Nov 22 14:21:32 user nova-compute[74776]:   <nova:flavor name="m1.tiny">
Nov 22 14:21:32 user nova-compute[74776]:     <nova:memory>512</nova:memory>
Nov 22 14:21:32 user nova-compute[74776]:     <nova:disk>1</nova:disk>
Nov 22 14:21:32 user nova-compute[74776]:     <nova:swap>0</nova:swap>
Nov 22 14:21:32 user nova-compute[74776]:     <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:21:32 user nova-compute[74776]:     <nova:vcpus>1</nova:vcpus>
Nov 22 14:21:32 user nova-compute[74776]:   </nova:flavor>
Nov 22 14:21:32 user nova-compute[74776]:   <nova:owner>
Nov 22 14:21:32 user nova-compute[74776]:     <nova:user uuid="1d173b822df3448bb49245f30afc0e17">tempest-TaggedAttachmentsTest-2066916431-project-member</nova:user>
Nov 22 14:21:32 user nova-compute[74776]:     <nova:project uuid="027310982a0047d9a0d06c29b5b6e1f2">tempest-TaggedAttachmentsTest-2066916431</nova:project>
Nov 22 14:21:32 user nova-compute[74776]:   </nova:owner>
Nov 22 14:21:32 user nova-compute[74776]:   <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:21:32 user nova-compute[74776]:   <nova:ports>
Nov 22 14:21:32 user nova-compute[74776]:     <nova:port uuid="d13f9065-d7f3-4274-929f-3ac85db8bf73">
Nov 22 14:21:32 user nova-compute[74776]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 14:21:32 user nova-compute[74776]:     </nova:port>
Nov 22 14:21:32 user nova-compute[74776]:     <nova:port uuid="b25ae5ba-034e-4c8f-b11a-570458c20dfe">
Nov 22 14:21:32 user nova-compute[74776]:       <nova:ip type="fixed" address="10.10.10.228" ipVersion="4"/>
Nov 22 14:21:32 user nova-compute[74776]:     </nova:port>
Nov 22 14:21:32 user nova-compute[74776]:   </nova:ports>
Nov 22 14:21:32 user nova-compute[74776]: </nova:instance>
Nov 22 14:21:32 user nova-compute[74776]:  {{(pid=74776) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0fa3ab40-99dd-4c50-a41d-089f51769f2c tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "interface-6dcf355f-759d-4a9a-9fb6-394e242c03e4-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.264s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG nova.compute.manager [req-11996e57-a1fc-4724-9fe7-dbeab74f8048 req-e3cb6694-01f9-4461-8a09-abcae44b3c69 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Received event network-vif-plugged-b25ae5ba-034e-4c8f-b11a-570458c20dfe {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-11996e57-a1fc-4724-9fe7-dbeab74f8048 req-e3cb6694-01f9-4461-8a09-abcae44b3c69 service nova] Acquiring lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-11996e57-a1fc-4724-9fe7-dbeab74f8048 req-e3cb6694-01f9-4461-8a09-abcae44b3c69 service nova] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-11996e57-a1fc-4724-9fe7-dbeab74f8048 req-e3cb6694-01f9-4461-8a09-abcae44b3c69 service nova] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG nova.compute.manager [req-11996e57-a1fc-4724-9fe7-dbeab74f8048 req-e3cb6694-01f9-4461-8a09-abcae44b3c69 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] No waiting events found dispatching network-vif-plugged-b25ae5ba-034e-4c8f-b11a-570458c20dfe {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:21:32 user nova-compute[74776]: WARNING nova.compute.manager [req-11996e57-a1fc-4724-9fe7-dbeab74f8048 req-e3cb6694-01f9-4461-8a09-abcae44b3c69 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Received unexpected event network-vif-plugged-b25ae5ba-034e-4c8f-b11a-570458c20dfe for instance with vm_state active and task_state None.
Nov 22 14:21:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquiring lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG nova.objects.instance [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lazy-loading 'flavor' on Instance uuid 6dcf355f-759d-4a9a-9fb6-394e242c03e4 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:21:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquiring lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:33 user nova-compute[74776]: INFO nova.compute.manager [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Attaching volume 8a5497e7-8111-4ac6-b4b5-81f1d28a5472 to /dev/vdb
Nov 22 14:21:33 user nova-compute[74776]: DEBUG os_brick.utils [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99c6cd5-e367-40a0-bf2c-9413e7b82a7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[475dea36-98a4-43a5-ae59-fd05dba76da3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c927afe-ef3c-4516-b0c7-6bece0343b68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f4a9e4-b95a-44bc-9ecd-3ff6460a199c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:21:33 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:21:33 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3cbf97-5067-48b2-bf0a-5efe613a461d]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG os_brick.utils [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:21:33 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Updating existing volume attachment record: 4e840d90-e793-45fe-8d2a-ac78aa2d3f2b {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:21:34 user nova-compute[74776]: DEBUG nova.compute.manager [req-55d79531-d56a-45c8-9e7b-bcbfaa0a3ffb req-74eab50d-604e-4e1a-9ca3-05eb5a33bf85 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Received event network-vif-plugged-b25ae5ba-034e-4c8f-b11a-570458c20dfe {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:21:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-55d79531-d56a-45c8-9e7b-bcbfaa0a3ffb req-74eab50d-604e-4e1a-9ca3-05eb5a33bf85 service nova] Acquiring lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-55d79531-d56a-45c8-9e7b-bcbfaa0a3ffb req-74eab50d-604e-4e1a-9ca3-05eb5a33bf85 service nova] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-55d79531-d56a-45c8-9e7b-bcbfaa0a3ffb req-74eab50d-604e-4e1a-9ca3-05eb5a33bf85 service nova] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:21:34 user nova-compute[74776]: DEBUG nova.compute.manager [req-55d79531-d56a-45c8-9e7b-bcbfaa0a3ffb req-74eab50d-604e-4e1a-9ca3-05eb5a33bf85 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] No waiting events found dispatching network-vif-plugged-b25ae5ba-034e-4c8f-b11a-570458c20dfe {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:21:34 user nova-compute[74776]: WARNING nova.compute.manager [req-55d79531-d56a-45c8-9e7b-bcbfaa0a3ffb req-74eab50d-604e-4e1a-9ca3-05eb5a33bf85 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Received unexpected event network-vif-plugged-b25ae5ba-034e-4c8f-b11a-570458c20dfe for instance with vm_state active and task_state None.
Nov 22 14:21:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YfpUmHJr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:21:40 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:21:40 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:21:40 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[484e9668-b618-4463-a82e-6dedd9116bfc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:21:40 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.128s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c08530a-d0bd-4321-9f9a-c1564286a1f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472] added
Nov 22 14:21:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0973c3dd-2324-4020-afe9-e466c779e3c9]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.069s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d25a92-9bcf-414d-91d0-b73659cb11d8]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YfpUmHJr {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YfpUmHJr" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84c5089-11ed-4577-a900-d589fdb9c368]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YfpUmHJr'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de3d75a-baf6-4c1c-9734-58b15d2875ef]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed41565c-6c98-46c4-9a2f-5f4c2cd6ee02]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:21:40 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:21:40 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:21:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:21:40 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:21:40 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:21:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b87214-7b32-4727-8a11-f557696911a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472, portal: 172.16.0.220,3260]
Nov 22 14:21:40 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472, portal: 172.16.0.220,3260] successful.
Nov 22 14:21:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f88955-6919-4da3-9a52-72d08c4fe34e]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[489a5f10-3786-4729-83f3-bd2446bcc96a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:21:40 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:21:40 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:21:40 user nova-compute[74776]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 (non-flash)
Nov 22 14:21:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:21:40 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:21:40 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:21:40 user nova-compute[74776]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 (non-flash)
Nov 22 14:21:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.543s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[35730ba8-fbb3-4819-9100-ce093362e5d1]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:21:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YfpUmHJr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:21:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.585s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:21:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] <== connect_volume: return (1588ms) {'type': 'block', 'scsi_wwn': '23935383034363962', 'path': '/dev/sde'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:21:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935383034363962', 'path': '/dev/sde'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:21:41 user nova-compute[74776]: DEBUG nova.objects.instance [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lazy-loading 'flavor' on Instance uuid 6dcf355f-759d-4a9a-9fb6-394e242c03e4 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:21:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:21:41 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:21:41 user nova-compute[74776]:   <source dev="/dev/sde"/>
Nov 22 14:21:41 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:21:41 user nova-compute[74776]:   <serial>8a5497e7-8111-4ac6-b4b5-81f1d28a5472</serial>
Nov 22 14:21:41 user nova-compute[74776]: </disk>
Nov 22 14:21:41 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:21:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:42 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:21:42 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] No BDM found with device name hda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:21:42 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] No VIF found with MAC fa:16:3e:0f:a0:64, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:21:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-be058f32-c0b9-44f7-a376-4a4ad211238d tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.297s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:21:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:43 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:21:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:21:43 user nova-compute[74776]: INFO nova.compute.claims [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Claim successful on node user
Nov 22 14:21:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquiring lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:43 user nova-compute[74776]: INFO nova.compute.manager [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Detaching volume 8a5497e7-8111-4ac6-b4b5-81f1d28a5472
Nov 22 14:21:43 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:21:43 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:21:43 user nova-compute[74776]: INFO nova.virt.block_device [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Attempting to driver detach volume 8a5497e7-8111-4ac6-b4b5-81f1d28a5472 from mountpoint /dev/vdb
Nov 22 14:21:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.622s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:21:43 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:21:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Attempting to detach device vdb from instance 6dcf355f-759d-4a9a-9fb6-394e242c03e4 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:21:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:21:43 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:21:43 user nova-compute[74776]:   <source dev="/dev/sde"/>
Nov 22 14:21:43 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:21:43 user nova-compute[74776]:   <serial>8a5497e7-8111-4ac6-b4b5-81f1d28a5472</serial>
Nov 22 14:21:43 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 22 14:21:43 user nova-compute[74776]: </disk>
Nov 22 14:21:43 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:21:43 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Successfully detached device vdb from instance 6dcf355f-759d-4a9a-9fb6-394e242c03e4 from the persistent domain config.
Nov 22 14:21:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6dcf355f-759d-4a9a-9fb6-394e242c03e4 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:21:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:21:43 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:21:43 user nova-compute[74776]:   <source dev="/dev/sde"/>
Nov 22 14:21:43 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:21:43 user nova-compute[74776]:   <serial>8a5497e7-8111-4ac6-b4b5-81f1d28a5472</serial>
Nov 22 14:21:43 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 22 14:21:43 user nova-compute[74776]: </disk>
Nov 22 14:21:43 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:21:43 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:21:43 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:21:43 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:21:44 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:21:44 user nova-compute[74776]: INFO nova.virt.block_device [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Booting with volume 504cd7d5-84cc-40ad-bbe4-009c0933038f at /dev/vda
Nov 22 14:21:44 user nova-compute[74776]: DEBUG nova.policy [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3997118da5d641489bf9e772eabc156e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09ea5e02a3340b0b2326971a28fd88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG os_brick.utils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee1c69c-7eb6-47de-bede-f85bc9e38a21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a08c22-799f-4e55-ac45-b3b38879506a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[23065036-0bbf-4546-b45b-ae0311907557]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bc58ac-f07b-47d1-ab02-2a3f4ac0e39f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:21:44 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:21:44 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a387fa-fbf0-447f-bcdb-5ab743b30257]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG os_brick.utils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Updating existing volume attachment record: 6a79536e-2dfc-4c07-88db-295a209895c2 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6dcf355f-759d-4a9a-9fb6-394e242c03e4 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:21:44 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Successfully created port: a9601d6f-cfc5-47b5-8260-414d5ac1157f {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:21:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:45 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Successfully created port: e631b486-fff8-4c8b-b688-138a941b0440 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:21:45 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Successfully created port: c7053999-2290-4f4e-a386-1ffc306de05a {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:21:46 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Successfully created port: e6f96288-8194-465b-90bd-640ecaec56e4 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:21:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:47 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Successfully created port: 0f0b6445-b307-4db8-ae22-121bdc8777c6 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:21:47 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Successfully updated port: a9601d6f-cfc5-47b5-8260-414d5ac1157f {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:21:47 user nova-compute[74776]: DEBUG nova.compute.manager [req-49695104-2403-491f-bbc9-59dcaa06a18c req-fa96b377-aff9-4458-bfb7-76553cfcd8e4 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-changed-a9601d6f-cfc5-47b5-8260-414d5ac1157f {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:21:47 user nova-compute[74776]: DEBUG nova.compute.manager [req-49695104-2403-491f-bbc9-59dcaa06a18c req-fa96b377-aff9-4458-bfb7-76553cfcd8e4 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Refreshing instance network info cache due to event network-changed-a9601d6f-cfc5-47b5-8260-414d5ac1157f. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:21:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-49695104-2403-491f-bbc9-59dcaa06a18c req-fa96b377-aff9-4458-bfb7-76553cfcd8e4 service nova] Acquiring lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:21:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-49695104-2403-491f-bbc9-59dcaa06a18c req-fa96b377-aff9-4458-bfb7-76553cfcd8e4 service nova] Acquired lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:21:47 user nova-compute[74776]: DEBUG nova.network.neutron [req-49695104-2403-491f-bbc9-59dcaa06a18c req-fa96b377-aff9-4458-bfb7-76553cfcd8e4 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Refreshing network info cache for port a9601d6f-cfc5-47b5-8260-414d5ac1157f {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:21:47 user nova-compute[74776]: DEBUG nova.network.neutron [req-49695104-2403-491f-bbc9-59dcaa06a18c req-fa96b377-aff9-4458-bfb7-76553cfcd8e4 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:21:48 user nova-compute[74776]: DEBUG nova.network.neutron [req-49695104-2403-491f-bbc9-59dcaa06a18c req-fa96b377-aff9-4458-bfb7-76553cfcd8e4 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:21:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-49695104-2403-491f-bbc9-59dcaa06a18c req-fa96b377-aff9-4458-bfb7-76553cfcd8e4 service nova] Releasing lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:21:48 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Successfully updated port: 81b8bd85-da35-47cb-880f-6b3de9efd406 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:21:48 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Successfully updated port: df6ff5ee-9150-4078-8357-caeb01f35ff8 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:21:49 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Successfully updated port: e631b486-fff8-4c8b-b688-138a941b0440 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:21:49 user nova-compute[74776]: DEBUG nova.compute.manager [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-changed-81b8bd85-da35-47cb-880f-6b3de9efd406 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:21:49 user nova-compute[74776]: DEBUG nova.compute.manager [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Refreshing instance network info cache due to event network-changed-81b8bd85-da35-47cb-880f-6b3de9efd406. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:21:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] Acquiring lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:21:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] Acquired lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:21:49 user nova-compute[74776]: DEBUG nova.network.neutron [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Refreshing network info cache for port 81b8bd85-da35-47cb-880f-6b3de9efd406 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:21:49 user nova-compute[74776]: DEBUG nova.network.neutron [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Successfully updated port: c7053999-2290-4f4e-a386-1ffc306de05a {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG nova.network.neutron [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] Releasing lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-changed-df6ff5ee-9150-4078-8357-caeb01f35ff8 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Refreshing instance network info cache due to event network-changed-df6ff5ee-9150-4078-8357-caeb01f35ff8. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] Acquiring lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] Acquired lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG nova.network.neutron [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Refreshing network info cache for port df6ff5ee-9150-4078-8357-caeb01f35ff8 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG nova.network.neutron [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG nova.network.neutron [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] Releasing lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-changed-e631b486-fff8-4c8b-b688-138a941b0440 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Refreshing instance network info cache due to event network-changed-e631b486-fff8-4c8b-b688-138a941b0440. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] Acquiring lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] Acquired lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG nova.network.neutron [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Refreshing network info cache for port e631b486-fff8-4c8b-b688-138a941b0440 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG nova.network.neutron [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:21:50 user nova-compute[74776]: INFO nova.virt.block_device [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Booting with volume 721375eb-40a3-4db4-9ee2-a9a6d2460848 at /dev/vdb
Nov 22 14:21:50 user nova-compute[74776]: DEBUG nova.network.neutron [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4272dd25-6752-4b40-b366-3844d7bc73b7 req-ca76ee23-6070-4a4a-a6cf-4b7a95514227 service nova] Releasing lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG os_brick.utils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed281bf-550b-43a6-989a-30c7ab923119]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfe20a8-ee46-4751-a672-a3a121b6cfd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Successfully updated port: e6f96288-8194-465b-90bd-640ecaec56e4 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2cbb49-6c98-44a6-b59a-a999e77ae7c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69efa63-fd9e-4474-8f3b-eaeacad934dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-25451e9d-cc0e-4fe1-b549-7a23e0a968a8 req-52cccad4-3ddc-4bc0-ab25-d82f70c64425 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-changed-e6f96288-8194-465b-90bd-640ecaec56e4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-25451e9d-cc0e-4fe1-b549-7a23e0a968a8 req-52cccad4-3ddc-4bc0-ab25-d82f70c64425 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Refreshing instance network info cache due to event network-changed-e6f96288-8194-465b-90bd-640ecaec56e4. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-25451e9d-cc0e-4fe1-b549-7a23e0a968a8 req-52cccad4-3ddc-4bc0-ab25-d82f70c64425 service nova] Acquiring lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-25451e9d-cc0e-4fe1-b549-7a23e0a968a8 req-52cccad4-3ddc-4bc0-ab25-d82f70c64425 service nova] Acquired lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG nova.network.neutron [req-25451e9d-cc0e-4fe1-b549-7a23e0a968a8 req-52cccad4-3ddc-4bc0-ab25-d82f70c64425 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Refreshing network info cache for port e6f96288-8194-465b-90bd-640ecaec56e4 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:21:50 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:21:50 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeac7aa-8cfa-41a6-88f9-22b4d02257a2]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG os_brick.utils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:21:50 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Updating existing volume attachment record: ccfa9db3-5d5c-4a0e-8289-94233fad55ba {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:21:51 user nova-compute[74776]: DEBUG nova.network.neutron [req-25451e9d-cc0e-4fe1-b549-7a23e0a968a8 req-52cccad4-3ddc-4bc0-ab25-d82f70c64425 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:21:51 user nova-compute[74776]: DEBUG nova.network.neutron [req-25451e9d-cc0e-4fe1-b549-7a23e0a968a8 req-52cccad4-3ddc-4bc0-ab25-d82f70c64425 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:21:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-25451e9d-cc0e-4fe1-b549-7a23e0a968a8 req-52cccad4-3ddc-4bc0-ab25-d82f70c64425 service nova] Releasing lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:21:51 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Successfully updated port: 0f0b6445-b307-4db8-ae22-121bdc8777c6 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:21:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Acquiring lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:21:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Acquired lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:21:51 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:21:51 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:21:51 user nova-compute[74776]: DEBUG nova.compute.manager [req-80b7485b-0a99-4e63-b36d-9e61dbaba33e req-06bcb16e-07e6-4152-b759-0e25f8732446 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-changed-c7053999-2290-4f4e-a386-1ffc306de05a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:21:51 user nova-compute[74776]: DEBUG nova.compute.manager [req-80b7485b-0a99-4e63-b36d-9e61dbaba33e req-06bcb16e-07e6-4152-b759-0e25f8732446 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Refreshing instance network info cache due to event network-changed-c7053999-2290-4f4e-a386-1ffc306de05a. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:21:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-80b7485b-0a99-4e63-b36d-9e61dbaba33e req-06bcb16e-07e6-4152-b759-0e25f8732446 service nova] Acquiring lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:21:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:52 user nova-compute[74776]: DEBUG nova.compute.manager [req-83d7f0dd-77b7-4bdd-89bd-f27c2c04a368 req-5fda2eff-c1f2-478b-9049-2decbdf60e39 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-changed-0f0b6445-b307-4db8-ae22-121bdc8777c6 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:21:52 user nova-compute[74776]: DEBUG nova.compute.manager [req-83d7f0dd-77b7-4bdd-89bd-f27c2c04a368 req-5fda2eff-c1f2-478b-9049-2decbdf60e39 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Refreshing instance network info cache due to event network-changed-0f0b6445-b307-4db8-ae22-121bdc8777c6. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:21:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-83d7f0dd-77b7-4bdd-89bd-f27c2c04a368 req-5fda2eff-c1f2-478b-9049-2decbdf60e39 service nova] Acquiring lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:21:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-f81bd537-1a6a-4e80-be29-4db2da75e085 req-4018ac3b-20ac-45dd-a562-a80ef70a0d0e service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Received event network-changed-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:21:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-f81bd537-1a6a-4e80-be29-4db2da75e085 req-4018ac3b-20ac-45dd-a562-a80ef70a0d0e service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Refreshing instance network info cache due to event network-changed-81372b6e-8162-4b1f-ac94-dcaf1c8c2473. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:21:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f81bd537-1a6a-4e80-be29-4db2da75e085 req-4018ac3b-20ac-45dd-a562-a80ef70a0d0e service nova] Acquiring lock "refresh_cache-d7f3ff5e-292d-4e81-af58-b9a45adfbda1" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:21:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f81bd537-1a6a-4e80-be29-4db2da75e085 req-4018ac3b-20ac-45dd-a562-a80ef70a0d0e service nova] Acquired lock "refresh_cache-d7f3ff5e-292d-4e81-af58-b9a45adfbda1" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:21:53 user nova-compute[74776]: DEBUG nova.network.neutron [req-f81bd537-1a6a-4e80-be29-4db2da75e085 req-4018ac3b-20ac-45dd-a562-a80ef70a0d0e service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Refreshing network info cache for port 81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:21:53 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Updating instance_info_cache with network_info: [{"id": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "address": "fa:16:3e:c7:ba:0a", "network": {"id": "10549d92-6312-459c-b167-bdd2396d9c88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1836352595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9601d6f-cf", "ovs_interfaceid": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81b8bd85-da35-47cb-880f-6b3de9efd406", "address": "fa:16:3e:59:13:7f", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b8bd85-da", "ovs_interfaceid": "81b8bd85-da35-47cb-880f-6b3de9efd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "address": "fa:16:3e:92:19:97", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6ff5ee-91", "ovs_interfaceid": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e631b486-fff8-4c8b-b688-138a941b0440", "address": "fa:16:3e:47:e8:14", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape631b486-ff", "ovs_interfaceid": "e631b486-fff8-4c8b-b688-138a941b0440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c7053999-2290-4f4e-a386-1ffc306de05a", "address": "fa:16:3e:3b:bf:db", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7053999-22", "ovs_interfaceid": "c7053999-2290-4f4e-a386-1ffc306de05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6f96288-8194-465b-90bd-640ecaec56e4", "address": "fa:16:3e:53:9d:81", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f96288-81", "ovs_interfaceid": "e6f96288-8194-465b-90bd-640ecaec56e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "address": "fa:16:3e:dd:3e:54", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0b6445-b3", "ovs_interfaceid": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:21:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Releasing lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:21:53 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Instance network_info: |[{"id": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "address": "fa:16:3e:c7:ba:0a", "network": {"id": "10549d92-6312-459c-b167-bdd2396d9c88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1836352595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9601d6f-cf", "ovs_interfaceid": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81b8bd85-da35-47cb-880f-6b3de9efd406", "address": "fa:16:3e:59:13:7f", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b8bd85-da", "ovs_interfaceid": "81b8bd85-da35-47cb-880f-6b3de9efd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "address": "fa:16:3e:92:19:97", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6ff5ee-91", "ovs_interfaceid": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e631b486-fff8-4c8b-b688-138a941b0440", "address": "fa:16:3e:47:e8:14", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape631b486-ff", "ovs_interfaceid": "e631b486-fff8-4c8b-b688-138a941b0440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c7053999-2290-4f4e-a386-1ffc306de05a", "address": "fa:16:3e:3b:bf:db", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7053999-22", "ovs_interfaceid": "c7053999-2290-4f4e-a386-1ffc306de05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6f96288-8194-465b-90bd-640ecaec56e4", "address": "fa:16:3e:53:9d:81", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f96288-81", "ovs_interfaceid": "e6f96288-8194-465b-90bd-640ecaec56e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "address": "fa:16:3e:dd:3e:54", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0b6445-b3", "ovs_interfaceid": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:21:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-80b7485b-0a99-4e63-b36d-9e61dbaba33e req-06bcb16e-07e6-4152-b759-0e25f8732446 service nova] Acquired lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:21:53 user nova-compute[74776]: DEBUG nova.network.neutron [req-80b7485b-0a99-4e63-b36d-9e61dbaba33e req-06bcb16e-07e6-4152-b759-0e25f8732446 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Refreshing network info cache for port c7053999-2290-4f4e-a386-1ffc306de05a {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:21:53 user nova-compute[74776]: DEBUG nova.network.neutron [req-f81bd537-1a6a-4e80-be29-4db2da75e085 req-4018ac3b-20ac-45dd-a562-a80ef70a0d0e service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Updated VIF entry in instance network info cache for port 81372b6e-8162-4b1f-ac94-dcaf1c8c2473. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:21:53 user nova-compute[74776]: DEBUG nova.network.neutron [req-f81bd537-1a6a-4e80-be29-4db2da75e085 req-4018ac3b-20ac-45dd-a562-a80ef70a0d0e service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Updating instance_info_cache with network_info: [{"id": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "address": "fa:16:3e:22:fe:77", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81372b6e-81", "ovs_interfaceid": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:21:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f81bd537-1a6a-4e80-be29-4db2da75e085 req-4018ac3b-20ac-45dd-a562-a80ef70a0d0e service nova] Releasing lock "refresh_cache-d7f3ff5e-292d-4e81-af58-b9a45adfbda1" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:21:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:53 user nova-compute[74776]: DEBUG nova.objects.instance [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lazy-loading 'flavor' on Instance uuid d7f3ff5e-292d-4e81-af58-b9a45adfbda1 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:21:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:21:54 user nova-compute[74776]: INFO nova.compute.manager [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Attaching volume f4f9db8e-6078-4602-be9a-f6e8b1e727b3 to /dev/vdb
Nov 22 14:21:54 user nova-compute[74776]: DEBUG os_brick.utils [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[128a9af5-80e6-4be3-953b-46bb7c6264cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae6db28-d492-404a-98e7-739efa855640]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc108b15-db33-48ee-a8ed-16112a07ccb0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0105081-691d-46e9-90ea-3089ec64816b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG nova.network.neutron [req-80b7485b-0a99-4e63-b36d-9e61dbaba33e req-06bcb16e-07e6-4152-b759-0e25f8732446 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Updated VIF entry in instance network info cache for port c7053999-2290-4f4e-a386-1ffc306de05a. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG nova.network.neutron [req-80b7485b-0a99-4e63-b36d-9e61dbaba33e req-06bcb16e-07e6-4152-b759-0e25f8732446 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Updating instance_info_cache with network_info: [{"id": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "address": "fa:16:3e:c7:ba:0a", "network": {"id": "10549d92-6312-459c-b167-bdd2396d9c88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1836352595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9601d6f-cf", "ovs_interfaceid": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81b8bd85-da35-47cb-880f-6b3de9efd406", "address": "fa:16:3e:59:13:7f", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b8bd85-da", "ovs_interfaceid": "81b8bd85-da35-47cb-880f-6b3de9efd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "address": "fa:16:3e:92:19:97", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6ff5ee-91", "ovs_interfaceid": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e631b486-fff8-4c8b-b688-138a941b0440", "address": "fa:16:3e:47:e8:14", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape631b486-ff", "ovs_interfaceid": "e631b486-fff8-4c8b-b688-138a941b0440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c7053999-2290-4f4e-a386-1ffc306de05a", "address": "fa:16:3e:3b:bf:db", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7053999-22", "ovs_interfaceid": "c7053999-2290-4f4e-a386-1ffc306de05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6f96288-8194-465b-90bd-640ecaec56e4", "address": "fa:16:3e:53:9d:81", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f96288-81", "ovs_interfaceid": "e6f96288-8194-465b-90bd-640ecaec56e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "address": "fa:16:3e:dd:3e:54", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0b6445-b3", "ovs_interfaceid": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:21:54 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:21:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1712e2e1-c610-41f8-a623-74f05f29053d]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG os_brick.utils [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Updating existing volume attachment record: c80687b0-8314-490b-b8ac-2a5ea9eba2fd {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-80b7485b-0a99-4e63-b36d-9e61dbaba33e req-06bcb16e-07e6-4152-b759-0e25f8732446 service nova] Releasing lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-83d7f0dd-77b7-4bdd-89bd-f27c2c04a368 req-5fda2eff-c1f2-478b-9049-2decbdf60e39 service nova] Acquired lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG nova.network.neutron [req-83d7f0dd-77b7-4bdd-89bd-f27c2c04a368 req-5fda2eff-c1f2-478b-9049-2decbdf60e39 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Refreshing network info cache for port 0f0b6445-b307-4db8-ae22-121bdc8777c6 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG nova.network.neutron [req-83d7f0dd-77b7-4bdd-89bd-f27c2c04a368 req-5fda2eff-c1f2-478b-9049-2decbdf60e39 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Updated VIF entry in instance network info cache for port 0f0b6445-b307-4db8-ae22-121bdc8777c6. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG nova.network.neutron [req-83d7f0dd-77b7-4bdd-89bd-f27c2c04a368 req-5fda2eff-c1f2-478b-9049-2decbdf60e39 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Updating instance_info_cache with network_info: [{"id": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "address": "fa:16:3e:c7:ba:0a", "network": {"id": "10549d92-6312-459c-b167-bdd2396d9c88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1836352595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9601d6f-cf", "ovs_interfaceid": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81b8bd85-da35-47cb-880f-6b3de9efd406", "address": "fa:16:3e:59:13:7f", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b8bd85-da", "ovs_interfaceid": "81b8bd85-da35-47cb-880f-6b3de9efd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "address": "fa:16:3e:92:19:97", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6ff5ee-91", "ovs_interfaceid": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e631b486-fff8-4c8b-b688-138a941b0440", "address": "fa:16:3e:47:e8:14", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape631b486-ff", "ovs_interfaceid": "e631b486-fff8-4c8b-b688-138a941b0440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c7053999-2290-4f4e-a386-1ffc306de05a", "address": "fa:16:3e:3b:bf:db", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7053999-22", "ovs_interfaceid": "c7053999-2290-4f4e-a386-1ffc306de05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6f96288-8194-465b-90bd-640ecaec56e4", "address": "fa:16:3e:53:9d:81", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f96288-81", "ovs_interfaceid": "e6f96288-8194-465b-90bd-640ecaec56e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "address": "fa:16:3e:dd:3e:54", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0b6445-b3", "ovs_interfaceid": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:21:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-83d7f0dd-77b7-4bdd-89bd-f27c2c04a368 req-5fda2eff-c1f2-478b-9049-2decbdf60e39 service nova] Releasing lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:21:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:21:57 user nova-compute[74776]: INFO nova.virt.block_device [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Booting with volume 929bce78-5b35-40bc-916b-a5420406834a at /dev/vdc
Nov 22 14:21:57 user nova-compute[74776]: DEBUG os_brick.utils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:21:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[620df5c0-fbcc-4866-bff4-d1a1bbec23bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca892217-39ea-4f57-adad-19452d7ae04a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:21:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ac675f-c1ca-4b30-b97b-c9ba1a63427e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcdf1d6-56f0-4025-b3cd-a029bd26c84d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:21:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:21:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:21:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:21:57 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:21:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[489327e5-ae6d-4291-b2c8-e18b4edcfc76]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:21:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:21:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:21:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:21:57 user nova-compute[74776]: DEBUG os_brick.utils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:21:57 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Updating existing volume attachment record: 9709fb0d-a23b-4d12-b4e9-8587e53e1eb3 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJHwfbLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:22:00 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:00 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:00 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea29774c-38f5-48f0-ad58-d4fdbe6aa3c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:22:00 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c85612-dd73-4ef4-b788-cd6641a31adb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3] added
Nov 22 14:22:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[042c5b01-3875-412a-8e20-dbcf824a2394]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a387e065-190a-4dd6-9e56-e17206889c5a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jJHwfbLd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jJHwfbLd" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1c3013-e880-41f1-ba51-4fb13abc805b]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jJHwfbLd'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ca5dd4-1365-4f92-88cc-0c53afdea57c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa2ae48-28a1-4438-a0c3-3d5403bbe36c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:00 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:00 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:00 user nova-compute[74776]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 (non-flash)
Nov 22 14:22:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:00 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:00 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:00 user nova-compute[74776]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 (non-flash)
Nov 22 14:22:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[777ff1b7-1da0-4318-a83c-d5b1ffd9e539]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3, portal: 172.16.0.220,3260]
Nov 22 14:22:00 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3, portal: 172.16.0.220,3260] successful.
Nov 22 14:22:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f616a627-240b-44f6-8d78-65f0634fed8f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25c9d01-d094-4e77-9d56-f84137e42e6e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:00 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:00 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:00 user nova-compute[74776]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 (non-flash)
Nov 22 14:22:00 user nova-compute[74776]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:00 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:00 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:00 user nova-compute[74776]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 (non-flash)
Nov 22 14:22:00 user nova-compute[74776]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[731848f9-3680-4f7c-a48b-5d6b4bfa4d5c]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:00 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: None {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:22:01 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:22:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJHwfbLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:22:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26264363939386364', 'path': '/dev/sdf'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:22:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264363939386364', 'path': '/dev/sdf'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:22:01 user nova-compute[74776]: DEBUG nova.objects.instance [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lazy-loading 'flavor' on Instance uuid d7f3ff5e-292d-4e81-af58-b9a45adfbda1 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:22:01 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:22:01 user nova-compute[74776]:   <source dev="/dev/sdf"/>
Nov 22 14:22:01 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:22:01 user nova-compute[74776]:   <serial>f4f9db8e-6078-4602-be9a-f6e8b1e727b3</serial>
Nov 22 14:22:01 user nova-compute[74776]: </disk>
Nov 22 14:22:01 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:22:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:22:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:22:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] No VIF found with MAC fa:16:3e:22:fe:77, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:22:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8b58bcda-791e-42c5-aa3c-bb317b9d3e8c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.380s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:03 user nova-compute[74776]: INFO nova.compute.manager [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Rebuilding instance
Nov 22 14:22:03 user nova-compute[74776]: DEBUG nova.compute.manager [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:22:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:03 user nova-compute[74776]: DEBUG nova.compute.manager [req-38c26791-f0a7-476f-bb0f-8c05eabfd856 req-92e7f87a-84d0-4ac8-a6cb-07d9c288be41 service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Received event network-vif-unplugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-38c26791-f0a7-476f-bb0f-8c05eabfd856 req-92e7f87a-84d0-4ac8-a6cb-07d9c288be41 service nova] Acquiring lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-38c26791-f0a7-476f-bb0f-8c05eabfd856 req-92e7f87a-84d0-4ac8-a6cb-07d9c288be41 service nova] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-38c26791-f0a7-476f-bb0f-8c05eabfd856 req-92e7f87a-84d0-4ac8-a6cb-07d9c288be41 service nova] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:03 user nova-compute[74776]: DEBUG nova.compute.manager [req-38c26791-f0a7-476f-bb0f-8c05eabfd856 req-92e7f87a-84d0-4ac8-a6cb-07d9c288be41 service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] No waiting events found dispatching network-vif-unplugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:03 user nova-compute[74776]: WARNING nova.compute.manager [req-38c26791-f0a7-476f-bb0f-8c05eabfd856 req-92e7f87a-84d0-4ac8-a6cb-07d9c288be41 service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Received unexpected event network-vif-unplugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 for instance with vm_state active and task_state rebuilding.
Nov 22 14:22:03 user nova-compute[74776]: INFO nova.compute.manager [None req-94ad0863-a1f5-4afa-beb8-74543a6c2b42 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Unrescuing
Nov 22 14:22:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-94ad0863-a1f5-4afa-beb8-74543a6c2b42 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:22:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-94ad0863-a1f5-4afa-beb8-74543a6c2b42 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquired lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:22:03 user nova-compute[74776]: DEBUG nova.network.neutron [None req-94ad0863-a1f5-4afa-beb8-74543a6c2b42 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:22:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:22:04 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Creating image(s)
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Did not create local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Ensure instance console log exists: /opt/stack/data/nova/instances/84dbab20-fe7f-4b9e-bc02-6c739029f69d/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Start _get_guest_xml network_info=[{"id": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "address": "fa:16:3e:c7:ba:0a", "network": {"id": "10549d92-6312-459c-b167-bdd2396d9c88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1836352595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9601d6f-cf", "ovs_interfaceid": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81b8bd85-da35-47cb-880f-6b3de9efd406", "address": "fa:16:3e:59:13:7f", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b8bd85-da", "ovs_interfaceid": "81b8bd85-da35-47cb-880f-6b3de9efd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "address": "fa:16:3e:92:19:97", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6ff5ee-91", "ovs_interfaceid": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e631b486-fff8-4c8b-b688-138a941b0440", "address": "fa:16:3e:47:e8:14", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape631b486-ff", "ovs_interfaceid": "e631b486-fff8-4c8b-b688-138a941b0440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c7053999-2290-4f4e-a386-1ffc306de05a", "address": "fa:16:3e:3b:bf:db", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7053999-22", "ovs_interfaceid": "c7053999-2290-4f4e-a386-1ffc306de05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6f96288-8194-465b-90bd-640ecaec56e4", "address": "fa:16:3e:53:9d:81", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f96288-81", "ovs_interfaceid": "e6f96288-8194-465b-90bd-640ecaec56e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "address": "fa:16:3e:dd:3e:54", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0b6445-b3", "ovs_interfaceid": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6a79536e-2dfc-4c07-88db-295a209895c2', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFuQCvIb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84dbab20-fe7f-4b9e-bc02-6c739029f69d', 'attached_at': '', 'detached_at': '', 'volume_id': '504cd7d5-84cc-40ad-bbe4-009c0933038f', 'serial': '504cd7d5-84cc-40ad-bbe4-009c0933038f'}, 'boot_index': 0, 'volume_type': None}, {'attachment_id': 'ccfa9db3-5d5c-4a0e-8289-94233fad55ba', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FEWrZIgj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84dbab20-fe7f-4b9e-bc02-6c739029f69d', 'attached_at': '', 'detached_at': '', 'volume_id': '721375eb-40a3-4db4-9ee2-a9a6d2460848', 'serial': '721375eb-40a3-4db4-9ee2-a9a6d2460848'}, 'boot_index': 1, 'volume_type': None}, {'attachment_id': '9709fb0d-a23b-4d12-b4e9-8587e53e1eb3', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fuKZVYwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84dbab20-fe7f-4b9e-bc02-6c739029f69d', 'attached_at': '', 'detached_at': '', 'volume_id': '929bce78-5b35-40bc-916b-a5420406834a', 'serial': '929bce78-5b35-40bc-916b-a5420406834a'}, 'boot_index': 2, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:22:04 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:22:04 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFuQCvIb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:22:04 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:04 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:04 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc8a635-afe2-487e-9432-2e4451231bcb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:22:04 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a663fc89-7935-4da0-8e24-621f3600d5a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f] added
Nov 22 14:22:04 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee12537-e8cd-4dca-95ee-0fa3b44dbffe]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba405e3-fe39-40b6-93e5-40af39e40a95]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AFuQCvIb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AFuQCvIb" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aea655c-b3f4-4d4e-a51b-17559e9fac9a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AFuQCvIb'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b77947-06c9-4caf-b6ec-7e403a462d3e]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97488ea-9e32-42e5-a539-43bf4664ed1e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:04 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6dcf355f-759d-4a9a-9fb6-394e242c03e4 is timed out.
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:04 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:04 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:04 user nova-compute[74776]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 (non-flash)
Nov 22 14:22:04 user nova-compute[74776]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:04 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:04 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:04 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:04 user nova-compute[74776]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 (non-flash)
Nov 22 14:22:04 user nova-compute[74776]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:04 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:04 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Successfully detached device vdb from instance 6dcf355f-759d-4a9a-9fb6-394e242c03e4 from the live domain config.
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YfpUmHJr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:22:04 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:04 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Instance destroyed successfully.
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da3002b-c8b4-4892-8bb7-018f11fd84fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f, portal: 172.16.0.220,3260]
Nov 22 14:22:04 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f, portal: 172.16.0.220,3260] successful.
Nov 22 14:22:04 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.network.neutron [None req-94ad0863-a1f5-4afa-beb8-74543a6c2b42 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Updating instance_info_cache with network_info: [{"id": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "address": "fa:16:3e:7c:6e:68", "network": {"id": "32c8e7a3-6995-4931-ad2d-e8c3eb351538", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92fd48cf9c34eac867c14bf962c3a0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd255982-4c", "ovs_interfaceid": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7469afd0-45bc-4cb3-82b4-bdc401841355]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Port 5911a175-03ae-4ed9-8c40-fc54c69233b4 binding to destination host user is already ACTIVE {{(pid=74776) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquired lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-94ad0863-a1f5-4afa-beb8-74543a6c2b42 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Releasing lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.objects.instance [None req-94ad0863-a1f5-4afa-beb8-74543a6c2b42 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lazy-loading 'flavor' on Instance uuid 98fb9b54-c428-4a48-b1ff-a976f971b764 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba08cdd0-6d2a-4218-b03b-6387e9deb545]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:04 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:04 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:04 user nova-compute[74776]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 (non-flash)
Nov 22 14:22:04 user nova-compute[74776]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:04 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:04 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:04 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:04 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:04 user nova-compute[74776]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 (non-flash)
Nov 22 14:22:04 user nova-compute[74776]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:04 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:04 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] HCTL ('38', '-', '-', 0) found on session 19 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:22:04 user nova-compute[74776]: INFO nova.compute.manager [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Detaching volume f4f9db8e-6078-4602-be9a-f6e8b1e727b3
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d553bc-f655-490b-9a53-69bdf35df923]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFuQCvIb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:22:04 user nova-compute[74776]: INFO nova.virt.block_device [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Attempting to driver detach volume f4f9db8e-6078-4602-be9a-f6e8b1e727b3 from mountpoint /dev/vdb
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Attempting to detach device vdb from instance d7f3ff5e-292d-4e81-af58-b9a45adfbda1 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:22:04 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:22:04 user nova-compute[74776]:   <source dev="/dev/sdf"/>
Nov 22 14:22:04 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:22:04 user nova-compute[74776]:   <serial>f4f9db8e-6078-4602-be9a-f6e8b1e727b3</serial>
Nov 22 14:22:04 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:22:04 user nova-compute[74776]: </disk>
Nov 22 14:22:04 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74776) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 14:22:04 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Successfully detached device vdb from instance d7f3ff5e-292d-4e81-af58-b9a45adfbda1 from the persistent domain config.
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJHwfbLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:22:04 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 14:22:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.compute.manager [req-188f6aec-2688-4711-8593-c5f55e380cdb req-cc2a0070-81a7-4fdd-bf91-177367d2dcf5 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received event network-vif-unplugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-188f6aec-2688-4711-8593-c5f55e380cdb req-cc2a0070-81a7-4fdd-bf91-177367d2dcf5 service nova] Acquiring lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-188f6aec-2688-4711-8593-c5f55e380cdb req-cc2a0070-81a7-4fdd-bf91-177367d2dcf5 service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-188f6aec-2688-4711-8593-c5f55e380cdb req-cc2a0070-81a7-4fdd-bf91-177367d2dcf5 service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:04 user nova-compute[74776]: DEBUG nova.compute.manager [req-188f6aec-2688-4711-8593-c5f55e380cdb req-cc2a0070-81a7-4fdd-bf91-177367d2dcf5 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] No waiting events found dispatching network-vif-unplugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:04 user nova-compute[74776]: WARNING nova.compute.manager [req-188f6aec-2688-4711-8593-c5f55e380cdb req-cc2a0070-81a7-4fdd-bf91-177367d2dcf5 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received unexpected event network-vif-unplugged-dd255982-4c19-4bf3-b01c-ba063b6f561e for instance with vm_state rescued and task_state unrescuing.
Nov 22 14:22:05 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Updating instance_info_cache with network_info: [{"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Releasing lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Creating tmpfile /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/tmp8qpkqrz9 to verify with other compute node that the instance is on the same shared storage. {{(pid=74776) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:05 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Instance destroyed successfully.
Nov 22 14:22:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23630336237313966', 'path': '/dev/sdg'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630336237313966', 'path': '/dev/sdg'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.182s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FEWrZIgj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:22:05 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d8e8f0-ca67-4213-ab45-0b2335c71acc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:22:05 user nova-compute[74776]: No targets found.
Nov 22 14:22:05 user nova-compute[74776]: iSNS:
Nov 22 14:22:05 user nova-compute[74776]: No targets found.
Nov 22 14:22:05 user nova-compute[74776]: STATIC:
Nov 22 14:22:05 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3
Nov 22 14:22:05 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:05 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:05 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472
Nov 22 14:22:05 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:05 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:05 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f
Nov 22 14:22:05 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:05 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:05 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3
Nov 22 14:22:05 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:05 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:05 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065
Nov 22 14:22:05 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:05 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:05 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f
Nov 22 14:22:05 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:05 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:05 user nova-compute[74776]: FIRMWARE:
Nov 22 14:22:05 user nova-compute[74776]: No targets found.
Nov 22 14:22:05 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:22:05 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:22:05 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32e9b93-fc6d-40d3-856f-3ab794a5b304]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9039762a-b2e4-4215-8ca4-2ce526bc7e4a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:05 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:05 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:05 user nova-compute[74776]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 (non-flash)
Nov 22 14:22:05 user nova-compute[74776]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:05 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:05 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:05 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:05 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:05 user nova-compute[74776]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 (non-flash)
Nov 22 14:22:05 user nova-compute[74776]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:05 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:05 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c38709a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472'): ({'sde'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Removing single pathed devices sde {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8db4731-4443-441d-a7e2-88c708f2c5a7]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f80a321-7a24-455a-ae72-fc2d31572a47]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Flushing IO for device /dev/sde {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a29b1fd-1842-42ab-9a61-dbf3d0ba25cd]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8034614-479b-4741-bddd-c32835e6fc6b]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] SCSI volumes sde have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c13c40-6eaf-4ffd-9499-a393624d54a9]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e321c4-b9d5-49af-a61b-fe153423bba3]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472, portal: 172.16.0.220,3260]
Nov 22 14:22:05 user nova-compute[74776]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472, portal: 172.16.0.220,3260] successful.
Nov 22 14:22:05 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG nova.compute.manager [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Received event network-vif-plugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] Acquiring lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG nova.compute.manager [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] No waiting events found dispatching network-vif-plugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:05 user nova-compute[74776]: WARNING nova.compute.manager [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Received unexpected event network-vif-plugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 for instance with vm_state active and task_state rebuilding.
Nov 22 14:22:05 user nova-compute[74776]: DEBUG nova.compute.manager [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received event network-changed-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG nova.compute.manager [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Refreshing instance network info cache due to event network-changed-dd255982-4c19-4bf3-b01c-ba063b6f561e. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] Acquiring lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] Acquired lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG nova.network.neutron [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Refreshing network info cache for port dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a5497e7-8111-4ac6-b4b5-81f1d28a5472 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[064189c0-bee7-403e-9aae-e32b2c744d8e]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] <== disconnect_volume: return (1533ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.238s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[13776874-2f38-4afe-9ddb-308718607629]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:22:05 user nova-compute[74776]: No targets found.
Nov 22 14:22:05 user nova-compute[74776]: iSNS:
Nov 22 14:22:05 user nova-compute[74776]: No targets found.
Nov 22 14:22:05 user nova-compute[74776]: STATIC:
Nov 22 14:22:05 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3
Nov 22 14:22:05 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:05 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:05 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f
Nov 22 14:22:05 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:05 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:05 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3
Nov 22 14:22:05 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:05 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:05 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065
Nov 22 14:22:05 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:05 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:05 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f
Nov 22 14:22:05 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:05 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:05 user nova-compute[74776]: FIRMWARE:
Nov 22 14:22:05 user nova-compute[74776]: No targets found.
Nov 22 14:22:05 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:22:05 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:22:05 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6342d3-926b-42fc-b58a-b16e01bb0046]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[774951a2-246a-46c2-9865-221fa2af1fca]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:06 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:06 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c58610a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3'): ({'sdf'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Removing single pathed devices sdf {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[347c803e-80ed-437a-9454-a39b1fe4fad3]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0749a14b-1eca-4a4c-8ced-5b37d147661d]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Flushing IO for device /dev/sdf {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7848c0-e3cd-4882-83a2-f45d49d3cd65]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.059s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f12d35-4140-4ed5-8c69-f74281b93273]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] SCSI volumes sdf have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e2eae0-5068-4328-ae03-5d88dee21863]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8335d52b-ae6e-4feb-b5bd-38e088f005b7]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3, portal: 172.16.0.220,3260]
Nov 22 14:22:06 user nova-compute[74776]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3, portal: 172.16.0.220,3260] successful.
Nov 22 14:22:06 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaa4549-fa5c-473d-89cf-e169a1a31b66]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] <== disconnect_volume: return (1579ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.679s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:06 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:06 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3067332c-78b8-4534-bac0-a27059d340a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:22:06 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[403a3c00-5c3f-4397-b87a-f8b372cf782b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848] added
Nov 22 14:22:06 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ba03a0-bf01-4c69-bcf1-2952e666d7ff]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG nova.network.neutron [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Updated VIF entry in instance network info cache for port dd255982-4c19-4bf3-b01c-ba063b6f561e. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG nova.network.neutron [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Updating instance_info_cache with network_info: [{"id": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "address": "fa:16:3e:7c:6e:68", "network": {"id": "32c8e7a3-6995-4931-ad2d-e8c3eb351538", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92fd48cf9c34eac867c14bf962c3a0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd255982-4c", "ovs_interfaceid": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e0c649-6b97-4ab7-8ef6-a2254b5b2820]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FEWrZIgj {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] Releasing lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received event network-changed-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Refreshing instance network info cache due to event network-changed-dd255982-4c19-4bf3-b01c-ba063b6f561e. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] Acquiring lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] Acquired lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG nova.network.neutron [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Refreshing network info cache for port dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FEWrZIgj" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39b881e-4f1b-4e67-87cb-8acbae3b78cb]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FEWrZIgj'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e36483-544d-4b4a-a2fd-e6b63e950aa9]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[860029ee-5284-44fd-a6e7-00e35251c5bf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:06 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:06 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7645f74-e6a9-4941-a0bb-7f92fd495fa1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848, portal: 172.16.0.220,3260]
Nov 22 14:22:06 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848, portal: 172.16.0.220,3260] successful.
Nov 22 14:22:06 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[54481894-4c53-46cd-a678-e830bd4063ca]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f82463-8c85-43d3-a8dd-1917cb256634]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:06 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:06 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:06 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[71531dcb-c70e-4a10-a05e-7eae1d200866]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FEWrZIgj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:22:06 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Instance destroyed successfully.
Nov 22 14:22:06 user nova-compute[74776]: DEBUG nova.objects.instance [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lazy-loading 'resources' on Instance uuid e96ab1bf-6f19-4e5f-b79d-f0266988090b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1644694208',display_name='tempest-ServerActionsTestOtherB-server-1644694208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1644694208',id=2,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNubZ7Gk5h0q4OD6Enksl8Cxk/zzd+sbOwMvtIBBZUt9W+DL2N76A0FAo5K8lTdtosYaw4CTfnxfM5nY6xMBLxjo0J1fnDDgRvxTybxKH1mCAazzdEjSajoOw371LIwgmw==',key_name='tempest-keypair-1933513143',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:20:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba1b35da14434fa09c3331d9c44d63fb',ramdisk_id='',reservation_id='r-fmg969sn',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1073417585',owner_user_name='tempest-ServerActionsTestOtherB-1073417585-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:20:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84f6a2d2d72f42f1ba0ee9b623a0a9ca',uuid=e96ab1bf-6f19-4e5f-b79d-f0266988090b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Converting VIF {"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:46:f7,bridge_name='br-int',has_traffic_filtering=True,id=5911a175-03ae-4ed9-8c40-fc54c69233b4,network=Network(1287337f-aeac-4c5f-a6f0-3af84b13c33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5911a175-03') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_vif [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:46:f7,bridge_name='br-int',has_traffic_filtering=True,id=5911a175-03ae-4ed9-8c40-fc54c69233b4,network=Network(1287337f-aeac-4c5f-a6f0-3af84b13c33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5911a175-03') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5911a175-03, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=126c78e7-c210-459e-88c1-73f0ad1358f1) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:06 user nova-compute[74776]: INFO os_vif [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:46:f7,bridge_name='br-int',has_traffic_filtering=True,id=5911a175-03ae-4ed9-8c40-fc54c69233b4,network=Network(1287337f-aeac-4c5f-a6f0-3af84b13c33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5911a175-03')
Nov 22 14:22:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvAJsUuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:22:06 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:22:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG nova.objects.instance [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lazy-loading 'flavor' on Instance uuid 6dcf355f-759d-4a9a-9fb6-394e242c03e4 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG nova.network.neutron [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Updated VIF entry in instance network info cache for port dd255982-4c19-4bf3-b01c-ba063b6f561e. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG nova.network.neutron [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Updating instance_info_cache with network_info: [{"id": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "address": "fa:16:3e:7c:6e:68", "network": {"id": "32c8e7a3-6995-4931-ad2d-e8c3eb351538", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92fd48cf9c34eac867c14bf962c3a0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd255982-4c", "ovs_interfaceid": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-eec05e30-fd7b-449d-b4ad-c13050463a2b req-50f9156b-7849-4bdf-82fd-36106698ec9c service nova] Releasing lock "refresh_cache-98fb9b54-c428-4a48-b1ff-a976f971b764" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:22:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3946fb5a-5ec1-4d57-9ff0-10635d9693cd tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.110s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.compute.manager [req-fb8af0a6-f674-4933-8ee7-2f2320cdc97b req-130ebe6b-4e21-43eb-a1f5-25b065997a29 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received event network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-fb8af0a6-f674-4933-8ee7-2f2320cdc97b req-130ebe6b-4e21-43eb-a1f5-25b065997a29 service nova] Acquiring lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-fb8af0a6-f674-4933-8ee7-2f2320cdc97b req-130ebe6b-4e21-43eb-a1f5-25b065997a29 service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-fb8af0a6-f674-4933-8ee7-2f2320cdc97b req-130ebe6b-4e21-43eb-a1f5-25b065997a29 service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.compute.manager [req-fb8af0a6-f674-4933-8ee7-2f2320cdc97b req-130ebe6b-4e21-43eb-a1f5-25b065997a29 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] No waiting events found dispatching network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:07 user nova-compute[74776]: WARNING nova.compute.manager [req-fb8af0a6-f674-4933-8ee7-2f2320cdc97b req-130ebe6b-4e21-43eb-a1f5-25b065997a29 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received unexpected event network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e for instance with vm_state rescued and task_state unrescuing.
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.compute.manager [req-fb8af0a6-f674-4933-8ee7-2f2320cdc97b req-130ebe6b-4e21-43eb-a1f5-25b065997a29 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received event network-vif-unplugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-fb8af0a6-f674-4933-8ee7-2f2320cdc97b req-130ebe6b-4e21-43eb-a1f5-25b065997a29 service nova] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-fb8af0a6-f674-4933-8ee7-2f2320cdc97b req-130ebe6b-4e21-43eb-a1f5-25b065997a29 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-fb8af0a6-f674-4933-8ee7-2f2320cdc97b req-130ebe6b-4e21-43eb-a1f5-25b065997a29 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.compute.manager [req-fb8af0a6-f674-4933-8ee7-2f2320cdc97b req-130ebe6b-4e21-43eb-a1f5-25b065997a29 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] No waiting events found dispatching network-vif-unplugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:07 user nova-compute[74776]: WARNING nova.compute.manager [req-fb8af0a6-f674-4933-8ee7-2f2320cdc97b req-130ebe6b-4e21-43eb-a1f5-25b065997a29 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received unexpected event network-vif-unplugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 for instance with vm_state resized and task_state resize_reverting.
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.compute.manager [req-fb8af0a6-f674-4933-8ee7-2f2320cdc97b req-130ebe6b-4e21-43eb-a1f5-25b065997a29 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-fb8af0a6-f674-4933-8ee7-2f2320cdc97b req-130ebe6b-4e21-43eb-a1f5-25b065997a29 service nova] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-fb8af0a6-f674-4933-8ee7-2f2320cdc97b req-130ebe6b-4e21-43eb-a1f5-25b065997a29 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-fb8af0a6-f674-4933-8ee7-2f2320cdc97b req-130ebe6b-4e21-43eb-a1f5-25b065997a29 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.compute.manager [req-fb8af0a6-f674-4933-8ee7-2f2320cdc97b req-130ebe6b-4e21-43eb-a1f5-25b065997a29 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] No waiting events found dispatching network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:07 user nova-compute[74776]: WARNING nova.compute.manager [req-fb8af0a6-f674-4933-8ee7-2f2320cdc97b req-130ebe6b-4e21-43eb-a1f5-25b065997a29 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received unexpected event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 for instance with vm_state resized and task_state resize_reverting.
Nov 22 14:22:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:07 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Instance destroyed successfully.
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1556564197',display_name='tempest-ServerActionsTestOtherA-server-676961491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1556564197',id=13,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAC9v0i+pER3cZ0Jjqv3cqTkz1HXyHfnSqpokTPMCo4Rsk1FySmrASTuu3c9HUsU6AsfF7+7FSXMyaBmojZ6N9tkTFvl0ozPbgI/kAIfW0Flf0H56UyV24UUsrzbg38lsw==',key_name='tempest-keypair-32107482',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:20:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3958d7be91b4bb1b9e314d8867cd8f5',ramdisk_id='',reservation_id='r-o0y8arto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-109524404',owner_user_name='tempest-ServerActionsTestOtherA-109524404-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:22:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f703bfbe762447778429bda22b74505c',uuid=d7f3ff5e-292d-4e81-af58-b9a45adfbda1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "address": "fa:16:3e:22:fe:77", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81372b6e-81", "ovs_interfaceid": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converting VIF {"id": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "address": "fa:16:3e:22:fe:77", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81372b6e-81", "ovs_interfaceid": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:fe:77,bridge_name='br-int',has_traffic_filtering=True,id=81372b6e-8162-4b1f-ac94-dcaf1c8c2473,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81372b6e-81') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_vif [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:fe:77,bridge_name='br-int',has_traffic_filtering=True,id=81372b6e-8162-4b1f-ac94-dcaf1c8c2473,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81372b6e-81') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81372b6e-81, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7abef39-4d3b-43bd-b3f5-1e300804ff74) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:07 user nova-compute[74776]: INFO os_vif [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:fe:77,bridge_name='br-int',has_traffic_filtering=True,id=81372b6e-8162-4b1f-ac94-dcaf1c8c2473,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81372b6e-81')
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJHwfbLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:22:07 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquiring lock "interface-6dcf355f-759d-4a9a-9fb6-394e242c03e4-b25ae5ba-034e-4c8f-b11a-570458c20dfe" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "interface-6dcf355f-759d-4a9a-9fb6-394e242c03e4-b25ae5ba-034e-4c8f-b11a-570458c20dfe" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.objects.instance [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lazy-loading 'flavor' on Instance uuid 6dcf355f-759d-4a9a-9fb6-394e242c03e4 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1295290313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1295290313',id=12,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOi2wt6bwWC52YfMKFz0ZOdIihoSozV9972X7DtLjMCaPcI7UTCrW5QcIACFjc56Pj6b7cRSH9i47OvgkdTcAES+2IVEx2e8rM0Q9iF4eOSwA6MrKwoAcVhYd6C5lAkb1w==',key_name='tempest-keypair-973400344',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:19:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='027310982a0047d9a0d06c29b5b6e1f2',ramdisk_id='',reservation_id='r-n0ic6hqp',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2066916431',owner_user_name='tempest-TaggedAttachmentsTest-2066916431-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:19:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d173b822df3448bb49245f30afc0e17',uuid=6dcf355f-759d-4a9a-9fb6-394e242c03e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b25ae5ba-034e-4c8f-b11a-570458c20dfe", "address": "fa:16:3e:7a:a2:a1", "network": {"id": "ac41ca40-21af-4bcd-a64f-afc65a8556f3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-121572572", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb25ae5ba-03", "ovs_interfaceid": "b25ae5ba-034e-4c8f-b11a-570458c20dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Converting VIF {"id": "b25ae5ba-034e-4c8f-b11a-570458c20dfe", "address": "fa:16:3e:7a:a2:a1", "network": {"id": "ac41ca40-21af-4bcd-a64f-afc65a8556f3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-121572572", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb25ae5ba-03", "ovs_interfaceid": "b25ae5ba-034e-4c8f-b11a-570458c20dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a2:a1,bridge_name='br-int',has_traffic_filtering=True,id=b25ae5ba-034e-4c8f-b11a-570458c20dfe,network=Network(ac41ca40-21af-4bcd-a64f-afc65a8556f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb25ae5ba-03') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7a:a2:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tapb25ae5ba-03"/></interface> {{(pid=74776) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7a:a2:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tapb25ae5ba-03"/></interface> {{(pid=74776) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Attempting to detach device tapb25ae5ba-03 from instance 6dcf355f-759d-4a9a-9fb6-394e242c03e4 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] detach device xml: <interface type="ethernet">
Nov 22 14:22:07 user nova-compute[74776]:   <mac address="fa:16:3e:7a:a2:a1"/>
Nov 22 14:22:07 user nova-compute[74776]:   <model type="virtio"/>
Nov 22 14:22:07 user nova-compute[74776]:   <mtu size="1442"/>
Nov 22 14:22:07 user nova-compute[74776]:   <target dev="tapb25ae5ba-03"/>
Nov 22 14:22:07 user nova-compute[74776]: </interface>
Nov 22 14:22:07 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7a:a2:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tapb25ae5ba-03"/></interface> {{(pid=74776) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7a:a2:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tapb25ae5ba-03"/></interface>not found in domain: <domain type='kvm' id='12'>
Nov 22 14:22:07 user nova-compute[74776]:   <name>instance-0000000c</name>
Nov 22 14:22:07 user nova-compute[74776]:   <uuid>6dcf355f-759d-4a9a-9fb6-394e242c03e4</uuid>
Nov 22 14:22:07 user nova-compute[74776]:   <metadata>
Nov 22 14:22:07 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:22:07 user nova-compute[74776]:   <nova:package version="0.0.0"/>
Nov 22 14:22:07 user nova-compute[74776]:   <nova:name>tempest-device-tagging-server-1295290313</nova:name>
Nov 22 14:22:07 user nova-compute[74776]:   <nova:creationTime>2023-11-22 14:21:32</nova:creationTime>
Nov 22 14:22:07 user nova-compute[74776]:   <nova:flavor name="m1.tiny">
Nov 22 14:22:07 user nova-compute[74776]:     <nova:memory>512</nova:memory>
Nov 22 14:22:07 user nova-compute[74776]:     <nova:disk>1</nova:disk>
Nov 22 14:22:07 user nova-compute[74776]:     <nova:swap>0</nova:swap>
Nov 22 14:22:07 user nova-compute[74776]:     <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:22:07 user nova-compute[74776]:     <nova:vcpus>1</nova:vcpus>
Nov 22 14:22:07 user nova-compute[74776]:   </nova:flavor>
Nov 22 14:22:07 user nova-compute[74776]:   <nova:owner>
Nov 22 14:22:07 user nova-compute[74776]:     <nova:user uuid="1d173b822df3448bb49245f30afc0e17">tempest-TaggedAttachmentsTest-2066916431-project-member</nova:user>
Nov 22 14:22:07 user nova-compute[74776]:     <nova:project uuid="027310982a0047d9a0d06c29b5b6e1f2">tempest-TaggedAttachmentsTest-2066916431</nova:project>
Nov 22 14:22:07 user nova-compute[74776]:   </nova:owner>
Nov 22 14:22:07 user nova-compute[74776]:   <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:22:07 user nova-compute[74776]:   <nova:ports>
Nov 22 14:22:07 user nova-compute[74776]:     <nova:port uuid="d13f9065-d7f3-4274-929f-3ac85db8bf73">
Nov 22 14:22:07 user nova-compute[74776]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 14:22:07 user nova-compute[74776]:     </nova:port>
Nov 22 14:22:07 user nova-compute[74776]:     <nova:port uuid="b25ae5ba-034e-4c8f-b11a-570458c20dfe">
Nov 22 14:22:07 user nova-compute[74776]:       <nova:ip type="fixed" address="10.10.10.228" ipVersion="4"/>
Nov 22 14:22:07 user nova-compute[74776]:     </nova:port>
Nov 22 14:22:07 user nova-compute[74776]:   </nova:ports>
Nov 22 14:22:07 user nova-compute[74776]: </nova:instance>
Nov 22 14:22:07 user nova-compute[74776]:   </metadata>
Nov 22 14:22:07 user nova-compute[74776]:   <memory unit='KiB'>524288</memory>
Nov 22 14:22:07 user nova-compute[74776]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 22 14:22:07 user nova-compute[74776]:   <vcpu placement='static'>1</vcpu>
Nov 22 14:22:07 user nova-compute[74776]:   <resource>
Nov 22 14:22:07 user nova-compute[74776]:     <partition>/machine</partition>
Nov 22 14:22:07 user nova-compute[74776]:   </resource>
Nov 22 14:22:07 user nova-compute[74776]:   <sysinfo type='smbios'>
Nov 22 14:22:07 user nova-compute[74776]:     <system>
Nov 22 14:22:07 user nova-compute[74776]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 22 14:22:07 user nova-compute[74776]:       <entry name='product'>OpenStack Nova</entry>
Nov 22 14:22:07 user nova-compute[74776]:       <entry name='version'>0.0.0</entry>
Nov 22 14:22:07 user nova-compute[74776]:       <entry name='serial'>6dcf355f-759d-4a9a-9fb6-394e242c03e4</entry>
Nov 22 14:22:07 user nova-compute[74776]:       <entry name='uuid'>6dcf355f-759d-4a9a-9fb6-394e242c03e4</entry>
Nov 22 14:22:07 user nova-compute[74776]:       <entry name='family'>Virtual Machine</entry>
Nov 22 14:22:07 user nova-compute[74776]:     </system>
Nov 22 14:22:07 user nova-compute[74776]:   </sysinfo>
Nov 22 14:22:07 user nova-compute[74776]:   <os>
Nov 22 14:22:07 user nova-compute[74776]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 22 14:22:07 user nova-compute[74776]:     <boot dev='hd'/>
Nov 22 14:22:07 user nova-compute[74776]:     <smbios mode='sysinfo'/>
Nov 22 14:22:07 user nova-compute[74776]:   </os>
Nov 22 14:22:07 user nova-compute[74776]:   <features>
Nov 22 14:22:07 user nova-compute[74776]:     <acpi/>
Nov 22 14:22:07 user nova-compute[74776]:     <apic/>
Nov 22 14:22:07 user nova-compute[74776]:     <vmcoreinfo state='on'/>
Nov 22 14:22:07 user nova-compute[74776]:   </features>
Nov 22 14:22:07 user nova-compute[74776]:   <cpu mode='custom' match='exact' check='full'>
Nov 22 14:22:07 user nova-compute[74776]:     <model fallback='forbid'>Nehalem</model>
Nov 22 14:22:07 user nova-compute[74776]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 22 14:22:07 user nova-compute[74776]:     <feature policy='require' name='vme'/>
Nov 22 14:22:07 user nova-compute[74776]:     <feature policy='require' name='x2apic'/>
Nov 22 14:22:07 user nova-compute[74776]:     <feature policy='require' name='hypervisor'/>
Nov 22 14:22:07 user nova-compute[74776]:   </cpu>
Nov 22 14:22:07 user nova-compute[74776]:   <clock offset='utc'>
Nov 22 14:22:07 user nova-compute[74776]:     <timer name='pit' tickpolicy='delay'/>
Nov 22 14:22:07 user nova-compute[74776]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 22 14:22:07 user nova-compute[74776]:     <timer name='hpet' present='no'/>
Nov 22 14:22:07 user nova-compute[74776]:   </clock>
Nov 22 14:22:07 user nova-compute[74776]:   <on_poweroff>destroy</on_poweroff>
Nov 22 14:22:07 user nova-compute[74776]:   <on_reboot>restart</on_reboot>
Nov 22 14:22:07 user nova-compute[74776]:   <on_crash>destroy</on_crash>
Nov 22 14:22:07 user nova-compute[74776]:   <devices>
Nov 22 14:22:07 user nova-compute[74776]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 22 14:22:07 user nova-compute[74776]:     <disk type='file' device='disk'>
Nov 22 14:22:07 user nova-compute[74776]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 22 14:22:07 user nova-compute[74776]:       <source file='/opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk' index='2'/>
Nov 22 14:22:07 user nova-compute[74776]:       <backingStore type='file' index='3'>
Nov 22 14:22:07 user nova-compute[74776]:         <format type='raw'/>
Nov 22 14:22:07 user nova-compute[74776]:         <source file='/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e'/>
Nov 22 14:22:07 user nova-compute[74776]:         <backingStore/>
Nov 22 14:22:07 user nova-compute[74776]:       </backingStore>
Nov 22 14:22:07 user nova-compute[74776]:       <target dev='vda' bus='virtio'/>
Nov 22 14:22:07 user nova-compute[74776]:       <alias name='virtio-disk0'/>
Nov 22 14:22:07 user nova-compute[74776]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 22 14:22:07 user nova-compute[74776]:     </disk>
Nov 22 14:22:07 user nova-compute[74776]:     <disk type='file' device='cdrom'>
Nov 22 14:22:07 user nova-compute[74776]:       <driver name='qemu' type='raw' cache='none'/>
Nov 22 14:22:07 user nova-compute[74776]:       <source file='/opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk.config' index='1'/>
Nov 22 14:22:07 user nova-compute[74776]:       <backingStore/>
Nov 22 14:22:07 user nova-compute[74776]:       <target dev='hda' bus='ide'/>
Nov 22 14:22:07 user nova-compute[74776]:       <readonly/>
Nov 22 14:22:07 user nova-compute[74776]:       <alias name='ide0-0-0'/>
Nov 22 14:22:07 user nova-compute[74776]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 22 14:22:07 user nova-compute[74776]:     </disk>
Nov 22 14:22:07 user nova-compute[74776]:     <controller type='usb' index='0' model='none'>
Nov 22 14:22:07 user nova-compute[74776]:       <alias name='usb'/>
Nov 22 14:22:07 user nova-compute[74776]:     </controller>
Nov 22 14:22:07 user nova-compute[74776]:     <controller type='pci' index='0' model='pci-root'>
Nov 22 14:22:07 user nova-compute[74776]:       <alias name='pci.0'/>
Nov 22 14:22:07 user nova-compute[74776]:     </controller>
Nov 22 14:22:07 user nova-compute[74776]:     <controller type='ide' index='0'>
Nov 22 14:22:07 user nova-compute[74776]:       <alias name='ide'/>
Nov 22 14:22:07 user nova-compute[74776]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 22 14:22:07 user nova-compute[74776]:     </controller>
Nov 22 14:22:07 user nova-compute[74776]:     <interface type='ethernet'>
Nov 22 14:22:07 user nova-compute[74776]:       <mac address='fa:16:3e:0f:a0:64'/>
Nov 22 14:22:07 user nova-compute[74776]:       <target dev='tapd13f9065-d7'/>
Nov 22 14:22:07 user nova-compute[74776]:       <model type='virtio'/>
Nov 22 14:22:07 user nova-compute[74776]:       <mtu size='1442'/>
Nov 22 14:22:07 user nova-compute[74776]:       <alias name='net0'/>
Nov 22 14:22:07 user nova-compute[74776]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 22 14:22:07 user nova-compute[74776]:     </interface>
Nov 22 14:22:07 user nova-compute[74776]:     <interface type='ethernet'>
Nov 22 14:22:07 user nova-compute[74776]:       <mac address='fa:16:3e:7a:a2:a1'/>
Nov 22 14:22:07 user nova-compute[74776]:       <target dev='tapb25ae5ba-03'/>
Nov 22 14:22:07 user nova-compute[74776]:       <model type='virtio'/>
Nov 22 14:22:07 user nova-compute[74776]:       <mtu size='1442'/>
Nov 22 14:22:07 user nova-compute[74776]:       <alias name='net1'/>
Nov 22 14:22:07 user nova-compute[74776]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 22 14:22:07 user nova-compute[74776]:     </interface>
Nov 22 14:22:07 user nova-compute[74776]:     <serial type='pty'>
Nov 22 14:22:07 user nova-compute[74776]:       <source path='/dev/pts/4'/>
Nov 22 14:22:07 user nova-compute[74776]:       <log file='/opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/console.log' append='off'/>
Nov 22 14:22:07 user nova-compute[74776]:       <target type='isa-serial' port='0'>
Nov 22 14:22:07 user nova-compute[74776]:         <model name='isa-serial'/>
Nov 22 14:22:07 user nova-compute[74776]:       </target>
Nov 22 14:22:07 user nova-compute[74776]:       <alias name='serial0'/>
Nov 22 14:22:07 user nova-compute[74776]:     </serial>
Nov 22 14:22:07 user nova-compute[74776]:     <console type='pty' tty='/dev/pts/4'>
Nov 22 14:22:07 user nova-compute[74776]:       <source path='/dev/pts/4'/>
Nov 22 14:22:07 user nova-compute[74776]:       <log file='/opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/console.log' append='off'/>
Nov 22 14:22:07 user nova-compute[74776]:       <target type='serial' port='0'/>
Nov 22 14:22:07 user nova-compute[74776]:       <alias name='serial0'/>
Nov 22 14:22:07 user nova-compute[74776]:     </console>
Nov 22 14:22:07 user nova-compute[74776]:     <input type='mouse' bus='ps2'>
Nov 22 14:22:07 user nova-compute[74776]:       <alias name='input0'/>
Nov 22 14:22:07 user nova-compute[74776]:     </input>
Nov 22 14:22:07 user nova-compute[74776]:     <input type='keyboard' bus='ps2'>
Nov 22 14:22:07 user nova-compute[74776]:       <alias name='input1'/>
Nov 22 14:22:07 user nova-compute[74776]:     </input>
Nov 22 14:22:07 user nova-compute[74776]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 22 14:22:07 user nova-compute[74776]:       <listen type='address' address='0.0.0.0'/>
Nov 22 14:22:07 user nova-compute[74776]:     </graphics>
Nov 22 14:22:07 user nova-compute[74776]:     <audio id='1' type='none'/>
Nov 22 14:22:07 user nova-compute[74776]:     <video>
Nov 22 14:22:07 user nova-compute[74776]:       <model type='virtio' heads='1' primary='yes'/>
Nov 22 14:22:07 user nova-compute[74776]:       <alias name='video0'/>
Nov 22 14:22:07 user nova-compute[74776]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 22 14:22:07 user nova-compute[74776]:     </video>
Nov 22 14:22:07 user nova-compute[74776]:     <memballoon model='virtio'>
Nov 22 14:22:07 user nova-compute[74776]:       <stats period='10'/>
Nov 22 14:22:07 user nova-compute[74776]:       <alias name='balloon0'/>
Nov 22 14:22:07 user nova-compute[74776]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 22 14:22:07 user nova-compute[74776]:     </memballoon>
Nov 22 14:22:07 user nova-compute[74776]:     <rng model='virtio'>
Nov 22 14:22:07 user nova-compute[74776]:       <backend model='random'>/dev/urandom</backend>
Nov 22 14:22:07 user nova-compute[74776]:       <alias name='rng0'/>
Nov 22 14:22:07 user nova-compute[74776]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 22 14:22:07 user nova-compute[74776]:     </rng>
Nov 22 14:22:07 user nova-compute[74776]:   </devices>
Nov 22 14:22:07 user nova-compute[74776]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 22 14:22:07 user nova-compute[74776]:     <label>libvirt-6dcf355f-759d-4a9a-9fb6-394e242c03e4</label>
Nov 22 14:22:07 user nova-compute[74776]:     <imagelabel>libvirt-6dcf355f-759d-4a9a-9fb6-394e242c03e4</imagelabel>
Nov 22 14:22:07 user nova-compute[74776]:   </seclabel>
Nov 22 14:22:07 user nova-compute[74776]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 22 14:22:07 user nova-compute[74776]:     <label>+64055:+108</label>
Nov 22 14:22:07 user nova-compute[74776]:     <imagelabel>+64055:+108</imagelabel>
Nov 22 14:22:07 user nova-compute[74776]:   </seclabel>
Nov 22 14:22:07 user nova-compute[74776]: </domain>
Nov 22 14:22:07 user nova-compute[74776]:  {{(pid=74776) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 22 14:22:07 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Successfully detached device tapb25ae5ba-03 from instance 6dcf355f-759d-4a9a-9fb6-394e242c03e4 from the persistent domain config.
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] (1/8): Attempting to detach device tapb25ae5ba-03 with device alias net1 from instance 6dcf355f-759d-4a9a-9fb6-394e242c03e4 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] detach device xml: <interface type="ethernet">
Nov 22 14:22:07 user nova-compute[74776]:   <mac address="fa:16:3e:7a:a2:a1"/>
Nov 22 14:22:07 user nova-compute[74776]:   <model type="virtio"/>
Nov 22 14:22:07 user nova-compute[74776]:   <mtu size="1442"/>
Nov 22 14:22:07 user nova-compute[74776]:   <target dev="tapb25ae5ba-03"/>
Nov 22 14:22:07 user nova-compute[74776]: </interface>
Nov 22 14:22:07 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] <== connect_volume: return (2063ms) {'type': 'block', 'scsi_wwn': '26630623964663262', 'path': '/dev/sde'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630623964663262', 'path': '/dev/sde'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.862s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d056b9-bbd8-478e-9fc5-d62ce84573ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:22:07 user nova-compute[74776]: No targets found.
Nov 22 14:22:07 user nova-compute[74776]: iSNS:
Nov 22 14:22:07 user nova-compute[74776]: No targets found.
Nov 22 14:22:07 user nova-compute[74776]: STATIC:
Nov 22 14:22:07 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848
Nov 22 14:22:07 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:07 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:07 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3
Nov 22 14:22:07 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:07 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:07 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f
Nov 22 14:22:07 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:07 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:07 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065
Nov 22 14:22:07 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:07 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:07 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f
Nov 22 14:22:07 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:07 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:07 user nova-compute[74776]: FIRMWARE:
Nov 22 14:22:07 user nova-compute[74776]: No targets found.
Nov 22 14:22:07 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:22:07 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:22:07 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fuKZVYwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:22:07 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9757a0-60af-4276-a0eb-86a8574a45bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c864024-b435-4834-9e67-4f882ec89a4f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:07 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:07 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:07 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:07 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:07 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:07 user nova-compute[74776]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:07 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:07 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:07 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:07 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c58287c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3'): ({'sdc'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Removing single pathed devices sdc {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Start waiting for the detach event from libvirt for device tapb25ae5ba-03 with device alias net1 for instance 6dcf355f-759d-4a9a-9fb6-394e242c03e4 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b58ad1-2a47-4271-af92-3c5fd53dd2af]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e298a6-c76e-4448-806f-b214476e12de]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Flushing IO for device /dev/sdc {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.011s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[590de7e7-c8e7-4e87-ab9d-69e6a277349e]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f991a2c4-79e4-41a3-9dff-09e85b1cc960]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef29f1c-66ed-49ef-ac46-730f4e0aee22]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.compute.manager [req-59c0529e-e689-4184-9bfd-8380d2878e67 req-79f8fa11-5990-45e3-ae90-2afe79619c9e service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Received event network-vif-unplugged-b25ae5ba-034e-4c8f-b11a-570458c20dfe {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-59c0529e-e689-4184-9bfd-8380d2878e67 req-79f8fa11-5990-45e3-ae90-2afe79619c9e service nova] Acquiring lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-59c0529e-e689-4184-9bfd-8380d2878e67 req-79f8fa11-5990-45e3-ae90-2afe79619c9e service nova] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-59c0529e-e689-4184-9bfd-8380d2878e67 req-79f8fa11-5990-45e3-ae90-2afe79619c9e service nova] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG nova.compute.manager [req-59c0529e-e689-4184-9bfd-8380d2878e67 req-79f8fa11-5990-45e3-ae90-2afe79619c9e service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] No waiting events found dispatching network-vif-unplugged-b25ae5ba-034e-4c8f-b11a-570458c20dfe {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:07 user nova-compute[74776]: WARNING nova.compute.manager [req-59c0529e-e689-4184-9bfd-8380d2878e67 req-79f8fa11-5990-45e3-ae90-2afe79619c9e service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Received unexpected event network-vif-unplugged-b25ae5ba-034e-4c8f-b11a-570458c20dfe for instance with vm_state active and task_state None.
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b74cf4-d14a-40ba-8c1c-8127f519dae5]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260]
Nov 22 14:22:07 user nova-compute[74776]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260] successful.
Nov 22 14:22:07 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8dd8f0-4fd2-4297-89a0-7b7b4d354b64]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] <== disconnect_volume: return (1208ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.819s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e9409f-0ab0-4ccf-aed9-c1ab3c582fb9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:22:08 user nova-compute[74776]: No targets found.
Nov 22 14:22:08 user nova-compute[74776]: iSNS:
Nov 22 14:22:08 user nova-compute[74776]: No targets found.
Nov 22 14:22:08 user nova-compute[74776]: STATIC:
Nov 22 14:22:08 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848
Nov 22 14:22:08 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:08 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:08 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f
Nov 22 14:22:08 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:08 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:08 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065
Nov 22 14:22:08 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:08 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:08 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f
Nov 22 14:22:08 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:08 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:08 user nova-compute[74776]: FIRMWARE:
Nov 22 14:22:08 user nova-compute[74776]: No targets found.
Nov 22 14:22:08 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:22:08 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:22:08 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40146b5-5b88-4f05-ba53-7f185f2170ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a7340b-31b3-4889-b3d6-3194e53d6f2f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:08 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:08 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:08 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:08 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:08 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:08 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:08 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:08 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c582f2f80>, {}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Disconnecting from: [] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] <== disconnect_volume: return (898ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:22:08 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Deleting instance files /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1_del
Nov 22 14:22:08 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Deletion of /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1_del complete
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.395s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:08 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:08 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c46caf8-3ad4-495b-80df-ea760e147688]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:22:08 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7c3b4e-57bf-484b-910a-77ca4b4b1669]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a] added
Nov 22 14:22:08 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d149883-30dd-473d-aa9e-43978ba85068]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcd9e4c-e973-465f-bc8b-3b136b653fd0]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fuKZVYwq {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:08 user nova-compute[74776]: INFO nova.virt.block_device [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Booting with volume f4f9db8e-6078-4602-be9a-f6e8b1e727b3 at /dev/vdb
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fuKZVYwq" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef396874-26d9-4fdf-b447-c00dd6e83534]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fuKZVYwq'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[25becaa0-6f62-41ab-bdd9-6e85e67e5d41]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.utils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a48b3a6-497d-47ad-bb68-a69301c7fcd0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:08 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:08 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:08 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:08 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:08 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:08 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:08 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:08 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c91fe5-3ce6-4021-b912-bbc24fa0c84b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6188058d-c822-4031-b1cb-0ede76db3d25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fcf8aa-2647-4c09-897a-5df9ec957ef9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a9fdf0-a1a8-4e3c-a70b-41eeb8e7e126]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d953c978-5e88-4ba9-8fcf-37a3ce5b9ca3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a, portal: 172.16.0.220,3260]
Nov 22 14:22:08 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a, portal: 172.16.0.220,3260] successful.
Nov 22 14:22:08 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:22:08 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[046c83dd-1f64-484c-93e0-2e82296811ef]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.utils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Updating existing volume attachment record: 2f9d9810-63bc-4474-867d-aab5b5279a42 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6594cf-c155-48a8-b327-2c4a82dc7534]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08eee8f-1bb8-4b47-8980-ff7c13bf7ec1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:08 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:08 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:08 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:08 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:08 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:08 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:08 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:08 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:08 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:08 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[19378885-dc9d-41d9-9b28-dde1bfc71dae]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: None {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Didn't find any instances for network info cache update. {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG nova.objects.instance [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lazy-loading 'migration_context' on Instance uuid e96ab1bf-6f19-4e5f-b79d-f0266988090b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:08 user nova-compute[74776]: DEBUG nova.objects.base [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Object Instance<e96ab1bf-6f19-4e5f-b79d-f0266988090b> lazy-loaded attributes: resources,migration_context {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-cd49a7c0-e24d-4b08-98bc-6ff81dbc632a req-9b8db517-628b-484f-bcc6-8f04ac311b83 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received event network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cd49a7c0-e24d-4b08-98bc-6ff81dbc632a req-9b8db517-628b-484f-bcc6-8f04ac311b83 service nova] Acquiring lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cd49a7c0-e24d-4b08-98bc-6ff81dbc632a req-9b8db517-628b-484f-bcc6-8f04ac311b83 service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cd49a7c0-e24d-4b08-98bc-6ff81dbc632a req-9b8db517-628b-484f-bcc6-8f04ac311b83 service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-cd49a7c0-e24d-4b08-98bc-6ff81dbc632a req-9b8db517-628b-484f-bcc6-8f04ac311b83 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] No waiting events found dispatching network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:09 user nova-compute[74776]: WARNING nova.compute.manager [req-cd49a7c0-e24d-4b08-98bc-6ff81dbc632a req-9b8db517-628b-484f-bcc6-8f04ac311b83 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received unexpected event network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e for instance with vm_state rescued and task_state unrescuing.
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-cd49a7c0-e24d-4b08-98bc-6ff81dbc632a req-9b8db517-628b-484f-bcc6-8f04ac311b83 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received event network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cd49a7c0-e24d-4b08-98bc-6ff81dbc632a req-9b8db517-628b-484f-bcc6-8f04ac311b83 service nova] Acquiring lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cd49a7c0-e24d-4b08-98bc-6ff81dbc632a req-9b8db517-628b-484f-bcc6-8f04ac311b83 service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cd49a7c0-e24d-4b08-98bc-6ff81dbc632a req-9b8db517-628b-484f-bcc6-8f04ac311b83 service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-cd49a7c0-e24d-4b08-98bc-6ff81dbc632a req-9b8db517-628b-484f-bcc6-8f04ac311b83 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] No waiting events found dispatching network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:09 user nova-compute[74776]: WARNING nova.compute.manager [req-cd49a7c0-e24d-4b08-98bc-6ff81dbc632a req-9b8db517-628b-484f-bcc6-8f04ac311b83 service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received unexpected event network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e for instance with vm_state rescued and task_state unrescuing.
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.compute.manager [None req-94ad0863-a1f5-4afa-beb8-74543a6c2b42 tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.503s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fuKZVYwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] <== connect_volume: return (1763ms) {'type': 'block', 'scsi_wwn': '26465353864636563', 'path': '/dev/sdc'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465353864636563', 'path': '/dev/sdc'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-404720208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-404720208',id=19,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9gPq9VvMiaCjz4jYQfD2X7t/kdIY759yEoUNDsiedT8w0+KrpqXNAWDUJBS32NG8AcPT9hsMwWnSuTON9ZI8QrT5b4OI2633ygBIkQus263nx/aRlzu77alZ84xwlRow==',key_name='tempest-keypair-1960061017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c09ea5e02a3340b0b2326971a28fd88a',ramdisk_id='',reservation_id='r-ul5083f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402092407',owner_user_name='tempest-TaggedBootDevicesTest-1402092407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3997118da5d641489bf9e772eabc156e',uuid=84dbab20-fe7f-4b9e-bc02-6c739029f69d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "address": "fa:16:3e:c7:ba:0a", "network": {"id": "10549d92-6312-459c-b167-bdd2396d9c88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1836352595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9601d6f-cf", "ovs_interfaceid": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converting VIF {"id": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "address": "fa:16:3e:c7:ba:0a", "network": {"id": "10549d92-6312-459c-b167-bdd2396d9c88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1836352595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9601d6f-cf", "ovs_interfaceid": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:ba:0a,bridge_name='br-int',has_traffic_filtering=True,id=a9601d6f-cfc5-47b5-8260-414d5ac1157f,network=Network(10549d92-6312-459c-b167-bdd2396d9c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9601d6f-cf') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-404720208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-404720208',id=19,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9gPq9VvMiaCjz4jYQfD2X7t/kdIY759yEoUNDsiedT8w0+KrpqXNAWDUJBS32NG8AcPT9hsMwWnSuTON9ZI8QrT5b4OI2633ygBIkQus263nx/aRlzu77alZ84xwlRow==',key_name='tempest-keypair-1960061017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c09ea5e02a3340b0b2326971a28fd88a',ramdisk_id='',reservation_id='r-ul5083f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402092407',owner_user_name='tempest-TaggedBootDevicesTest-1402092407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3997118da5d641489bf9e772eabc156e',uuid=84dbab20-fe7f-4b9e-bc02-6c739029f69d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81b8bd85-da35-47cb-880f-6b3de9efd406", "address": "fa:16:3e:59:13:7f", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b8bd85-da", "ovs_interfaceid": "81b8bd85-da35-47cb-880f-6b3de9efd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converting VIF {"id": "81b8bd85-da35-47cb-880f-6b3de9efd406", "address": "fa:16:3e:59:13:7f", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b8bd85-da", "ovs_interfaceid": "81b8bd85-da35-47cb-880f-6b3de9efd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:13:7f,bridge_name='br-int',has_traffic_filtering=True,id=81b8bd85-da35-47cb-880f-6b3de9efd406,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap81b8bd85-da') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-404720208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-404720208',id=19,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9gPq9VvMiaCjz4jYQfD2X7t/kdIY759yEoUNDsiedT8w0+KrpqXNAWDUJBS32NG8AcPT9hsMwWnSuTON9ZI8QrT5b4OI2633ygBIkQus263nx/aRlzu77alZ84xwlRow==',key_name='tempest-keypair-1960061017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c09ea5e02a3340b0b2326971a28fd88a',ramdisk_id='',reservation_id='r-ul5083f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402092407',owner_user_name='tempest-TaggedBootDevicesTest-1402092407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3997118da5d641489bf9e772eabc156e',uuid=84dbab20-fe7f-4b9e-bc02-6c739029f69d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "address": "fa:16:3e:92:19:97", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6ff5ee-91", "ovs_interfaceid": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converting VIF {"id": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "address": "fa:16:3e:92:19:97", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6ff5ee-91", "ovs_interfaceid": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:19:97,bridge_name='br-int',has_traffic_filtering=True,id=df6ff5ee-9150-4078-8357-caeb01f35ff8,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdf6ff5ee-91') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-404720208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-404720208',id=19,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9gPq9VvMiaCjz4jYQfD2X7t/kdIY759yEoUNDsiedT8w0+KrpqXNAWDUJBS32NG8AcPT9hsMwWnSuTON9ZI8QrT5b4OI2633ygBIkQus263nx/aRlzu77alZ84xwlRow==',key_name='tempest-keypair-1960061017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c09ea5e02a3340b0b2326971a28fd88a',ramdisk_id='',reservation_id='r-ul5083f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402092407',owner_user_name='tempest-TaggedBootDevicesTest-1402092407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3997118da5d641489bf9e772eabc156e',uuid=84dbab20-fe7f-4b9e-bc02-6c739029f69d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e631b486-fff8-4c8b-b688-138a941b0440", "address": "fa:16:3e:47:e8:14", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape631b486-ff", "ovs_interfaceid": "e631b486-fff8-4c8b-b688-138a941b0440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converting VIF {"id": "e631b486-fff8-4c8b-b688-138a941b0440", "address": "fa:16:3e:47:e8:14", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape631b486-ff", "ovs_interfaceid": "e631b486-fff8-4c8b-b688-138a941b0440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:e8:14,bridge_name='br-int',has_traffic_filtering=True,id=e631b486-fff8-4c8b-b688-138a941b0440,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape631b486-ff') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-404720208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-404720208',id=19,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9gPq9VvMiaCjz4jYQfD2X7t/kdIY759yEoUNDsiedT8w0+KrpqXNAWDUJBS32NG8AcPT9hsMwWnSuTON9ZI8QrT5b4OI2633ygBIkQus263nx/aRlzu77alZ84xwlRow==',key_name='tempest-keypair-1960061017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c09ea5e02a3340b0b2326971a28fd88a',ramdisk_id='',reservation_id='r-ul5083f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402092407',owner_user_name='tempest-TaggedBootDevicesTest-1402092407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3997118da5d641489bf9e772eabc156e',uuid=84dbab20-fe7f-4b9e-bc02-6c739029f69d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7053999-2290-4f4e-a386-1ffc306de05a", "address": "fa:16:3e:3b:bf:db", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7053999-22", "ovs_interfaceid": "c7053999-2290-4f4e-a386-1ffc306de05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converting VIF {"id": "c7053999-2290-4f4e-a386-1ffc306de05a", "address": "fa:16:3e:3b:bf:db", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7053999-22", "ovs_interfaceid": "c7053999-2290-4f4e-a386-1ffc306de05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bf:db,bridge_name='br-int',has_traffic_filtering=True,id=c7053999-2290-4f4e-a386-1ffc306de05a,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7053999-22') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-404720208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-404720208',id=19,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9gPq9VvMiaCjz4jYQfD2X7t/kdIY759yEoUNDsiedT8w0+KrpqXNAWDUJBS32NG8AcPT9hsMwWnSuTON9ZI8QrT5b4OI2633ygBIkQus263nx/aRlzu77alZ84xwlRow==',key_name='tempest-keypair-1960061017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c09ea5e02a3340b0b2326971a28fd88a',ramdisk_id='',reservation_id='r-ul5083f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402092407',owner_user_name='tempest-TaggedBootDevicesTest-1402092407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3997118da5d641489bf9e772eabc156e',uuid=84dbab20-fe7f-4b9e-bc02-6c739029f69d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6f96288-8194-465b-90bd-640ecaec56e4", "address": "fa:16:3e:53:9d:81", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f96288-81", "ovs_interfaceid": "e6f96288-8194-465b-90bd-640ecaec56e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converting VIF {"id": "e6f96288-8194-465b-90bd-640ecaec56e4", "address": "fa:16:3e:53:9d:81", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f96288-81", "ovs_interfaceid": "e6f96288-8194-465b-90bd-640ecaec56e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:9d:81,bridge_name='br-int',has_traffic_filtering=True,id=e6f96288-8194-465b-90bd-640ecaec56e4,network=Network(01e2dcf7-2a81-4621-b5d8-254a7ef53b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6f96288-81') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-404720208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-404720208',id=19,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9gPq9VvMiaCjz4jYQfD2X7t/kdIY759yEoUNDsiedT8w0+KrpqXNAWDUJBS32NG8AcPT9hsMwWnSuTON9ZI8QrT5b4OI2633ygBIkQus263nx/aRlzu77alZ84xwlRow==',key_name='tempest-keypair-1960061017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c09ea5e02a3340b0b2326971a28fd88a',ramdisk_id='',reservation_id='r-ul5083f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402092407',owner_user_name='tempest-TaggedBootDevicesTest-1402092407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3997118da5d641489bf9e772eabc156e',uuid=84dbab20-fe7f-4b9e-bc02-6c739029f69d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "address": "fa:16:3e:dd:3e:54", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0b6445-b3", "ovs_interfaceid": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converting VIF {"id": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "address": "fa:16:3e:dd:3e:54", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0b6445-b3", "ovs_interfaceid": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:3e:54,bridge_name='br-int',has_traffic_filtering=True,id=0f0b6445-b307-4db8-ae22-121bdc8777c6,network=Network(01e2dcf7-2a81-4621-b5d8-254a7ef53b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0b6445-b3') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.objects.instance [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lazy-loading 'pci_devices' on Instance uuid 84dbab20-fe7f-4b9e-bc02-6c739029f69d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:22:09 user nova-compute[74776]:   <uuid>84dbab20-fe7f-4b9e-bc02-6c739029f69d</uuid>
Nov 22 14:22:09 user nova-compute[74776]:   <name>instance-00000013</name>
Nov 22 14:22:09 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:22:09 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:22:09 user nova-compute[74776]:   <metadata>
Nov 22 14:22:09 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:22:09 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:22:09 user nova-compute[74776]:       <nova:name>tempest-device-tagging-server-404720208</nova:name>
Nov 22 14:22:09 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:22:04</nova:creationTime>
Nov 22 14:22:09 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:22:09 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:22:09 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:22:09 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:22:09 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:22:09 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:22:09 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:22:09 user nova-compute[74776]:       <nova:owner>
Nov 22 14:22:09 user nova-compute[74776]:         <nova:user uuid="3997118da5d641489bf9e772eabc156e">tempest-TaggedBootDevicesTest-1402092407-project-member</nova:user>
Nov 22 14:22:09 user nova-compute[74776]:         <nova:project uuid="c09ea5e02a3340b0b2326971a28fd88a">tempest-TaggedBootDevicesTest-1402092407</nova:project>
Nov 22 14:22:09 user nova-compute[74776]:       </nova:owner>
Nov 22 14:22:09 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:22:09 user nova-compute[74776]:       <nova:ports>
Nov 22 14:22:09 user nova-compute[74776]:         <nova:port uuid="a9601d6f-cfc5-47b5-8260-414d5ac1157f">
Nov 22 14:22:09 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 22 14:22:09 user nova-compute[74776]:         </nova:port>
Nov 22 14:22:09 user nova-compute[74776]:         <nova:port uuid="81b8bd85-da35-47cb-880f-6b3de9efd406">
Nov 22 14:22:09 user nova-compute[74776]:           <nova:ip type="fixed" address="10.1.1.130" ipVersion="4"/>
Nov 22 14:22:09 user nova-compute[74776]:         </nova:port>
Nov 22 14:22:09 user nova-compute[74776]:         <nova:port uuid="df6ff5ee-9150-4078-8357-caeb01f35ff8">
Nov 22 14:22:09 user nova-compute[74776]:           <nova:ip type="fixed" address="10.1.1.27" ipVersion="4"/>
Nov 22 14:22:09 user nova-compute[74776]:         </nova:port>
Nov 22 14:22:09 user nova-compute[74776]:         <nova:port uuid="e631b486-fff8-4c8b-b688-138a941b0440">
Nov 22 14:22:09 user nova-compute[74776]:           <nova:ip type="fixed" address="10.1.1.91" ipVersion="4"/>
Nov 22 14:22:09 user nova-compute[74776]:         </nova:port>
Nov 22 14:22:09 user nova-compute[74776]:         <nova:port uuid="c7053999-2290-4f4e-a386-1ffc306de05a">
Nov 22 14:22:09 user nova-compute[74776]:           <nova:ip type="fixed" address="10.1.1.241" ipVersion="4"/>
Nov 22 14:22:09 user nova-compute[74776]:         </nova:port>
Nov 22 14:22:09 user nova-compute[74776]:         <nova:port uuid="e6f96288-8194-465b-90bd-640ecaec56e4">
Nov 22 14:22:09 user nova-compute[74776]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 22 14:22:09 user nova-compute[74776]:         </nova:port>
Nov 22 14:22:09 user nova-compute[74776]:         <nova:port uuid="0f0b6445-b307-4db8-ae22-121bdc8777c6">
Nov 22 14:22:09 user nova-compute[74776]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 22 14:22:09 user nova-compute[74776]:         </nova:port>
Nov 22 14:22:09 user nova-compute[74776]:       </nova:ports>
Nov 22 14:22:09 user nova-compute[74776]:     </nova:instance>
Nov 22 14:22:09 user nova-compute[74776]:   </metadata>
Nov 22 14:22:09 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:22:09 user nova-compute[74776]:     <system>
Nov 22 14:22:09 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:22:09 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:22:09 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:22:09 user nova-compute[74776]:       <entry name="serial">84dbab20-fe7f-4b9e-bc02-6c739029f69d</entry>
Nov 22 14:22:09 user nova-compute[74776]:       <entry name="uuid">84dbab20-fe7f-4b9e-bc02-6c739029f69d</entry>
Nov 22 14:22:09 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:22:09 user nova-compute[74776]:     </system>
Nov 22 14:22:09 user nova-compute[74776]:   </sysinfo>
Nov 22 14:22:09 user nova-compute[74776]:   <os>
Nov 22 14:22:09 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:22:09 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:22:09 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:22:09 user nova-compute[74776]:   </os>
Nov 22 14:22:09 user nova-compute[74776]:   <features>
Nov 22 14:22:09 user nova-compute[74776]:     <acpi/>
Nov 22 14:22:09 user nova-compute[74776]:     <apic/>
Nov 22 14:22:09 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:22:09 user nova-compute[74776]:   </features>
Nov 22 14:22:09 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:22:09 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:22:09 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:22:09 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:22:09 user nova-compute[74776]:   </clock>
Nov 22 14:22:09 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:22:09 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:22:09 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:22:09 user nova-compute[74776]:   </cpu>
Nov 22 14:22:09 user nova-compute[74776]:   <devices>
Nov 22 14:22:09 user nova-compute[74776]:     <disk type="file" device="cdrom">
Nov 22 14:22:09 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none"/>
Nov 22 14:22:09 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/84dbab20-fe7f-4b9e-bc02-6c739029f69d/disk.config"/>
Nov 22 14:22:09 user nova-compute[74776]:       <target dev="hda" bus="ide"/>
Nov 22 14:22:09 user nova-compute[74776]:     </disk>
Nov 22 14:22:09 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:22:09 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:22:09 user nova-compute[74776]:       <source dev="/dev/sdg"/>
Nov 22 14:22:09 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:22:09 user nova-compute[74776]:       <serial>504cd7d5-84cc-40ad-bbe4-009c0933038f</serial>
Nov 22 14:22:09 user nova-compute[74776]:     </disk>
Nov 22 14:22:09 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:22:09 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:22:09 user nova-compute[74776]:       <source dev="/dev/sde"/>
Nov 22 14:22:09 user nova-compute[74776]:       <target dev="vdb" bus="virtio"/>
Nov 22 14:22:09 user nova-compute[74776]:       <serial>721375eb-40a3-4db4-9ee2-a9a6d2460848</serial>
Nov 22 14:22:09 user nova-compute[74776]:     </disk>
Nov 22 14:22:09 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:22:09 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:22:09 user nova-compute[74776]:       <source dev="/dev/sdc"/>
Nov 22 14:22:09 user nova-compute[74776]:       <target dev="vdc" bus="virtio"/>
Nov 22 14:22:09 user nova-compute[74776]:       <serial>929bce78-5b35-40bc-916b-a5420406834a</serial>
Nov 22 14:22:09 user nova-compute[74776]:     </disk>
Nov 22 14:22:09 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:22:09 user nova-compute[74776]:       <mac address="fa:16:3e:c7:ba:0a"/>
Nov 22 14:22:09 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:22:09 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:22:09 user nova-compute[74776]:       <target dev="tapa9601d6f-cf"/>
Nov 22 14:22:09 user nova-compute[74776]:     </interface>
Nov 22 14:22:09 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:22:09 user nova-compute[74776]:       <mac address="fa:16:3e:59:13:7f"/>
Nov 22 14:22:09 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:22:09 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:22:09 user nova-compute[74776]:       <target dev="tap81b8bd85-da"/>
Nov 22 14:22:09 user nova-compute[74776]:     </interface>
Nov 22 14:22:09 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:22:09 user nova-compute[74776]:       <mac address="fa:16:3e:92:19:97"/>
Nov 22 14:22:09 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:22:09 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:22:09 user nova-compute[74776]:       <target dev="tapdf6ff5ee-91"/>
Nov 22 14:22:09 user nova-compute[74776]:     </interface>
Nov 22 14:22:09 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:22:09 user nova-compute[74776]:       <mac address="fa:16:3e:47:e8:14"/>
Nov 22 14:22:09 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:22:09 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:22:09 user nova-compute[74776]:       <target dev="tape631b486-ff"/>
Nov 22 14:22:09 user nova-compute[74776]:     </interface>
Nov 22 14:22:09 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:22:09 user nova-compute[74776]:       <mac address="fa:16:3e:3b:bf:db"/>
Nov 22 14:22:09 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:22:09 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:22:09 user nova-compute[74776]:       <target dev="tapc7053999-22"/>
Nov 22 14:22:09 user nova-compute[74776]:     </interface>
Nov 22 14:22:09 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:22:09 user nova-compute[74776]:       <mac address="fa:16:3e:53:9d:81"/>
Nov 22 14:22:09 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:22:09 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:22:09 user nova-compute[74776]:       <target dev="tape6f96288-81"/>
Nov 22 14:22:09 user nova-compute[74776]:     </interface>
Nov 22 14:22:09 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:22:09 user nova-compute[74776]:       <mac address="fa:16:3e:dd:3e:54"/>
Nov 22 14:22:09 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:22:09 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:22:09 user nova-compute[74776]:       <target dev="tap0f0b6445-b3"/>
Nov 22 14:22:09 user nova-compute[74776]:     </interface>
Nov 22 14:22:09 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:22:09 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/84dbab20-fe7f-4b9e-bc02-6c739029f69d/console.log" append="off"/>
Nov 22 14:22:09 user nova-compute[74776]:     </serial>
Nov 22 14:22:09 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:22:09 user nova-compute[74776]:     <video>
Nov 22 14:22:09 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:22:09 user nova-compute[74776]:     </video>
Nov 22 14:22:09 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:22:09 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:22:09 user nova-compute[74776]:     </rng>
Nov 22 14:22:09 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:22:09 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:22:09 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:22:09 user nova-compute[74776]:     </memballoon>
Nov 22 14:22:09 user nova-compute[74776]:   </devices>
Nov 22 14:22:09 user nova-compute[74776]: </domain>
Nov 22 14:22:09 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-404720208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-404720208',id=19,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9gPq9VvMiaCjz4jYQfD2X7t/kdIY759yEoUNDsiedT8w0+KrpqXNAWDUJBS32NG8AcPT9hsMwWnSuTON9ZI8QrT5b4OI2633ygBIkQus263nx/aRlzu77alZ84xwlRow==',key_name='tempest-keypair-1960061017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c09ea5e02a3340b0b2326971a28fd88a',ramdisk_id='',reservation_id='r-ul5083f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402092407',owner_user_name='tempest-TaggedBootDevicesTest-1402092407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3997118da5d641489bf9e772eabc156e',uuid=84dbab20-fe7f-4b9e-bc02-6c739029f69d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "address": "fa:16:3e:c7:ba:0a", "network": {"id": "10549d92-6312-459c-b167-bdd2396d9c88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1836352595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9601d6f-cf", "ovs_interfaceid": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converting VIF {"id": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "address": "fa:16:3e:c7:ba:0a", "network": {"id": "10549d92-6312-459c-b167-bdd2396d9c88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1836352595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9601d6f-cf", "ovs_interfaceid": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:ba:0a,bridge_name='br-int',has_traffic_filtering=True,id=a9601d6f-cfc5-47b5-8260-414d5ac1157f,network=Network(10549d92-6312-459c-b167-bdd2396d9c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9601d6f-cf') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG os_vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:ba:0a,bridge_name='br-int',has_traffic_filtering=True,id=a9601d6f-cfc5-47b5-8260-414d5ac1157f,network=Network(10549d92-6312-459c-b167-bdd2396d9c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9601d6f-cf') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07548543-9cbc-50d3-8b27-03d042dc9213', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9601d6f-cf, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9601d6f-cf, col_values=(('qos', UUID('b32a9eeb-c5a1-47d4-86a3-dd95c3ac9f4c')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9601d6f-cf, col_values=(('external_ids', {'iface-id': 'a9601d6f-cfc5-47b5-8260-414d5ac1157f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:ba:0a', 'vm-uuid': '84dbab20-fe7f-4b9e-bc02-6c739029f69d'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:09 user nova-compute[74776]: INFO nova.compute.manager [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Swapping old allocation on dict_keys(['b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a']) held by migration 707b0dc0-e28a-44c9-99f4-67d5ce9be5e5 for instance
Nov 22 14:22:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: INFO os_vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:ba:0a,bridge_name='br-int',has_traffic_filtering=True,id=a9601d6f-cfc5-47b5-8260-414d5ac1157f,network=Network(10549d92-6312-459c-b167-bdd2396d9c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9601d6f-cf')
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-404720208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-404720208',id=19,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9gPq9VvMiaCjz4jYQfD2X7t/kdIY759yEoUNDsiedT8w0+KrpqXNAWDUJBS32NG8AcPT9hsMwWnSuTON9ZI8QrT5b4OI2633ygBIkQus263nx/aRlzu77alZ84xwlRow==',key_name='tempest-keypair-1960061017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c09ea5e02a3340b0b2326971a28fd88a',ramdisk_id='',reservation_id='r-ul5083f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402092407',owner_user_name='tempest-TaggedBootDevicesTest-1402092407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3997118da5d641489bf9e772eabc156e',uuid=84dbab20-fe7f-4b9e-bc02-6c739029f69d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81b8bd85-da35-47cb-880f-6b3de9efd406", "address": "fa:16:3e:59:13:7f", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b8bd85-da", "ovs_interfaceid": "81b8bd85-da35-47cb-880f-6b3de9efd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converting VIF {"id": "81b8bd85-da35-47cb-880f-6b3de9efd406", "address": "fa:16:3e:59:13:7f", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b8bd85-da", "ovs_interfaceid": "81b8bd85-da35-47cb-880f-6b3de9efd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:13:7f,bridge_name='br-int',has_traffic_filtering=True,id=81b8bd85-da35-47cb-880f-6b3de9efd406,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap81b8bd85-da') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG os_vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:13:7f,bridge_name='br-int',has_traffic_filtering=True,id=81b8bd85-da35-47cb-880f-6b3de9efd406,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap81b8bd85-da') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85d830a1-01ab-51a7-b13e-888969d174ff', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Overwriting current allocation {'allocations': {'b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 23}}, 'project_id': 'ba1b35da14434fa09c3331d9c44d63fb', 'user_id': '84f6a2d2d72f42f1ba0ee9b623a0a9ca', 'consumer_generation': 1} on consumer e96ab1bf-6f19-4e5f-b79d-f0266988090b {{(pid=74776) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81b8bd85-da, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81b8bd85-da, col_values=(('qos', UUID('17ce8286-9c6e-4407-82b7-d7c9c4d01804')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81b8bd85-da, col_values=(('external_ids', {'iface-id': '81b8bd85-da35-47cb-880f-6b3de9efd406', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:13:7f', 'vm-uuid': '84dbab20-fe7f-4b9e-bc02-6c739029f69d'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: INFO os_vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:13:7f,bridge_name='br-int',has_traffic_filtering=True,id=81b8bd85-da35-47cb-880f-6b3de9efd406,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap81b8bd85-da')
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-404720208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-404720208',id=19,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9gPq9VvMiaCjz4jYQfD2X7t/kdIY759yEoUNDsiedT8w0+KrpqXNAWDUJBS32NG8AcPT9hsMwWnSuTON9ZI8QrT5b4OI2633ygBIkQus263nx/aRlzu77alZ84xwlRow==',key_name='tempest-keypair-1960061017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c09ea5e02a3340b0b2326971a28fd88a',ramdisk_id='',reservation_id='r-ul5083f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402092407',owner_user_name='tempest-TaggedBootDevicesTest-1402092407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3997118da5d641489bf9e772eabc156e',uuid=84dbab20-fe7f-4b9e-bc02-6c739029f69d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "address": "fa:16:3e:92:19:97", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6ff5ee-91", "ovs_interfaceid": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converting VIF {"id": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "address": "fa:16:3e:92:19:97", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6ff5ee-91", "ovs_interfaceid": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:19:97,bridge_name='br-int',has_traffic_filtering=True,id=df6ff5ee-9150-4078-8357-caeb01f35ff8,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdf6ff5ee-91') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG os_vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:19:97,bridge_name='br-int',has_traffic_filtering=True,id=df6ff5ee-9150-4078-8357-caeb01f35ff8,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdf6ff5ee-91') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '637d812d-7266-5ee6-beb5-72df4fce93d3', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf6ff5ee-91, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf6ff5ee-91, col_values=(('qos', UUID('5aba6e20-b3e5-49fb-afe2-0ee4f8ee3b2a')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf6ff5ee-91, col_values=(('external_ids', {'iface-id': 'df6ff5ee-9150-4078-8357-caeb01f35ff8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:19:97', 'vm-uuid': '84dbab20-fe7f-4b9e-bc02-6c739029f69d'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: INFO os_vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:19:97,bridge_name='br-int',has_traffic_filtering=True,id=df6ff5ee-9150-4078-8357-caeb01f35ff8,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdf6ff5ee-91')
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-404720208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-404720208',id=19,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9gPq9VvMiaCjz4jYQfD2X7t/kdIY759yEoUNDsiedT8w0+KrpqXNAWDUJBS32NG8AcPT9hsMwWnSuTON9ZI8QrT5b4OI2633ygBIkQus263nx/aRlzu77alZ84xwlRow==',key_name='tempest-keypair-1960061017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c09ea5e02a3340b0b2326971a28fd88a',ramdisk_id='',reservation_id='r-ul5083f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402092407',owner_user_name='tempest-TaggedBootDevicesTest-1402092407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3997118da5d641489bf9e772eabc156e',uuid=84dbab20-fe7f-4b9e-bc02-6c739029f69d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e631b486-fff8-4c8b-b688-138a941b0440", "address": "fa:16:3e:47:e8:14", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape631b486-ff", "ovs_interfaceid": "e631b486-fff8-4c8b-b688-138a941b0440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converting VIF {"id": "e631b486-fff8-4c8b-b688-138a941b0440", "address": "fa:16:3e:47:e8:14", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape631b486-ff", "ovs_interfaceid": "e631b486-fff8-4c8b-b688-138a941b0440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:e8:14,bridge_name='br-int',has_traffic_filtering=True,id=e631b486-fff8-4c8b-b688-138a941b0440,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape631b486-ff') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG os_vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:e8:14,bridge_name='br-int',has_traffic_filtering=True,id=e631b486-fff8-4c8b-b688-138a941b0440,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape631b486-ff') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7cc00c1e-8fd8-5fe6-bcd6-c5e9a7ddb85d', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquired lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape631b486-ff, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape631b486-ff, col_values=(('qos', UUID('efd76e1f-1059-4154-a25e-69142c94f8ff')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape631b486-ff, col_values=(('external_ids', {'iface-id': 'e631b486-fff8-4c8b-b688-138a941b0440', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:e8:14', 'vm-uuid': '84dbab20-fe7f-4b9e-bc02-6c739029f69d'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: INFO os_vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:e8:14,bridge_name='br-int',has_traffic_filtering=True,id=e631b486-fff8-4c8b-b688-138a941b0440,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape631b486-ff')
Nov 22 14:22:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-404720208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-404720208',id=19,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9gPq9VvMiaCjz4jYQfD2X7t/kdIY759yEoUNDsiedT8w0+KrpqXNAWDUJBS32NG8AcPT9hsMwWnSuTON9ZI8QrT5b4OI2633ygBIkQus263nx/aRlzu77alZ84xwlRow==',key_name='tempest-keypair-1960061017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c09ea5e02a3340b0b2326971a28fd88a',ramdisk_id='',reservation_id='r-ul5083f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402092407',owner_user_name='tempest-TaggedBootDevicesTest-1402092407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3997118da5d641489bf9e772eabc156e',uuid=84dbab20-fe7f-4b9e-bc02-6c739029f69d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7053999-2290-4f4e-a386-1ffc306de05a", "address": "fa:16:3e:3b:bf:db", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7053999-22", "ovs_interfaceid": "c7053999-2290-4f4e-a386-1ffc306de05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converting VIF {"id": "c7053999-2290-4f4e-a386-1ffc306de05a", "address": "fa:16:3e:3b:bf:db", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7053999-22", "ovs_interfaceid": "c7053999-2290-4f4e-a386-1ffc306de05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bf:db,bridge_name='br-int',has_traffic_filtering=True,id=c7053999-2290-4f4e-a386-1ffc306de05a,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7053999-22') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG os_vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bf:db,bridge_name='br-int',has_traffic_filtering=True,id=c7053999-2290-4f4e-a386-1ffc306de05a,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7053999-22') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea5fc613-39e3-5b01-8101-a42f12490a66', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG nova.compute.manager [req-0ac3a8d7-03d4-4d04-946c-df4f45cb14e6 req-ac0ed3d3-5d90-4e5f-a090-4add212e20a0 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Received event network-vif-plugged-b25ae5ba-034e-4c8f-b11a-570458c20dfe {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0ac3a8d7-03d4-4d04-946c-df4f45cb14e6 req-ac0ed3d3-5d90-4e5f-a090-4add212e20a0 service nova] Acquiring lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0ac3a8d7-03d4-4d04-946c-df4f45cb14e6 req-ac0ed3d3-5d90-4e5f-a090-4add212e20a0 service nova] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0ac3a8d7-03d4-4d04-946c-df4f45cb14e6 req-ac0ed3d3-5d90-4e5f-a090-4add212e20a0 service nova] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG nova.compute.manager [req-0ac3a8d7-03d4-4d04-946c-df4f45cb14e6 req-ac0ed3d3-5d90-4e5f-a090-4add212e20a0 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] No waiting events found dispatching network-vif-plugged-b25ae5ba-034e-4c8f-b11a-570458c20dfe {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:10 user nova-compute[74776]: WARNING nova.compute.manager [req-0ac3a8d7-03d4-4d04-946c-df4f45cb14e6 req-ac0ed3d3-5d90-4e5f-a090-4add212e20a0 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Received unexpected event network-vif-plugged-b25ae5ba-034e-4c8f-b11a-570458c20dfe for instance with vm_state active and task_state None.
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7053999-22, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7053999-22, col_values=(('qos', UUID('a07421bf-c143-4fb8-89cf-9c7d1c62c68f')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7053999-22, col_values=(('external_ids', {'iface-id': 'c7053999-2290-4f4e-a386-1ffc306de05a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:bf:db', 'vm-uuid': '84dbab20-fe7f-4b9e-bc02-6c739029f69d'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: INFO os_vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bf:db,bridge_name='br-int',has_traffic_filtering=True,id=c7053999-2290-4f4e-a386-1ffc306de05a,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7053999-22')
Nov 22 14:22:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-404720208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-404720208',id=19,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9gPq9VvMiaCjz4jYQfD2X7t/kdIY759yEoUNDsiedT8w0+KrpqXNAWDUJBS32NG8AcPT9hsMwWnSuTON9ZI8QrT5b4OI2633ygBIkQus263nx/aRlzu77alZ84xwlRow==',key_name='tempest-keypair-1960061017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c09ea5e02a3340b0b2326971a28fd88a',ramdisk_id='',reservation_id='r-ul5083f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402092407',owner_user_name='tempest-TaggedBootDevicesTest-1402092407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3997118da5d641489bf9e772eabc156e',uuid=84dbab20-fe7f-4b9e-bc02-6c739029f69d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6f96288-8194-465b-90bd-640ecaec56e4", "address": "fa:16:3e:53:9d:81", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f96288-81", "ovs_interfaceid": "e6f96288-8194-465b-90bd-640ecaec56e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converting VIF {"id": "e6f96288-8194-465b-90bd-640ecaec56e4", "address": "fa:16:3e:53:9d:81", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f96288-81", "ovs_interfaceid": "e6f96288-8194-465b-90bd-640ecaec56e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:9d:81,bridge_name='br-int',has_traffic_filtering=True,id=e6f96288-8194-465b-90bd-640ecaec56e4,network=Network(01e2dcf7-2a81-4621-b5d8-254a7ef53b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6f96288-81') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG os_vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:9d:81,bridge_name='br-int',has_traffic_filtering=True,id=e6f96288-8194-465b-90bd-640ecaec56e4,network=Network(01e2dcf7-2a81-4621-b5d8-254a7ef53b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6f96288-81') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ecaa59c0-a32c-5c58-99c4-226395bdd399', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6f96288-81, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6f96288-81, col_values=(('qos', UUID('38953088-0568-4ccb-a08e-720e5d390b18')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6f96288-81, col_values=(('external_ids', {'iface-id': 'e6f96288-8194-465b-90bd-640ecaec56e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:9d:81', 'vm-uuid': '84dbab20-fe7f-4b9e-bc02-6c739029f69d'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: INFO os_vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:9d:81,bridge_name='br-int',has_traffic_filtering=True,id=e6f96288-8194-465b-90bd-640ecaec56e4,network=Network(01e2dcf7-2a81-4621-b5d8-254a7ef53b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6f96288-81')
Nov 22 14:22:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-404720208',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-404720208',id=19,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9gPq9VvMiaCjz4jYQfD2X7t/kdIY759yEoUNDsiedT8w0+KrpqXNAWDUJBS32NG8AcPT9hsMwWnSuTON9ZI8QrT5b4OI2633ygBIkQus263nx/aRlzu77alZ84xwlRow==',key_name='tempest-keypair-1960061017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c09ea5e02a3340b0b2326971a28fd88a',ramdisk_id='',reservation_id='r-ul5083f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402092407',owner_user_name='tempest-TaggedBootDevicesTest-1402092407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3997118da5d641489bf9e772eabc156e',uuid=84dbab20-fe7f-4b9e-bc02-6c739029f69d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "address": "fa:16:3e:dd:3e:54", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0b6445-b3", "ovs_interfaceid": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converting VIF {"id": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "address": "fa:16:3e:dd:3e:54", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0b6445-b3", "ovs_interfaceid": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:3e:54,bridge_name='br-int',has_traffic_filtering=True,id=0f0b6445-b307-4db8-ae22-121bdc8777c6,network=Network(01e2dcf7-2a81-4621-b5d8-254a7ef53b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0b6445-b3') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG os_vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:3e:54,bridge_name='br-int',has_traffic_filtering=True,id=0f0b6445-b307-4db8-ae22-121bdc8777c6,network=Network(01e2dcf7-2a81-4621-b5d8-254a7ef53b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0b6445-b3') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dfe6d3a4-c061-5d15-9e70-b5ef26c65893', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f0b6445-b3, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f0b6445-b3, col_values=(('qos', UUID('69c32532-f5df-45f9-bcfa-28a75b90d153')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f0b6445-b3, col_values=(('external_ids', {'iface-id': '0f0b6445-b307-4db8-ae22-121bdc8777c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:3e:54', 'vm-uuid': '84dbab20-fe7f-4b9e-bc02-6c739029f69d'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:10 user nova-compute[74776]: INFO os_vif [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:3e:54,bridge_name='br-int',has_traffic_filtering=True,id=0f0b6445-b307-4db8-ae22-121bdc8777c6,network=Network(01e2dcf7-2a81-4621-b5d8-254a7ef53b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0b6445-b3')
Nov 22 14:22:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] No BDM found with device name hda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] No VIF found with MAC fa:16:3e:c7:ba:0a, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] No VIF found with MAC fa:16:3e:3b:bf:db, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:22:10 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Using config drive
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Updating instance_info_cache with network_info: [{"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Releasing lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG os_brick.utils [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2e3acf-c228-4ac0-9e5e-2c73f6131833]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93b241d-4223-4862-b7b7-61d0b151c1e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a53c47b-a073-4f1b-b602-ba4bc3a5b2ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f9ee5d-5abb-4a8e-8430-f17fc9de40d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:22:10 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Creating config drive at /opt/stack/data/nova/instances/84dbab20-fe7f-4b9e-bc02-6c739029f69d/disk.config
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/84dbab20-fe7f-4b9e-bc02-6c739029f69d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnpxup_o2 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/84dbab20-fe7f-4b9e-bc02-6c739029f69d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnpxup_o2" returned: 0 in 0.079s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:22:10 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:22:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70565f9-dd96-421a-ac92-b3ce83974fc0]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:22:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:22:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:22:11 user nova-compute[74776]: DEBUG os_brick.utils [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] <== get_connector_properties: return (216ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:22:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:22:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:12 user nova-compute[74776]: INFO nova.compute.manager [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Rescuing
Nov 22 14:22:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "refresh_cache-6f2ce4b2-660c-431f-b951-c6ec5090ef7e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:22:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquired lock "refresh_cache-6f2ce4b2-660c-431f-b951-c6ec5090ef7e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:22:12 user nova-compute[74776]: DEBUG nova.network.neutron [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:22:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-87059ffc-297e-4915-aa4c-8f4d6096943b req-96a406f0-89f3-4258-b64c-50b56c4cedcf service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-plugged-a9601d6f-cfc5-47b5-8260-414d5ac1157f {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-87059ffc-297e-4915-aa4c-8f4d6096943b req-96a406f0-89f3-4258-b64c-50b56c4cedcf service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-87059ffc-297e-4915-aa4c-8f4d6096943b req-96a406f0-89f3-4258-b64c-50b56c4cedcf service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-87059ffc-297e-4915-aa4c-8f4d6096943b req-96a406f0-89f3-4258-b64c-50b56c4cedcf service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-87059ffc-297e-4915-aa4c-8f4d6096943b req-96a406f0-89f3-4258-b64c-50b56c4cedcf service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-plugged-a9601d6f-cfc5-47b5-8260-414d5ac1157f {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:12 user nova-compute[74776]: WARNING nova.compute.manager [req-87059ffc-297e-4915-aa4c-8f4d6096943b req-96a406f0-89f3-4258-b64c-50b56c4cedcf service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received unexpected event network-vif-plugged-a9601d6f-cfc5-47b5-8260-414d5ac1157f for instance with vm_state building and task_state spawning.
Nov 22 14:22:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-1b3a4e48-80a9-4bab-865b-ab29ef89e607 req-2ca20bae-d5ca-4d8c-9402-7095fbd61d89 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-plugged-df6ff5ee-9150-4078-8357-caeb01f35ff8 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1b3a4e48-80a9-4bab-865b-ab29ef89e607 req-2ca20bae-d5ca-4d8c-9402-7095fbd61d89 service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1b3a4e48-80a9-4bab-865b-ab29ef89e607 req-2ca20bae-d5ca-4d8c-9402-7095fbd61d89 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1b3a4e48-80a9-4bab-865b-ab29ef89e607 req-2ca20bae-d5ca-4d8c-9402-7095fbd61d89 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-1b3a4e48-80a9-4bab-865b-ab29ef89e607 req-2ca20bae-d5ca-4d8c-9402-7095fbd61d89 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-plugged-df6ff5ee-9150-4078-8357-caeb01f35ff8 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:17 user nova-compute[74776]: WARNING nova.compute.manager [req-1b3a4e48-80a9-4bab-865b-ab29ef89e607 req-2ca20bae-d5ca-4d8c-9402-7095fbd61d89 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received unexpected event network-vif-plugged-df6ff5ee-9150-4078-8357-caeb01f35ff8 for instance with vm_state building and task_state spawning.
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-plugged-a9601d6f-cfc5-47b5-8260-414d5ac1157f {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-plugged-a9601d6f-cfc5-47b5-8260-414d5ac1157f {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:17 user nova-compute[74776]: WARNING nova.compute.manager [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received unexpected event network-vif-plugged-a9601d6f-cfc5-47b5-8260-414d5ac1157f for instance with vm_state building and task_state spawning.
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-plugged-81b8bd85-da35-47cb-880f-6b3de9efd406 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-plugged-81b8bd85-da35-47cb-880f-6b3de9efd406 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:17 user nova-compute[74776]: WARNING nova.compute.manager [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received unexpected event network-vif-plugged-81b8bd85-da35-47cb-880f-6b3de9efd406 for instance with vm_state building and task_state spawning.
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-plugged-81b8bd85-da35-47cb-880f-6b3de9efd406 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-plugged-81b8bd85-da35-47cb-880f-6b3de9efd406 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:17 user nova-compute[74776]: WARNING nova.compute.manager [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received unexpected event network-vif-plugged-81b8bd85-da35-47cb-880f-6b3de9efd406 for instance with vm_state building and task_state spawning.
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-plugged-c7053999-2290-4f4e-a386-1ffc306de05a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-plugged-c7053999-2290-4f4e-a386-1ffc306de05a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:17 user nova-compute[74776]: WARNING nova.compute.manager [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received unexpected event network-vif-plugged-c7053999-2290-4f4e-a386-1ffc306de05a for instance with vm_state building and task_state spawning.
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-plugged-c7053999-2290-4f4e-a386-1ffc306de05a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-plugged-c7053999-2290-4f4e-a386-1ffc306de05a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:17 user nova-compute[74776]: WARNING nova.compute.manager [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received unexpected event network-vif-plugged-c7053999-2290-4f4e-a386-1ffc306de05a for instance with vm_state building and task_state spawning.
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-plugged-e6f96288-8194-465b-90bd-640ecaec56e4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-plugged-e6f96288-8194-465b-90bd-640ecaec56e4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:17 user nova-compute[74776]: WARNING nova.compute.manager [req-6fc5a373-0f77-4fd1-91aa-7dd67bcfe698 req-63fcbb9f-345a-482d-93b4-897c9981e0e5 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received unexpected event network-vif-plugged-e6f96288-8194-465b-90bd-640ecaec56e4 for instance with vm_state building and task_state spawning.
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-f7b24450-0449-4761-a0db-df6616bdf859 req-0fe45238-c3b5-4577-a538-773b66b7108e service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-plugged-0f0b6445-b307-4db8-ae22-121bdc8777c6 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f7b24450-0449-4761-a0db-df6616bdf859 req-0fe45238-c3b5-4577-a538-773b66b7108e service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f7b24450-0449-4761-a0db-df6616bdf859 req-0fe45238-c3b5-4577-a538-773b66b7108e service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f7b24450-0449-4761-a0db-df6616bdf859 req-0fe45238-c3b5-4577-a538-773b66b7108e service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-f7b24450-0449-4761-a0db-df6616bdf859 req-0fe45238-c3b5-4577-a538-773b66b7108e service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-plugged-0f0b6445-b307-4db8-ae22-121bdc8777c6 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:17 user nova-compute[74776]: WARNING nova.compute.manager [req-f7b24450-0449-4761-a0db-df6616bdf859 req-0fe45238-c3b5-4577-a538-773b66b7108e service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received unexpected event network-vif-plugged-0f0b6445-b307-4db8-ae22-121bdc8777c6 for instance with vm_state building and task_state spawning.
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-97fd07bf-2fc1-48f3-8de6-7e45f010b48c req-44d761e6-9df9-4005-a2e8-d84fbda07abf service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-plugged-df6ff5ee-9150-4078-8357-caeb01f35ff8 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-97fd07bf-2fc1-48f3-8de6-7e45f010b48c req-44d761e6-9df9-4005-a2e8-d84fbda07abf service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-97fd07bf-2fc1-48f3-8de6-7e45f010b48c req-44d761e6-9df9-4005-a2e8-d84fbda07abf service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-97fd07bf-2fc1-48f3-8de6-7e45f010b48c req-44d761e6-9df9-4005-a2e8-d84fbda07abf service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-97fd07bf-2fc1-48f3-8de6-7e45f010b48c req-44d761e6-9df9-4005-a2e8-d84fbda07abf service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-plugged-df6ff5ee-9150-4078-8357-caeb01f35ff8 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:17 user nova-compute[74776]: WARNING nova.compute.manager [req-97fd07bf-2fc1-48f3-8de6-7e45f010b48c req-44d761e6-9df9-4005-a2e8-d84fbda07abf service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received unexpected event network-vif-plugged-df6ff5ee-9150-4078-8357-caeb01f35ff8 for instance with vm_state building and task_state spawning.
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-97fd07bf-2fc1-48f3-8de6-7e45f010b48c req-44d761e6-9df9-4005-a2e8-d84fbda07abf service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-plugged-e631b486-fff8-4c8b-b688-138a941b0440 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-97fd07bf-2fc1-48f3-8de6-7e45f010b48c req-44d761e6-9df9-4005-a2e8-d84fbda07abf service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-97fd07bf-2fc1-48f3-8de6-7e45f010b48c req-44d761e6-9df9-4005-a2e8-d84fbda07abf service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-97fd07bf-2fc1-48f3-8de6-7e45f010b48c req-44d761e6-9df9-4005-a2e8-d84fbda07abf service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-97fd07bf-2fc1-48f3-8de6-7e45f010b48c req-44d761e6-9df9-4005-a2e8-d84fbda07abf service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-plugged-e631b486-fff8-4c8b-b688-138a941b0440 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:17 user nova-compute[74776]: WARNING nova.compute.manager [req-97fd07bf-2fc1-48f3-8de6-7e45f010b48c req-44d761e6-9df9-4005-a2e8-d84fbda07abf service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received unexpected event network-vif-plugged-e631b486-fff8-4c8b-b688-138a941b0440 for instance with vm_state building and task_state spawning.
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-97fd07bf-2fc1-48f3-8de6-7e45f010b48c req-44d761e6-9df9-4005-a2e8-d84fbda07abf service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-plugged-e631b486-fff8-4c8b-b688-138a941b0440 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-97fd07bf-2fc1-48f3-8de6-7e45f010b48c req-44d761e6-9df9-4005-a2e8-d84fbda07abf service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-97fd07bf-2fc1-48f3-8de6-7e45f010b48c req-44d761e6-9df9-4005-a2e8-d84fbda07abf service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-97fd07bf-2fc1-48f3-8de6-7e45f010b48c req-44d761e6-9df9-4005-a2e8-d84fbda07abf service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-97fd07bf-2fc1-48f3-8de6-7e45f010b48c req-44d761e6-9df9-4005-a2e8-d84fbda07abf service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-plugged-e631b486-fff8-4c8b-b688-138a941b0440 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:17 user nova-compute[74776]: WARNING nova.compute.manager [req-97fd07bf-2fc1-48f3-8de6-7e45f010b48c req-44d761e6-9df9-4005-a2e8-d84fbda07abf service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received unexpected event network-vif-plugged-e631b486-fff8-4c8b-b688-138a941b0440 for instance with vm_state building and task_state spawning.
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-e9d90195-f8c8-42c6-9d65-5035b165f8d6 req-5236222c-e3be-4d86-95ad-3b24e0707f72 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-plugged-e6f96288-8194-465b-90bd-640ecaec56e4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e9d90195-f8c8-42c6-9d65-5035b165f8d6 req-5236222c-e3be-4d86-95ad-3b24e0707f72 service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e9d90195-f8c8-42c6-9d65-5035b165f8d6 req-5236222c-e3be-4d86-95ad-3b24e0707f72 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e9d90195-f8c8-42c6-9d65-5035b165f8d6 req-5236222c-e3be-4d86-95ad-3b24e0707f72 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-e9d90195-f8c8-42c6-9d65-5035b165f8d6 req-5236222c-e3be-4d86-95ad-3b24e0707f72 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-plugged-e6f96288-8194-465b-90bd-640ecaec56e4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:17 user nova-compute[74776]: WARNING nova.compute.manager [req-e9d90195-f8c8-42c6-9d65-5035b165f8d6 req-5236222c-e3be-4d86-95ad-3b24e0707f72 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received unexpected event network-vif-plugged-e6f96288-8194-465b-90bd-640ecaec56e4 for instance with vm_state building and task_state spawning.
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-bc3a577b-ce72-4b28-be81-06a6cf4c7030 req-e67def2c-9e8f-4dd1-aa75-bcbd28b90c97 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-plugged-0f0b6445-b307-4db8-ae22-121bdc8777c6 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-bc3a577b-ce72-4b28-be81-06a6cf4c7030 req-e67def2c-9e8f-4dd1-aa75-bcbd28b90c97 service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-bc3a577b-ce72-4b28-be81-06a6cf4c7030 req-e67def2c-9e8f-4dd1-aa75-bcbd28b90c97 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-bc3a577b-ce72-4b28-be81-06a6cf4c7030 req-e67def2c-9e8f-4dd1-aa75-bcbd28b90c97 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-bc3a577b-ce72-4b28-be81-06a6cf4c7030 req-e67def2c-9e8f-4dd1-aa75-bcbd28b90c97 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-plugged-0f0b6445-b307-4db8-ae22-121bdc8777c6 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:17 user nova-compute[74776]: WARNING nova.compute.manager [req-bc3a577b-ce72-4b28-be81-06a6cf4c7030 req-e67def2c-9e8f-4dd1-aa75-bcbd28b90c97 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received unexpected event network-vif-plugged-0f0b6445-b307-4db8-ae22-121bdc8777c6 for instance with vm_state building and task_state spawning.
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:17 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:22:17 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=7453MB free_disk=25.140113830566406GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:17 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Instance spawned successfully.
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:22:17 user nova-compute[74776]: INFO nova.compute.manager [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Took 13.78 seconds to spawn the instance on the hypervisor.
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:22:17 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Creating image(s)
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "/opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "/opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:17 user nova-compute[74776]: DEBUG nova.network.neutron [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Updating instance_info_cache with network_info: [{"id": "c83b6599-820f-462a-bd26-af48014d7d7d", "address": "fa:16:3e:18:32:09", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b6599-82", "ovs_interfaceid": "c83b6599-820f-462a-bd26-af48014d7d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4629d82d-fd02-4a58-a535-b362b493e7c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 98fb9b54-c428-4a48-b1ff-a976f971b764 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 25deabe8-8cfc-4d40-a734-755d4097baf5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 42b00137-df98-47d9-9d02-29b4707fed30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6dcf355f-759d-4a9a-9fb6-394e242c03e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance d7f3ff5e-292d-4e81-af58-b9a45adfbda1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance e96ab1bf-6f19-4e5f-b79d-f0266988090b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 525baf66-82cc-4e8d-a37a-c92c51d4673d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6f2ce4b2-660c-431f-b951-c6ec5090ef7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4246c1b7-6873-421a-ab2a-59dfb6adcb38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 370f25d8-d6f4-4de8-b356-d23e6d599f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 97fa95f1-f856-4b65-917f-9808bac6e576 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 84dbab20-fe7f-4b9e-bc02-6c739029f69d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Releasing lock "refresh_cache-6f2ce4b2-660c-431f-b951-c6ec5090ef7e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:22:18 user nova-compute[74776]: INFO nova.compute.manager [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Took 35.08 seconds to build instance.
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.395s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0f54b15a-14f8-496c-8beb-9e3e70dc4bce tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.219s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing inventories for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating ProviderTree inventory for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating inventory in ProviderTree for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing aggregate associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, aggregates: None {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing trait associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Starting finish_revert_migration {{(pid=74776) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.208s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Start _get_guest_xml network_info=[{"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '93283a59-da20-43a7-a926-a048ce66ab89', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvAJsUuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e96ab1bf-6f19-4e5f-b79d-f0266988090b', 'attached_at': '2023-11-22T14:22:18.000000', 'detached_at': '', 'volume_id': '80d952a7-ba34-425d-b34d-dbb03e3fb7e3', 'serial': '80d952a7-ba34-425d-b34d-dbb03e3fb7e3'}, 'boot_index': None, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk 1073741824" returned: 0 in 0.082s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:18 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:22:18 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.objects.instance [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lazy-loading 'vcpu_model' on Instance uuid e96ab1bf-6f19-4e5f-b79d-f0266988090b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvAJsUuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:22:18 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:22:18 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:18 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:22:18 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:18 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-89d0061e-68ff-43ac-a729-1ed49e5cad19 req-4c8db5cd-bd57-4594-aad9-f208413a836d service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Received event network-vif-unplugged-c83b6599-820f-462a-bd26-af48014d7d7d {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-89d0061e-68ff-43ac-a729-1ed49e5cad19 req-4c8db5cd-bd57-4594-aad9-f208413a836d service nova] Acquiring lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-89d0061e-68ff-43ac-a729-1ed49e5cad19 req-4c8db5cd-bd57-4594-aad9-f208413a836d service nova] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-89d0061e-68ff-43ac-a729-1ed49e5cad19 req-4c8db5cd-bd57-4594-aad9-f208413a836d service nova] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-89d0061e-68ff-43ac-a729-1ed49e5cad19 req-4c8db5cd-bd57-4594-aad9-f208413a836d service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] No waiting events found dispatching network-vif-unplugged-c83b6599-820f-462a-bd26-af48014d7d7d {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:18 user nova-compute[74776]: WARNING nova.compute.manager [req-89d0061e-68ff-43ac-a729-1ed49e5cad19 req-4c8db5cd-bd57-4594-aad9-f208413a836d service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Received unexpected event network-vif-unplugged-c83b6599-820f-462a-bd26-af48014d7d7d for instance with vm_state active and task_state rescuing.
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[344701f7-65c2-4c54-bac6-68b2e6193179]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:22:18 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.197s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8398cca-0f95-4dc4-af00-fefafa9b78e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3] added
Nov 22 14:22:18 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d58ecb-7f48-4b64-8cee-17301ae8b4c3]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1232d756-1bc2-4b63-bddf-e24e6268ba4d]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvAJsUuN {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvAJsUuN" returned: 0 in 0.027s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[265c87dc-50bd-49ca-ac3c-ef0120ff8b92]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZvAJsUuN'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ed9b24-6d9e-4699-8893-e7f4e529e097]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Cannot resize image /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Ensure instance console log exists: /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Start _get_guest_xml network_info=[{"id": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "address": "fa:16:3e:22:fe:77", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81372b6e-81", "ovs_interfaceid": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2f9d9810-63bc-4474-867d-aab5b5279a42', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJHwfbLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd7f3ff5e-292d-4e81-af58-b9a45adfbda1', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4f9db8e-6078-4602-be9a-f6e8b1e727b3', 'serial': 'f4f9db8e-6078-4602-be9a-f6e8b1e727b3'}, 'boot_index': None, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dacb9fa-fb21-448c-a190-278032d8715e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:19 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:19 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:19 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:19 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:19 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:19 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:19 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:19 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:19 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Instance destroyed successfully.
Nov 22 14:22:19 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 22 14:22:19 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 22 14:22:19 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Attempting rescue
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74776) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Instance directory exists: not creating {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 14:22:19 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Creating image(s)
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "/opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "/opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.objects.instance [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6f2ce4b2-660c-431f-b951-c6ec5090ef7e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.objects.instance [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lazy-loading 'vcpu_model' on Instance uuid d7f3ff5e-292d-4e81-af58-b9a45adfbda1 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eda1efc-5cf5-42cf-a5fe-16b4597849ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260]
Nov 22 14:22:19 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260] successful.
Nov 22 14:22:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb1a696-48da-47bf-ab2f-eaf1c6604941]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJHwfbLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:22:19 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 14:22:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a8a1be-2fdc-43e0-951d-c1b48aed2913]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:19 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:19 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:19 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:19 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:19 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:19 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:19 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:19 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:19 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:19 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.486s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d1ddf9-7623-4927-af9a-3222967fa2ea]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvAJsUuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.645s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.214s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] There are 0 instances to clean {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue" returned: 0 in 0.054s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.objects.instance [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'migration_context' on Instance uuid 6f2ce4b2-660c-431f-b951-c6ec5090ef7e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.objects.base [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Object Instance<6f2ce4b2-660c-431f-b951-c6ec5090ef7e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Start _get_guest_xml network_info=[{"id": "c83b6599-820f-462a-bd26-af48014d7d7d", "address": "fa:16:3e:18:32:09", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "vif_mac": "fa:16:3e:18:32:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b6599-82", "ovs_interfaceid": "c83b6599-820f-462a-bd26-af48014d7d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.objects.instance [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'resources' on Instance uuid 6f2ce4b2-660c-431f-b951-c6ec5090ef7e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.objects.base [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Object Instance<6f2ce4b2-660c-431f-b951-c6ec5090ef7e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.objects.instance [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'numa_topology' on Instance uuid 6f2ce4b2-660c-431f-b951-c6ec5090ef7e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.objects.base [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Object Instance<6f2ce4b2-660c-431f-b951-c6ec5090ef7e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:22:19 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:22:19 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.objects.instance [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6f2ce4b2-660c-431f-b951-c6ec5090ef7e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.objects.base [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Object Instance<6f2ce4b2-660c-431f-b951-c6ec5090ef7e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:20:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-143378724',display_name='tempest-ServerRescueNegativeTestJSON-server-143378724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-143378724',id=15,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:20:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36f36a88fd7b403d9c2dd29bcd64aac6',ramdisk_id='',reservation_id='r-mtmgdtqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1360515217',owner_user_name='tempest-ServerRescueNegativeTestJSON-1360515217-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:20:32Z,user_data=None,user_id='d686d08dc36a49fa80192546c4f68940',uuid=6f2ce4b2-660c-431f-b951-c6ec5090ef7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c83b6599-820f-462a-bd26-af48014d7d7d", "address": "fa:16:3e:18:32:09", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "vif_mac": "fa:16:3e:18:32:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b6599-82", "ovs_interfaceid": "c83b6599-820f-462a-bd26-af48014d7d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converting VIF {"id": "c83b6599-820f-462a-bd26-af48014d7d7d", "address": "fa:16:3e:18:32:09", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "vif_mac": "fa:16:3e:18:32:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b6599-82", "ovs_interfaceid": "c83b6599-820f-462a-bd26-af48014d7d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:32:09,bridge_name='br-int',has_traffic_filtering=True,id=c83b6599-820f-462a-bd26-af48014d7d7d,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b6599-82') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.objects.instance [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f2ce4b2-660c-431f-b951-c6ec5090ef7e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.objects.base [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Object Instance<6f2ce4b2-660c-431f-b951-c6ec5090ef7e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:22:19 user nova-compute[74776]:   <uuid>6f2ce4b2-660c-431f-b951-c6ec5090ef7e</uuid>
Nov 22 14:22:19 user nova-compute[74776]:   <name>instance-0000000f</name>
Nov 22 14:22:19 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:22:19 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:22:19 user nova-compute[74776]:   <metadata>
Nov 22 14:22:19 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:22:19 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:22:19 user nova-compute[74776]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-143378724</nova:name>
Nov 22 14:22:19 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:22:19</nova:creationTime>
Nov 22 14:22:19 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:22:19 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:22:19 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:22:19 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:22:19 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:22:19 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:22:19 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:22:19 user nova-compute[74776]:       <nova:owner>
Nov 22 14:22:19 user nova-compute[74776]:         <nova:user uuid="d686d08dc36a49fa80192546c4f68940">tempest-ServerRescueNegativeTestJSON-1360515217-project-member</nova:user>
Nov 22 14:22:19 user nova-compute[74776]:         <nova:project uuid="36f36a88fd7b403d9c2dd29bcd64aac6">tempest-ServerRescueNegativeTestJSON-1360515217</nova:project>
Nov 22 14:22:19 user nova-compute[74776]:       </nova:owner>
Nov 22 14:22:19 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:22:19 user nova-compute[74776]:       <nova:ports>
Nov 22 14:22:19 user nova-compute[74776]:         <nova:port uuid="c83b6599-820f-462a-bd26-af48014d7d7d">
Nov 22 14:22:19 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 14:22:19 user nova-compute[74776]:         </nova:port>
Nov 22 14:22:19 user nova-compute[74776]:       </nova:ports>
Nov 22 14:22:19 user nova-compute[74776]:     </nova:instance>
Nov 22 14:22:19 user nova-compute[74776]:   </metadata>
Nov 22 14:22:19 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:22:19 user nova-compute[74776]:     <system>
Nov 22 14:22:19 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:22:19 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:22:19 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:22:19 user nova-compute[74776]:       <entry name="serial">6f2ce4b2-660c-431f-b951-c6ec5090ef7e</entry>
Nov 22 14:22:19 user nova-compute[74776]:       <entry name="uuid">6f2ce4b2-660c-431f-b951-c6ec5090ef7e</entry>
Nov 22 14:22:19 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:22:19 user nova-compute[74776]:     </system>
Nov 22 14:22:19 user nova-compute[74776]:   </sysinfo>
Nov 22 14:22:19 user nova-compute[74776]:   <os>
Nov 22 14:22:19 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:22:19 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:22:19 user nova-compute[74776]:   </os>
Nov 22 14:22:19 user nova-compute[74776]:   <features>
Nov 22 14:22:19 user nova-compute[74776]:     <acpi/>
Nov 22 14:22:19 user nova-compute[74776]:     <apic/>
Nov 22 14:22:19 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:22:19 user nova-compute[74776]:   </features>
Nov 22 14:22:19 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:22:19 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:22:19 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:22:19 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:22:19 user nova-compute[74776]:   </clock>
Nov 22 14:22:19 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:22:19 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:22:19 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:22:19 user nova-compute[74776]:   </cpu>
Nov 22 14:22:19 user nova-compute[74776]:   <devices>
Nov 22 14:22:19 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:22:19 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:22:19 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue"/>
Nov 22 14:22:19 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:22:19 user nova-compute[74776]:     </disk>
Nov 22 14:22:19 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:22:19 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:22:19 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk"/>
Nov 22 14:22:19 user nova-compute[74776]:       <target dev="vdb" bus="virtio"/>
Nov 22 14:22:19 user nova-compute[74776]:     </disk>
Nov 22 14:22:19 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:22:19 user nova-compute[74776]:       <mac address="fa:16:3e:18:32:09"/>
Nov 22 14:22:19 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:22:19 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:22:19 user nova-compute[74776]:       <target dev="tapc83b6599-82"/>
Nov 22 14:22:19 user nova-compute[74776]:     </interface>
Nov 22 14:22:19 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:22:19 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/console.log" append="off"/>
Nov 22 14:22:19 user nova-compute[74776]:     </serial>
Nov 22 14:22:19 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:22:19 user nova-compute[74776]:     <video>
Nov 22 14:22:19 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:22:19 user nova-compute[74776]:     </video>
Nov 22 14:22:19 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:22:19 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:22:19 user nova-compute[74776]:     </rng>
Nov 22 14:22:19 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:22:19 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:22:19 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:22:19 user nova-compute[74776]:     </memballoon>
Nov 22 14:22:19 user nova-compute[74776]:   </devices>
Nov 22 14:22:19 user nova-compute[74776]: </domain>
Nov 22 14:22:19 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:22:19 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Instance destroyed successfully.
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:22:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] No VIF found with MAC fa:16:3e:18:32:09, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.560s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] <== connect_volume: return (1562ms) {'type': 'block', 'scsi_wwn': '23562313333376336', 'path': '/dev/sdf'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562313333376336', 'path': '/dev/sdf'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.081s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:20 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:20 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-8e5dcf1a-42e3-4b66-99cb-5cfc6a17c183 req-f3f60365-015d-4e9f-a1f4-c0f6d5482993 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Received event network-changed-bc0c53a4-0e99-4794-863a-3dd7e2fd6622 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-8e5dcf1a-42e3-4b66-99cb-5cfc6a17c183 req-f3f60365-015d-4e9f-a1f4-c0f6d5482993 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Refreshing instance network info cache due to event network-changed-bc0c53a4-0e99-4794-863a-3dd7e2fd6622. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8e5dcf1a-42e3-4b66-99cb-5cfc6a17c183 req-f3f60365-015d-4e9f-a1f4-c0f6d5482993 service nova] Acquiring lock "refresh_cache-4246c1b7-6873-421a-ab2a-59dfb6adcb38" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8e5dcf1a-42e3-4b66-99cb-5cfc6a17c183 req-f3f60365-015d-4e9f-a1f4-c0f6d5482993 service nova] Acquired lock "refresh_cache-4246c1b7-6873-421a-ab2a-59dfb6adcb38" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG nova.network.neutron [req-8e5dcf1a-42e3-4b66-99cb-5cfc6a17c183 req-f3f60365-015d-4e9f-a1f4-c0f6d5482993 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Refreshing network info cache for port bc0c53a4-0e99-4794-863a-3dd7e2fd6622 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1644694208',display_name='tempest-ServerActionsTestOtherB-server-1644694208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1644694208',id=2,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNubZ7Gk5h0q4OD6Enksl8Cxk/zzd+sbOwMvtIBBZUt9W+DL2N76A0FAo5K8lTdtosYaw4CTfnxfM5nY6xMBLxjo0J1fnDDgRvxTybxKH1mCAazzdEjSajoOw371LIwgmw==',key_name='tempest-keypair-1933513143',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:20:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ba1b35da14434fa09c3331d9c44d63fb',ramdisk_id='',reservation_id='r-fmg969sn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1073417585',owner_user_name='tempest-ServerActionsTestOtherB-1073417585-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:22:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84f6a2d2d72f42f1ba0ee9b623a0a9ca',uuid=e96ab1bf-6f19-4e5f-b79d-f0266988090b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Converting VIF {"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:46:f7,bridge_name='br-int',has_traffic_filtering=True,id=5911a175-03ae-4ed9-8c40-fc54c69233b4,network=Network(1287337f-aeac-4c5f-a6f0-3af84b13c33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5911a175-03') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:22:20 user nova-compute[74776]:   <uuid>e96ab1bf-6f19-4e5f-b79d-f0266988090b</uuid>
Nov 22 14:22:20 user nova-compute[74776]:   <name>instance-00000002</name>
Nov 22 14:22:20 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:22:20 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:22:20 user nova-compute[74776]:   <metadata>
Nov 22 14:22:20 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:22:20 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:22:20 user nova-compute[74776]:       <nova:name>tempest-ServerActionsTestOtherB-server-1644694208</nova:name>
Nov 22 14:22:20 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:22:18</nova:creationTime>
Nov 22 14:22:20 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:22:20 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:22:20 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:22:20 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:22:20 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:22:20 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:22:20 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:22:20 user nova-compute[74776]:       <nova:owner>
Nov 22 14:22:20 user nova-compute[74776]:         <nova:user uuid="84f6a2d2d72f42f1ba0ee9b623a0a9ca">tempest-ServerActionsTestOtherB-1073417585-project-member</nova:user>
Nov 22 14:22:20 user nova-compute[74776]:         <nova:project uuid="ba1b35da14434fa09c3331d9c44d63fb">tempest-ServerActionsTestOtherB-1073417585</nova:project>
Nov 22 14:22:20 user nova-compute[74776]:       </nova:owner>
Nov 22 14:22:20 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:22:20 user nova-compute[74776]:       <nova:ports>
Nov 22 14:22:20 user nova-compute[74776]:         <nova:port uuid="5911a175-03ae-4ed9-8c40-fc54c69233b4">
Nov 22 14:22:20 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 22 14:22:20 user nova-compute[74776]:         </nova:port>
Nov 22 14:22:20 user nova-compute[74776]:       </nova:ports>
Nov 22 14:22:20 user nova-compute[74776]:     </nova:instance>
Nov 22 14:22:20 user nova-compute[74776]:   </metadata>
Nov 22 14:22:20 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:22:20 user nova-compute[74776]:     <system>
Nov 22 14:22:20 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:22:20 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:22:20 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:22:20 user nova-compute[74776]:       <entry name="serial">e96ab1bf-6f19-4e5f-b79d-f0266988090b</entry>
Nov 22 14:22:20 user nova-compute[74776]:       <entry name="uuid">e96ab1bf-6f19-4e5f-b79d-f0266988090b</entry>
Nov 22 14:22:20 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:22:20 user nova-compute[74776]:     </system>
Nov 22 14:22:20 user nova-compute[74776]:   </sysinfo>
Nov 22 14:22:20 user nova-compute[74776]:   <os>
Nov 22 14:22:20 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:22:20 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:22:20 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:22:20 user nova-compute[74776]:   </os>
Nov 22 14:22:20 user nova-compute[74776]:   <features>
Nov 22 14:22:20 user nova-compute[74776]:     <acpi/>
Nov 22 14:22:20 user nova-compute[74776]:     <apic/>
Nov 22 14:22:20 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:22:20 user nova-compute[74776]:   </features>
Nov 22 14:22:20 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:22:20 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:22:20 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:22:20 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:22:20 user nova-compute[74776]:   </clock>
Nov 22 14:22:20 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:22:20 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:22:20 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:22:20 user nova-compute[74776]:   </cpu>
Nov 22 14:22:20 user nova-compute[74776]:   <devices>
Nov 22 14:22:20 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:22:20 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:22:20 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk"/>
Nov 22 14:22:20 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:22:20 user nova-compute[74776]:     </disk>
Nov 22 14:22:20 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:22:20 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:22:20 user nova-compute[74776]:       <source dev="/dev/sdf"/>
Nov 22 14:22:20 user nova-compute[74776]:       <target dev="vdb" bus="virtio"/>
Nov 22 14:22:20 user nova-compute[74776]:       <serial>80d952a7-ba34-425d-b34d-dbb03e3fb7e3</serial>
Nov 22 14:22:20 user nova-compute[74776]:     </disk>
Nov 22 14:22:20 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:22:20 user nova-compute[74776]:       <mac address="fa:16:3e:b6:46:f7"/>
Nov 22 14:22:20 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:22:20 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:22:20 user nova-compute[74776]:       <target dev="tap5911a175-03"/>
Nov 22 14:22:20 user nova-compute[74776]:     </interface>
Nov 22 14:22:20 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:22:20 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/console.log" append="off"/>
Nov 22 14:22:20 user nova-compute[74776]:     </serial>
Nov 22 14:22:20 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:22:20 user nova-compute[74776]:     <video>
Nov 22 14:22:20 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:22:20 user nova-compute[74776]:     </video>
Nov 22 14:22:20 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:22:20 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:22:20 user nova-compute[74776]:     </rng>
Nov 22 14:22:20 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:22:20 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:22:20 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:22:20 user nova-compute[74776]:     </memballoon>
Nov 22 14:22:20 user nova-compute[74776]:   </devices>
Nov 22 14:22:20 user nova-compute[74776]: </domain>
Nov 22 14:22:20 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1644694208',display_name='tempest-ServerActionsTestOtherB-server-1644694208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1644694208',id=2,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNubZ7Gk5h0q4OD6Enksl8Cxk/zzd+sbOwMvtIBBZUt9W+DL2N76A0FAo5K8lTdtosYaw4CTfnxfM5nY6xMBLxjo0J1fnDDgRvxTybxKH1mCAazzdEjSajoOw371LIwgmw==',key_name='tempest-keypair-1933513143',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:20:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ba1b35da14434fa09c3331d9c44d63fb',ramdisk_id='',reservation_id='r-fmg969sn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1073417585',owner_user_name='tempest-ServerActionsTestOtherB-1073417585-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:22:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84f6a2d2d72f42f1ba0ee9b623a0a9ca',uuid=e96ab1bf-6f19-4e5f-b79d-f0266988090b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Converting VIF {"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:46:f7,bridge_name='br-int',has_traffic_filtering=True,id=5911a175-03ae-4ed9-8c40-fc54c69233b4,network=Network(1287337f-aeac-4c5f-a6f0-3af84b13c33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5911a175-03') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_vif [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:46:f7,bridge_name='br-int',has_traffic_filtering=True,id=5911a175-03ae-4ed9-8c40-fc54c69233b4,network=Network(1287337f-aeac-4c5f-a6f0-3af84b13c33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5911a175-03') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[276b35a8-dc97-4871-a0b8-7b6a91a01811]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:22:20 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c74d6a55-b22d-59ad-82db-70b347dcfa06', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d130dc-2870-48bd-985f-6e6f4969de17]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3] added
Nov 22 14:22:20 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5911a175-03, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5911a175-03, col_values=(('qos', UUID('d3170328-3ef6-4eb0-85c7-19ca32e805aa')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5911a175-03, col_values=(('external_ids', {'iface-id': '5911a175-03ae-4ed9-8c40-fc54c69233b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:46:f7', 'vm-uuid': 'e96ab1bf-6f19-4e5f-b79d-f0266988090b'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[df59e891-dfae-4430-bf57-325f55aa1eda]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:20 user nova-compute[74776]: INFO os_vif [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:46:f7,bridge_name='br-int',has_traffic_filtering=True,id=5911a175-03ae-4ed9-8c40-fc54c69233b4,network=Network(1287337f-aeac-4c5f-a6f0-3af84b13c33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5911a175-03')
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d098bf-100a-4201-a7b3-4b272c40e93f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jJHwfbLd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jJHwfbLd" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2abc56e-7ebd-4d94-a2a1-e2d25e090cd8]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jJHwfbLd'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf11471-defa-45d5-a403-01b51c0b6a8f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2008b264-3531-48bc-8e58-246da5e6c8c0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:20 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:20 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb743e05-4b04-46df-8258-ae6820ad2854]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3, portal: 172.16.0.220,3260]
Nov 22 14:22:20 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3, portal: 172.16.0.220,3260] successful.
Nov 22 14:22:20 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b1a148-25c7-4fbe-a9f4-5f8bcae26777]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c309aa1-1890-49cc-994c-51e90bc792fa]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:20 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:20 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:20 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.427s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] HCTL ('39', '-', '-', 0) found on session 23 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e4f6d8-938c-43c2-b980-9048eaf9f691]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Searching for a device in session 23 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJHwfbLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG nova.network.neutron [req-8e5dcf1a-42e3-4b66-99cb-5cfc6a17c183 req-f3f60365-015d-4e9f-a1f4-c0f6d5482993 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Updated VIF entry in instance network info cache for port bc0c53a4-0e99-4794-863a-3dd7e2fd6622. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG nova.network.neutron [req-8e5dcf1a-42e3-4b66-99cb-5cfc6a17c183 req-f3f60365-015d-4e9f-a1f4-c0f6d5482993 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Updating instance_info_cache with network_info: [{"id": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "address": "fa:16:3e:85:36:3e", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c53a4-0e", "ovs_interfaceid": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-4d5ddc23-2c80-417d-a50e-85900553c1c9 req-c18966d7-fc71-4b4f-8511-62b910154ca8 service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Received event network-vif-plugged-c83b6599-820f-462a-bd26-af48014d7d7d {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4d5ddc23-2c80-417d-a50e-85900553c1c9 req-c18966d7-fc71-4b4f-8511-62b910154ca8 service nova] Acquiring lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4d5ddc23-2c80-417d-a50e-85900553c1c9 req-c18966d7-fc71-4b4f-8511-62b910154ca8 service nova] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4d5ddc23-2c80-417d-a50e-85900553c1c9 req-c18966d7-fc71-4b4f-8511-62b910154ca8 service nova] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-4d5ddc23-2c80-417d-a50e-85900553c1c9 req-c18966d7-fc71-4b4f-8511-62b910154ca8 service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] No waiting events found dispatching network-vif-plugged-c83b6599-820f-462a-bd26-af48014d7d7d {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:20 user nova-compute[74776]: WARNING nova.compute.manager [req-4d5ddc23-2c80-417d-a50e-85900553c1c9 req-c18966d7-fc71-4b4f-8511-62b910154ca8 service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Received unexpected event network-vif-plugged-c83b6599-820f-462a-bd26-af48014d7d7d for instance with vm_state active and task_state rescuing.
Nov 22 14:22:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8e5dcf1a-42e3-4b66-99cb-5cfc6a17c183 req-f3f60365-015d-4e9f-a1f4-c0f6d5482993 service nova] Releasing lock "refresh_cache-4246c1b7-6873-421a-ab2a-59dfb6adcb38" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.475s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] <== connect_volume: return (2556ms) {'type': 'block', 'scsi_wwn': '26264363939386364', 'path': '/dev/sdh'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264363939386364', 'path': '/dev/sdh'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T14:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1556564197',display_name='tempest-ServerActionsTestOtherA-server-676961491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1556564197',id=13,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAC9v0i+pER3cZ0Jjqv3cqTkz1HXyHfnSqpokTPMCo4Rsk1FySmrASTuu3c9HUsU6AsfF7+7FSXMyaBmojZ6N9tkTFvl0ozPbgI/kAIfW0Flf0H56UyV24UUsrzbg38lsw==',key_name='tempest-keypair-32107482',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:20:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3958d7be91b4bb1b9e314d8867cd8f5',ramdisk_id='',reservation_id='r-o0y8arto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-109524404',owner_user_name='tempest-ServerActionsTestOtherA-109524404-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:22:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f703bfbe762447778429bda22b74505c',uuid=d7f3ff5e-292d-4e81-af58-b9a45adfbda1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "address": "fa:16:3e:22:fe:77", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81372b6e-81", "ovs_interfaceid": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converting VIF {"id": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "address": "fa:16:3e:22:fe:77", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81372b6e-81", "ovs_interfaceid": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:fe:77,bridge_name='br-int',has_traffic_filtering=True,id=81372b6e-8162-4b1f-ac94-dcaf1c8c2473,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81372b6e-81') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:22:21 user nova-compute[74776]:   <uuid>d7f3ff5e-292d-4e81-af58-b9a45adfbda1</uuid>
Nov 22 14:22:21 user nova-compute[74776]:   <name>instance-0000000d</name>
Nov 22 14:22:21 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:22:21 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:22:21 user nova-compute[74776]:   <metadata>
Nov 22 14:22:21 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:22:21 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:22:21 user nova-compute[74776]:       <nova:name>tempest-ServerActionsTestOtherA-server-676961491</nova:name>
Nov 22 14:22:21 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:22:19</nova:creationTime>
Nov 22 14:22:21 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:22:21 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:22:21 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:22:21 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:22:21 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:22:21 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:22:21 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:22:21 user nova-compute[74776]:       <nova:owner>
Nov 22 14:22:21 user nova-compute[74776]:         <nova:user uuid="f703bfbe762447778429bda22b74505c">tempest-ServerActionsTestOtherA-109524404-project-member</nova:user>
Nov 22 14:22:21 user nova-compute[74776]:         <nova:project uuid="a3958d7be91b4bb1b9e314d8867cd8f5">tempest-ServerActionsTestOtherA-109524404</nova:project>
Nov 22 14:22:21 user nova-compute[74776]:       </nova:owner>
Nov 22 14:22:21 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:22:21 user nova-compute[74776]:       <nova:ports>
Nov 22 14:22:21 user nova-compute[74776]:         <nova:port uuid="81372b6e-8162-4b1f-ac94-dcaf1c8c2473">
Nov 22 14:22:21 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 14:22:21 user nova-compute[74776]:         </nova:port>
Nov 22 14:22:21 user nova-compute[74776]:       </nova:ports>
Nov 22 14:22:21 user nova-compute[74776]:     </nova:instance>
Nov 22 14:22:21 user nova-compute[74776]:   </metadata>
Nov 22 14:22:21 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:22:21 user nova-compute[74776]:     <system>
Nov 22 14:22:21 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:22:21 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:22:21 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:22:21 user nova-compute[74776]:       <entry name="serial">d7f3ff5e-292d-4e81-af58-b9a45adfbda1</entry>
Nov 22 14:22:21 user nova-compute[74776]:       <entry name="uuid">d7f3ff5e-292d-4e81-af58-b9a45adfbda1</entry>
Nov 22 14:22:21 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:22:21 user nova-compute[74776]:     </system>
Nov 22 14:22:21 user nova-compute[74776]:   </sysinfo>
Nov 22 14:22:21 user nova-compute[74776]:   <os>
Nov 22 14:22:21 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:22:21 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:22:21 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:22:21 user nova-compute[74776]:   </os>
Nov 22 14:22:21 user nova-compute[74776]:   <features>
Nov 22 14:22:21 user nova-compute[74776]:     <acpi/>
Nov 22 14:22:21 user nova-compute[74776]:     <apic/>
Nov 22 14:22:21 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:22:21 user nova-compute[74776]:   </features>
Nov 22 14:22:21 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:22:21 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:22:21 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:22:21 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:22:21 user nova-compute[74776]:   </clock>
Nov 22 14:22:21 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:22:21 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:22:21 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:22:21 user nova-compute[74776]:   </cpu>
Nov 22 14:22:21 user nova-compute[74776]:   <devices>
Nov 22 14:22:21 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:22:21 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:22:21 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk"/>
Nov 22 14:22:21 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:22:21 user nova-compute[74776]:     </disk>
Nov 22 14:22:21 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:22:21 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:22:21 user nova-compute[74776]:       <source dev="/dev/sdh"/>
Nov 22 14:22:21 user nova-compute[74776]:       <target dev="vdb" bus="virtio"/>
Nov 22 14:22:21 user nova-compute[74776]:       <serial>f4f9db8e-6078-4602-be9a-f6e8b1e727b3</serial>
Nov 22 14:22:21 user nova-compute[74776]:     </disk>
Nov 22 14:22:21 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:22:21 user nova-compute[74776]:       <mac address="fa:16:3e:22:fe:77"/>
Nov 22 14:22:21 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:22:21 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:22:21 user nova-compute[74776]:       <target dev="tap81372b6e-81"/>
Nov 22 14:22:21 user nova-compute[74776]:     </interface>
Nov 22 14:22:21 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:22:21 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/console.log" append="off"/>
Nov 22 14:22:21 user nova-compute[74776]:     </serial>
Nov 22 14:22:21 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:22:21 user nova-compute[74776]:     <video>
Nov 22 14:22:21 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:22:21 user nova-compute[74776]:     </video>
Nov 22 14:22:21 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:22:21 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:22:21 user nova-compute[74776]:     </rng>
Nov 22 14:22:21 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:22:21 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:22:21 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:22:21 user nova-compute[74776]:     </memballoon>
Nov 22 14:22:21 user nova-compute[74776]:   </devices>
Nov 22 14:22:21 user nova-compute[74776]: </domain>
Nov 22 14:22:21 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T14:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1556564197',display_name='tempest-ServerActionsTestOtherA-server-676961491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1556564197',id=13,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAC9v0i+pER3cZ0Jjqv3cqTkz1HXyHfnSqpokTPMCo4Rsk1FySmrASTuu3c9HUsU6AsfF7+7FSXMyaBmojZ6N9tkTFvl0ozPbgI/kAIfW0Flf0H56UyV24UUsrzbg38lsw==',key_name='tempest-keypair-32107482',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:20:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3958d7be91b4bb1b9e314d8867cd8f5',ramdisk_id='',reservation_id='r-o0y8arto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-109524404',owner_user_name='tempest-ServerActionsTestOtherA-109524404-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:22:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f703bfbe762447778429bda22b74505c',uuid=d7f3ff5e-292d-4e81-af58-b9a45adfbda1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "address": "fa:16:3e:22:fe:77", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81372b6e-81", "ovs_interfaceid": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converting VIF {"id": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "address": "fa:16:3e:22:fe:77", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81372b6e-81", "ovs_interfaceid": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:fe:77,bridge_name='br-int',has_traffic_filtering=True,id=81372b6e-8162-4b1f-ac94-dcaf1c8c2473,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81372b6e-81') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG os_vif [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:fe:77,bridge_name='br-int',has_traffic_filtering=True,id=81372b6e-8162-4b1f-ac94-dcaf1c8c2473,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81372b6e-81') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1f19de8-1309-5a7f-91c6-0adcd7a964c1', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81372b6e-81, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81372b6e-81, col_values=(('qos', UUID('c46a7b2c-efda-40cc-b7ae-d5de9f0fbe09')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81372b6e-81, col_values=(('external_ids', {'iface-id': '81372b6e-8162-4b1f-ac94-dcaf1c8c2473', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:fe:77', 'vm-uuid': 'd7f3ff5e-292d-4e81-af58-b9a45adfbda1'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:21 user nova-compute[74776]: INFO os_vif [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:fe:77,bridge_name='br-int',has_traffic_filtering=True,id=81372b6e-8162-4b1f-ac94-dcaf1c8c2473,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81372b6e-81')
Nov 22 14:22:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] No VIF found with MAC fa:16:3e:22:fe:77, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG nova.objects.instance [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lazy-loading 'flavor' on Instance uuid 4246c1b7-6873-421a-ab2a-59dfb6adcb38 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:22 user nova-compute[74776]: INFO nova.compute.manager [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Attaching volume 40726f1b-fbf2-4327-a6e1-7fda35aa7189 to /dev/vdb
Nov 22 14:22:22 user nova-compute[74776]: DEBUG os_brick.utils [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[02eee258-7f23-46d8-9f57-ff599145d609]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd11de89-ce17-428c-9dc2-c741dfc1b8d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d28a28a-e4d5-406a-9e0c-4b81118d9027]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe660d1-258f-4df9-a594-b1b03e995af6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:22:22 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:22:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a61b87-84f2-4c51-b1ce-d19c9c3f3026]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG os_brick.utils [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:22:22 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Updating existing volume attachment record: 1017860d-f232-4011-b12a-4fb28eb2d87e {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:22:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-9a1559a7-88bf-43bf-b200-b0cd26421b01 req-231a674a-e32b-49f3-bbd4-4ac840cd695a service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Received event network-vif-plugged-c83b6599-820f-462a-bd26-af48014d7d7d {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9a1559a7-88bf-43bf-b200-b0cd26421b01 req-231a674a-e32b-49f3-bbd4-4ac840cd695a service nova] Acquiring lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9a1559a7-88bf-43bf-b200-b0cd26421b01 req-231a674a-e32b-49f3-bbd4-4ac840cd695a service nova] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9a1559a7-88bf-43bf-b200-b0cd26421b01 req-231a674a-e32b-49f3-bbd4-4ac840cd695a service nova] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-9a1559a7-88bf-43bf-b200-b0cd26421b01 req-231a674a-e32b-49f3-bbd4-4ac840cd695a service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] No waiting events found dispatching network-vif-plugged-c83b6599-820f-462a-bd26-af48014d7d7d {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:23 user nova-compute[74776]: WARNING nova.compute.manager [req-9a1559a7-88bf-43bf-b200-b0cd26421b01 req-231a674a-e32b-49f3-bbd4-4ac840cd695a service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Received unexpected event network-vif-plugged-c83b6599-820f-462a-bd26-af48014d7d7d for instance with vm_state active and task_state rescuing.
Nov 22 14:22:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-9a1559a7-88bf-43bf-b200-b0cd26421b01 req-231a674a-e32b-49f3-bbd4-4ac840cd695a service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Received event network-vif-plugged-c83b6599-820f-462a-bd26-af48014d7d7d {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9a1559a7-88bf-43bf-b200-b0cd26421b01 req-231a674a-e32b-49f3-bbd4-4ac840cd695a service nova] Acquiring lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9a1559a7-88bf-43bf-b200-b0cd26421b01 req-231a674a-e32b-49f3-bbd4-4ac840cd695a service nova] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9a1559a7-88bf-43bf-b200-b0cd26421b01 req-231a674a-e32b-49f3-bbd4-4ac840cd695a service nova] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-9a1559a7-88bf-43bf-b200-b0cd26421b01 req-231a674a-e32b-49f3-bbd4-4ac840cd695a service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] No waiting events found dispatching network-vif-plugged-c83b6599-820f-462a-bd26-af48014d7d7d {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:23 user nova-compute[74776]: WARNING nova.compute.manager [req-9a1559a7-88bf-43bf-b200-b0cd26421b01 req-231a674a-e32b-49f3-bbd4-4ac840cd695a service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Received unexpected event network-vif-plugged-c83b6599-820f-462a-bd26-af48014d7d7d for instance with vm_state active and task_state rescuing.
Nov 22 14:22:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "25deabe8-8cfc-4d40-a734-755d4097baf5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "25deabe8-8cfc-4d40-a734-755d4097baf5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "25deabe8-8cfc-4d40-a734-755d4097baf5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "25deabe8-8cfc-4d40-a734-755d4097baf5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "25deabe8-8cfc-4d40-a734-755d4097baf5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:23 user nova-compute[74776]: INFO nova.compute.manager [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Terminating instance
Nov 22 14:22:23 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:22:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-d258f77b-c067-4a03-aff5-d1a58f8127d2 req-9994e1f6-a664-4533-a33e-2b92a1508fb5 service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Received event network-vif-plugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d258f77b-c067-4a03-aff5-d1a58f8127d2 req-9994e1f6-a664-4533-a33e-2b92a1508fb5 service nova] Acquiring lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d258f77b-c067-4a03-aff5-d1a58f8127d2 req-9994e1f6-a664-4533-a33e-2b92a1508fb5 service nova] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d258f77b-c067-4a03-aff5-d1a58f8127d2 req-9994e1f6-a664-4533-a33e-2b92a1508fb5 service nova] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-d258f77b-c067-4a03-aff5-d1a58f8127d2 req-9994e1f6-a664-4533-a33e-2b92a1508fb5 service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] No waiting events found dispatching network-vif-plugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:24 user nova-compute[74776]: WARNING nova.compute.manager [req-d258f77b-c067-4a03-aff5-d1a58f8127d2 req-9994e1f6-a664-4533-a33e-2b92a1508fb5 service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Received unexpected event network-vif-plugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 for instance with vm_state active and task_state rebuild_spawning.
Nov 22 14:22:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-926eb10d-d0ad-4a0c-9f3b-e6b8b31b390a req-6262eb4c-4b90-4840-84d7-fa843f17841e service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Received event network-vif-unplugged-08471f51-9b29-4d1f-9c06-3006abae8ff1 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-926eb10d-d0ad-4a0c-9f3b-e6b8b31b390a req-6262eb4c-4b90-4840-84d7-fa843f17841e service nova] Acquiring lock "25deabe8-8cfc-4d40-a734-755d4097baf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-926eb10d-d0ad-4a0c-9f3b-e6b8b31b390a req-6262eb4c-4b90-4840-84d7-fa843f17841e service nova] Lock "25deabe8-8cfc-4d40-a734-755d4097baf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-926eb10d-d0ad-4a0c-9f3b-e6b8b31b390a req-6262eb4c-4b90-4840-84d7-fa843f17841e service nova] Lock "25deabe8-8cfc-4d40-a734-755d4097baf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-926eb10d-d0ad-4a0c-9f3b-e6b8b31b390a req-6262eb4c-4b90-4840-84d7-fa843f17841e service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] No waiting events found dispatching network-vif-unplugged-08471f51-9b29-4d1f-9c06-3006abae8ff1 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-926eb10d-d0ad-4a0c-9f3b-e6b8b31b390a req-6262eb4c-4b90-4840-84d7-fa843f17841e service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Received event network-vif-unplugged-08471f51-9b29-4d1f-9c06-3006abae8ff1 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-926eb10d-d0ad-4a0c-9f3b-e6b8b31b390a req-6262eb4c-4b90-4840-84d7-fa843f17841e service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Received event network-vif-plugged-08471f51-9b29-4d1f-9c06-3006abae8ff1 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-926eb10d-d0ad-4a0c-9f3b-e6b8b31b390a req-6262eb4c-4b90-4840-84d7-fa843f17841e service nova] Acquiring lock "25deabe8-8cfc-4d40-a734-755d4097baf5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-926eb10d-d0ad-4a0c-9f3b-e6b8b31b390a req-6262eb4c-4b90-4840-84d7-fa843f17841e service nova] Lock "25deabe8-8cfc-4d40-a734-755d4097baf5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-926eb10d-d0ad-4a0c-9f3b-e6b8b31b390a req-6262eb4c-4b90-4840-84d7-fa843f17841e service nova] Lock "25deabe8-8cfc-4d40-a734-755d4097baf5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-926eb10d-d0ad-4a0c-9f3b-e6b8b31b390a req-6262eb4c-4b90-4840-84d7-fa843f17841e service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] No waiting events found dispatching network-vif-plugged-08471f51-9b29-4d1f-9c06-3006abae8ff1 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:25 user nova-compute[74776]: WARNING nova.compute.manager [req-926eb10d-d0ad-4a0c-9f3b-e6b8b31b390a req-6262eb4c-4b90-4840-84d7-fa843f17841e service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Received unexpected event network-vif-plugged-08471f51-9b29-4d1f-9c06-3006abae8ff1 for instance with vm_state active and task_state deleting.
Nov 22 14:22:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:25 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Instance destroyed successfully.
Nov 22 14:22:25 user nova-compute[74776]: DEBUG nova.objects.instance [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lazy-loading 'resources' on Instance uuid 25deabe8-8cfc-4d40-a734-755d4097baf5 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-221678284',display_name='tempest-VolumesAdminNegativeTest-server-221678284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-221678284',id=6,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7x2qjoHC8BWrj2Byhutl6d7bc2RSC/A4Hs4S4Yj8xexGyuGpoqWKkoPIZ1qZDosY3ovqXe0RTce8tRNzRbTOgFPc7JnwJMN7ISPQOONjqpb6BTQz7wH8u8Y3pBAODUYA==',key_name='tempest-keypair-666513585',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:16:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e84f31ee687a47558c74cf007bd17175',ramdisk_id='',reservation_id='r-h0dpsmw1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1815512001',owner_user_name='tempest-VolumesAdminNegativeTest-1815512001-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:16:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d30d915576746b0a9f38789a2e74f03',uuid=25deabe8-8cfc-4d40-a734-755d4097baf5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "address": "fa:16:3e:98:ce:04", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08471f51-9b", "ovs_interfaceid": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Converting VIF {"id": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "address": "fa:16:3e:98:ce:04", "network": {"id": "59cbde16-cdcd-4761-9c50-b31b4f2387b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1379160631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e84f31ee687a47558c74cf007bd17175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08471f51-9b", "ovs_interfaceid": "08471f51-9b29-4d1f-9c06-3006abae8ff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:ce:04,bridge_name='br-int',has_traffic_filtering=True,id=08471f51-9b29-4d1f-9c06-3006abae8ff1,network=Network(59cbde16-cdcd-4761-9c50-b31b4f2387b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08471f51-9b') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG os_vif [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:ce:04,bridge_name='br-int',has_traffic_filtering=True,id=08471f51-9b29-4d1f-9c06-3006abae8ff1,network=Network(59cbde16-cdcd-4761-9c50-b31b4f2387b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08471f51-9b') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-85af2f4e-b154-4567-8a8b-2ed987b0508c req-a46a633a-1973-4461-b374-d81c5c350a85 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-85af2f4e-b154-4567-8a8b-2ed987b0508c req-a46a633a-1973-4461-b374-d81c5c350a85 service nova] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-85af2f4e-b154-4567-8a8b-2ed987b0508c req-a46a633a-1973-4461-b374-d81c5c350a85 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-85af2f4e-b154-4567-8a8b-2ed987b0508c req-a46a633a-1973-4461-b374-d81c5c350a85 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-85af2f4e-b154-4567-8a8b-2ed987b0508c req-a46a633a-1973-4461-b374-d81c5c350a85 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] No waiting events found dispatching network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:25 user nova-compute[74776]: WARNING nova.compute.manager [req-85af2f4e-b154-4567-8a8b-2ed987b0508c req-a46a633a-1973-4461-b374-d81c5c350a85 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received unexpected event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 for instance with vm_state resized and task_state resize_reverting.
Nov 22 14:22:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08471f51-9b, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db921947-4281-4499-82d4-0ab89b78abd7) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:25 user nova-compute[74776]: INFO os_vif [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:ce:04,bridge_name='br-int',has_traffic_filtering=True,id=08471f51-9b29-4d1f-9c06-3006abae8ff1,network=Network(59cbde16-cdcd-4761-9c50-b31b4f2387b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08471f51-9b')
Nov 22 14:22:25 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Deleting instance files /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5_del
Nov 22 14:22:25 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Deletion of /opt/stack/data/nova/instances/25deabe8-8cfc-4d40-a734-755d4097baf5_del complete
Nov 22 14:22:25 user nova-compute[74776]: INFO nova.compute.manager [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Took 2.23 seconds to destroy the instance on the hypervisor.
Nov 22 14:22:25 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:26 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:22:26 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Took 0.94 seconds to deallocate network for instance.
Nov 22 14:22:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:26 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:22:26 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:22:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:27 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Deleted allocations for instance 25deabe8-8cfc-4d40-a734-755d4097baf5
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.compute.manager [req-47591730-4576-48d1-b26e-19fd4abf81a3 req-9baac68a-eb22-4b0b-8a4e-33122d15cd21 service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Received event network-vif-plugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-47591730-4576-48d1-b26e-19fd4abf81a3 req-9baac68a-eb22-4b0b-8a4e-33122d15cd21 service nova] Acquiring lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-47591730-4576-48d1-b26e-19fd4abf81a3 req-9baac68a-eb22-4b0b-8a4e-33122d15cd21 service nova] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-47591730-4576-48d1-b26e-19fd4abf81a3 req-9baac68a-eb22-4b0b-8a4e-33122d15cd21 service nova] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.compute.manager [req-47591730-4576-48d1-b26e-19fd4abf81a3 req-9baac68a-eb22-4b0b-8a4e-33122d15cd21 service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] No waiting events found dispatching network-vif-plugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:27 user nova-compute[74776]: WARNING nova.compute.manager [req-47591730-4576-48d1-b26e-19fd4abf81a3 req-9baac68a-eb22-4b0b-8a4e-33122d15cd21 service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Received unexpected event network-vif-plugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 for instance with vm_state active and task_state rebuild_spawning.
Nov 22 14:22:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4da15a5a-6d28-4f12-a6aa-bd3ac68b340c tempest-VolumesAdminNegativeTest-1815512001 tempest-VolumesAdminNegativeTest-1815512001-project-member] Lock "25deabe8-8cfc-4d40-a734-755d4097baf5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.875s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.compute.manager [req-0fc5c8ee-8d41-4daf-a408-521e3e18f3f3 req-7ecfb0bb-df6c-48f0-ab54-8a25247c7c54 service nova] [instance: 25deabe8-8cfc-4d40-a734-755d4097baf5] Received event network-vif-deleted-08471f51-9b29-4d1f-9c06-3006abae8ff1 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.compute.manager [req-32954202-46a7-41fc-b91f-da1039e49f27 req-4c8ba2ac-a417-4433-9c85-554675ab7bcd service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-32954202-46a7-41fc-b91f-da1039e49f27 req-4c8ba2ac-a417-4433-9c85-554675ab7bcd service nova] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-32954202-46a7-41fc-b91f-da1039e49f27 req-4c8ba2ac-a417-4433-9c85-554675ab7bcd service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-32954202-46a7-41fc-b91f-da1039e49f27 req-4c8ba2ac-a417-4433-9c85-554675ab7bcd service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.compute.manager [req-32954202-46a7-41fc-b91f-da1039e49f27 req-4c8ba2ac-a417-4433-9c85-554675ab7bcd service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] No waiting events found dispatching network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:27 user nova-compute[74776]: WARNING nova.compute.manager [req-32954202-46a7-41fc-b91f-da1039e49f27 req-4c8ba2ac-a417-4433-9c85-554675ab7bcd service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received unexpected event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 for instance with vm_state resized and task_state resize_reverting.
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-e5a0cb69-783b-46ef-a699-983f31ade9e2 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:22:27 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Instance spawned successfully.
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:22:27 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Instance running successfully.
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] finish_revert_migration finished successfully. {{(pid=74776) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 22 14:22:27 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Waiting for libvirt event about the detach of device tapb25ae5ba-03 with device alias net1 from instance 6dcf355f-759d-4a9a-9fb6-394e242c03e4 is timed out.
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7a:a2:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tapb25ae5ba-03"/></interface> {{(pid=74776) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7a:a2:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tapb25ae5ba-03"/></interface>not found in domain: <domain type='kvm' id='12'>
Nov 22 14:22:27 user nova-compute[74776]:   <name>instance-0000000c</name>
Nov 22 14:22:27 user nova-compute[74776]:   <uuid>6dcf355f-759d-4a9a-9fb6-394e242c03e4</uuid>
Nov 22 14:22:27 user nova-compute[74776]:   <metadata>
Nov 22 14:22:27 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:22:27 user nova-compute[74776]:   <nova:package version="0.0.0"/>
Nov 22 14:22:27 user nova-compute[74776]:   <nova:name>tempest-device-tagging-server-1295290313</nova:name>
Nov 22 14:22:27 user nova-compute[74776]:   <nova:creationTime>2023-11-22 14:21:32</nova:creationTime>
Nov 22 14:22:27 user nova-compute[74776]:   <nova:flavor name="m1.tiny">
Nov 22 14:22:27 user nova-compute[74776]:     <nova:memory>512</nova:memory>
Nov 22 14:22:27 user nova-compute[74776]:     <nova:disk>1</nova:disk>
Nov 22 14:22:27 user nova-compute[74776]:     <nova:swap>0</nova:swap>
Nov 22 14:22:27 user nova-compute[74776]:     <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:22:27 user nova-compute[74776]:     <nova:vcpus>1</nova:vcpus>
Nov 22 14:22:27 user nova-compute[74776]:   </nova:flavor>
Nov 22 14:22:27 user nova-compute[74776]:   <nova:owner>
Nov 22 14:22:27 user nova-compute[74776]:     <nova:user uuid="1d173b822df3448bb49245f30afc0e17">tempest-TaggedAttachmentsTest-2066916431-project-member</nova:user>
Nov 22 14:22:27 user nova-compute[74776]:     <nova:project uuid="027310982a0047d9a0d06c29b5b6e1f2">tempest-TaggedAttachmentsTest-2066916431</nova:project>
Nov 22 14:22:27 user nova-compute[74776]:   </nova:owner>
Nov 22 14:22:27 user nova-compute[74776]:   <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:22:27 user nova-compute[74776]:   <nova:ports>
Nov 22 14:22:27 user nova-compute[74776]:     <nova:port uuid="d13f9065-d7f3-4274-929f-3ac85db8bf73">
Nov 22 14:22:27 user nova-compute[74776]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 14:22:27 user nova-compute[74776]:     </nova:port>
Nov 22 14:22:27 user nova-compute[74776]:     <nova:port uuid="b25ae5ba-034e-4c8f-b11a-570458c20dfe">
Nov 22 14:22:27 user nova-compute[74776]:       <nova:ip type="fixed" address="10.10.10.228" ipVersion="4"/>
Nov 22 14:22:27 user nova-compute[74776]:     </nova:port>
Nov 22 14:22:27 user nova-compute[74776]:   </nova:ports>
Nov 22 14:22:27 user nova-compute[74776]: </nova:instance>
Nov 22 14:22:27 user nova-compute[74776]:   </metadata>
Nov 22 14:22:27 user nova-compute[74776]:   <memory unit='KiB'>524288</memory>
Nov 22 14:22:27 user nova-compute[74776]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 22 14:22:27 user nova-compute[74776]:   <vcpu placement='static'>1</vcpu>
Nov 22 14:22:27 user nova-compute[74776]:   <resource>
Nov 22 14:22:27 user nova-compute[74776]:     <partition>/machine</partition>
Nov 22 14:22:27 user nova-compute[74776]:   </resource>
Nov 22 14:22:27 user nova-compute[74776]:   <sysinfo type='smbios'>
Nov 22 14:22:27 user nova-compute[74776]:     <system>
Nov 22 14:22:27 user nova-compute[74776]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 22 14:22:27 user nova-compute[74776]:       <entry name='product'>OpenStack Nova</entry>
Nov 22 14:22:27 user nova-compute[74776]:       <entry name='version'>0.0.0</entry>
Nov 22 14:22:27 user nova-compute[74776]:       <entry name='serial'>6dcf355f-759d-4a9a-9fb6-394e242c03e4</entry>
Nov 22 14:22:27 user nova-compute[74776]:       <entry name='uuid'>6dcf355f-759d-4a9a-9fb6-394e242c03e4</entry>
Nov 22 14:22:27 user nova-compute[74776]:       <entry name='family'>Virtual Machine</entry>
Nov 22 14:22:27 user nova-compute[74776]:     </system>
Nov 22 14:22:27 user nova-compute[74776]:   </sysinfo>
Nov 22 14:22:27 user nova-compute[74776]:   <os>
Nov 22 14:22:27 user nova-compute[74776]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 22 14:22:27 user nova-compute[74776]:     <boot dev='hd'/>
Nov 22 14:22:27 user nova-compute[74776]:     <smbios mode='sysinfo'/>
Nov 22 14:22:27 user nova-compute[74776]:   </os>
Nov 22 14:22:27 user nova-compute[74776]:   <features>
Nov 22 14:22:27 user nova-compute[74776]:     <acpi/>
Nov 22 14:22:27 user nova-compute[74776]:     <apic/>
Nov 22 14:22:27 user nova-compute[74776]:     <vmcoreinfo state='on'/>
Nov 22 14:22:27 user nova-compute[74776]:   </features>
Nov 22 14:22:27 user nova-compute[74776]:   <cpu mode='custom' match='exact' check='full'>
Nov 22 14:22:27 user nova-compute[74776]:     <model fallback='forbid'>Nehalem</model>
Nov 22 14:22:27 user nova-compute[74776]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 22 14:22:27 user nova-compute[74776]:     <feature policy='require' name='vme'/>
Nov 22 14:22:27 user nova-compute[74776]:     <feature policy='require' name='x2apic'/>
Nov 22 14:22:27 user nova-compute[74776]:     <feature policy='require' name='hypervisor'/>
Nov 22 14:22:27 user nova-compute[74776]:   </cpu>
Nov 22 14:22:27 user nova-compute[74776]:   <clock offset='utc'>
Nov 22 14:22:27 user nova-compute[74776]:     <timer name='pit' tickpolicy='delay'/>
Nov 22 14:22:27 user nova-compute[74776]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 22 14:22:27 user nova-compute[74776]:     <timer name='hpet' present='no'/>
Nov 22 14:22:27 user nova-compute[74776]:   </clock>
Nov 22 14:22:27 user nova-compute[74776]:   <on_poweroff>destroy</on_poweroff>
Nov 22 14:22:27 user nova-compute[74776]:   <on_reboot>restart</on_reboot>
Nov 22 14:22:27 user nova-compute[74776]:   <on_crash>destroy</on_crash>
Nov 22 14:22:27 user nova-compute[74776]:   <devices>
Nov 22 14:22:27 user nova-compute[74776]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 22 14:22:27 user nova-compute[74776]:     <disk type='file' device='disk'>
Nov 22 14:22:27 user nova-compute[74776]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 22 14:22:27 user nova-compute[74776]:       <source file='/opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk' index='2'/>
Nov 22 14:22:27 user nova-compute[74776]:       <backingStore type='file' index='3'>
Nov 22 14:22:27 user nova-compute[74776]:         <format type='raw'/>
Nov 22 14:22:27 user nova-compute[74776]:         <source file='/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e'/>
Nov 22 14:22:27 user nova-compute[74776]:         <backingStore/>
Nov 22 14:22:27 user nova-compute[74776]:       </backingStore>
Nov 22 14:22:27 user nova-compute[74776]:       <target dev='vda' bus='virtio'/>
Nov 22 14:22:27 user nova-compute[74776]:       <alias name='virtio-disk0'/>
Nov 22 14:22:27 user nova-compute[74776]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 22 14:22:27 user nova-compute[74776]:     </disk>
Nov 22 14:22:27 user nova-compute[74776]:     <disk type='file' device='cdrom'>
Nov 22 14:22:27 user nova-compute[74776]:       <driver name='qemu' type='raw' cache='none'/>
Nov 22 14:22:27 user nova-compute[74776]:       <source file='/opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/disk.config' index='1'/>
Nov 22 14:22:27 user nova-compute[74776]:       <backingStore/>
Nov 22 14:22:27 user nova-compute[74776]:       <target dev='hda' bus='ide'/>
Nov 22 14:22:27 user nova-compute[74776]:       <readonly/>
Nov 22 14:22:27 user nova-compute[74776]:       <alias name='ide0-0-0'/>
Nov 22 14:22:27 user nova-compute[74776]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 22 14:22:27 user nova-compute[74776]:     </disk>
Nov 22 14:22:27 user nova-compute[74776]:     <controller type='usb' index='0' model='none'>
Nov 22 14:22:27 user nova-compute[74776]:       <alias name='usb'/>
Nov 22 14:22:27 user nova-compute[74776]:     </controller>
Nov 22 14:22:27 user nova-compute[74776]:     <controller type='pci' index='0' model='pci-root'>
Nov 22 14:22:27 user nova-compute[74776]:       <alias name='pci.0'/>
Nov 22 14:22:27 user nova-compute[74776]:     </controller>
Nov 22 14:22:27 user nova-compute[74776]:     <controller type='ide' index='0'>
Nov 22 14:22:27 user nova-compute[74776]:       <alias name='ide'/>
Nov 22 14:22:27 user nova-compute[74776]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 22 14:22:27 user nova-compute[74776]:     </controller>
Nov 22 14:22:27 user nova-compute[74776]:     <interface type='ethernet'>
Nov 22 14:22:27 user nova-compute[74776]:       <mac address='fa:16:3e:0f:a0:64'/>
Nov 22 14:22:27 user nova-compute[74776]:       <target dev='tapd13f9065-d7'/>
Nov 22 14:22:27 user nova-compute[74776]:       <model type='virtio'/>
Nov 22 14:22:27 user nova-compute[74776]:       <mtu size='1442'/>
Nov 22 14:22:27 user nova-compute[74776]:       <alias name='net0'/>
Nov 22 14:22:27 user nova-compute[74776]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 22 14:22:27 user nova-compute[74776]:     </interface>
Nov 22 14:22:27 user nova-compute[74776]:     <serial type='pty'>
Nov 22 14:22:27 user nova-compute[74776]:       <source path='/dev/pts/4'/>
Nov 22 14:22:27 user nova-compute[74776]:       <log file='/opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/console.log' append='off'/>
Nov 22 14:22:27 user nova-compute[74776]:       <target type='isa-serial' port='0'>
Nov 22 14:22:27 user nova-compute[74776]:         <model name='isa-serial'/>
Nov 22 14:22:27 user nova-compute[74776]:       </target>
Nov 22 14:22:27 user nova-compute[74776]:       <alias name='serial0'/>
Nov 22 14:22:27 user nova-compute[74776]:     </serial>
Nov 22 14:22:27 user nova-compute[74776]:     <console type='pty' tty='/dev/pts/4'>
Nov 22 14:22:27 user nova-compute[74776]:       <source path='/dev/pts/4'/>
Nov 22 14:22:27 user nova-compute[74776]:       <log file='/opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4/console.log' append='off'/>
Nov 22 14:22:27 user nova-compute[74776]:       <target type='serial' port='0'/>
Nov 22 14:22:27 user nova-compute[74776]:       <alias name='serial0'/>
Nov 22 14:22:27 user nova-compute[74776]:     </console>
Nov 22 14:22:27 user nova-compute[74776]:     <input type='mouse' bus='ps2'>
Nov 22 14:22:27 user nova-compute[74776]:       <alias name='input0'/>
Nov 22 14:22:27 user nova-compute[74776]:     </input>
Nov 22 14:22:27 user nova-compute[74776]:     <input type='keyboard' bus='ps2'>
Nov 22 14:22:27 user nova-compute[74776]:       <alias name='input1'/>
Nov 22 14:22:27 user nova-compute[74776]:     </input>
Nov 22 14:22:27 user nova-compute[74776]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 22 14:22:27 user nova-compute[74776]:       <listen type='address' address='0.0.0.0'/>
Nov 22 14:22:27 user nova-compute[74776]:     </graphics>
Nov 22 14:22:27 user nova-compute[74776]:     <audio id='1' type='none'/>
Nov 22 14:22:27 user nova-compute[74776]:     <video>
Nov 22 14:22:27 user nova-compute[74776]:       <model type='virtio' heads='1' primary='yes'/>
Nov 22 14:22:27 user nova-compute[74776]:       <alias name='video0'/>
Nov 22 14:22:27 user nova-compute[74776]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 22 14:22:27 user nova-compute[74776]:     </video>
Nov 22 14:22:27 user nova-compute[74776]:     <memballoon model='virtio'>
Nov 22 14:22:27 user nova-compute[74776]:       <stats period='10'/>
Nov 22 14:22:27 user nova-compute[74776]:       <alias name='balloon0'/>
Nov 22 14:22:27 user nova-compute[74776]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 22 14:22:27 user nova-compute[74776]:     </memballoon>
Nov 22 14:22:27 user nova-compute[74776]:     <rng model='virtio'>
Nov 22 14:22:27 user nova-compute[74776]:       <backend model='random'>/dev/urandom</backend>
Nov 22 14:22:27 user nova-compute[74776]:       <alias name='rng0'/>
Nov 22 14:22:27 user nova-compute[74776]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 22 14:22:27 user nova-compute[74776]:     </rng>
Nov 22 14:22:27 user nova-compute[74776]:   </devices>
Nov 22 14:22:27 user nova-compute[74776]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 22 14:22:27 user nova-compute[74776]:     <label>libvirt-6dcf355f-759d-4a9a-9fb6-394e242c03e4</label>
Nov 22 14:22:27 user nova-compute[74776]:     <imagelabel>libvirt-6dcf355f-759d-4a9a-9fb6-394e242c03e4</imagelabel>
Nov 22 14:22:27 user nova-compute[74776]:   </seclabel>
Nov 22 14:22:27 user nova-compute[74776]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 22 14:22:27 user nova-compute[74776]:     <label>+64055:+108</label>
Nov 22 14:22:27 user nova-compute[74776]:     <imagelabel>+64055:+108</imagelabel>
Nov 22 14:22:27 user nova-compute[74776]:   </seclabel>
Nov 22 14:22:27 user nova-compute[74776]: </domain>
Nov 22 14:22:27 user nova-compute[74776]:  {{(pid=74776) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 22 14:22:27 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Successfully detached device tapb25ae5ba-03 from instance 6dcf355f-759d-4a9a-9fb6-394e242c03e4 from the live domain config.
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1295290313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1295290313',id=12,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOi2wt6bwWC52YfMKFz0ZOdIihoSozV9972X7DtLjMCaPcI7UTCrW5QcIACFjc56Pj6b7cRSH9i47OvgkdTcAES+2IVEx2e8rM0Q9iF4eOSwA6MrKwoAcVhYd6C5lAkb1w==',key_name='tempest-keypair-973400344',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:19:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='027310982a0047d9a0d06c29b5b6e1f2',ramdisk_id='',reservation_id='r-n0ic6hqp',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2066916431',owner_user_name='tempest-TaggedAttachmentsTest-2066916431-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:19:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d173b822df3448bb49245f30afc0e17',uuid=6dcf355f-759d-4a9a-9fb6-394e242c03e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b25ae5ba-034e-4c8f-b11a-570458c20dfe", "address": "fa:16:3e:7a:a2:a1", "network": {"id": "ac41ca40-21af-4bcd-a64f-afc65a8556f3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-121572572", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb25ae5ba-03", "ovs_interfaceid": "b25ae5ba-034e-4c8f-b11a-570458c20dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Converting VIF {"id": "b25ae5ba-034e-4c8f-b11a-570458c20dfe", "address": "fa:16:3e:7a:a2:a1", "network": {"id": "ac41ca40-21af-4bcd-a64f-afc65a8556f3", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-121572572", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb25ae5ba-03", "ovs_interfaceid": "b25ae5ba-034e-4c8f-b11a-570458c20dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a2:a1,bridge_name='br-int',has_traffic_filtering=True,id=b25ae5ba-034e-4c8f-b11a-570458c20dfe,network=Network(ac41ca40-21af-4bcd-a64f-afc65a8556f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb25ae5ba-03') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG os_vif [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a2:a1,bridge_name='br-int',has_traffic_filtering=True,id=b25ae5ba-034e-4c8f-b11a-570458c20dfe,network=Network(ac41ca40-21af-4bcd-a64f-afc65a8556f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb25ae5ba-03') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb25ae5ba-03, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4698bbc-ceb1-4ac3-9739-7fbc430c9cba) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.objects.instance [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74776) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:27 user nova-compute[74776]: INFO os_vif [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a2:a1,bridge_name='br-int',has_traffic_filtering=True,id=b25ae5ba-034e-4c8f-b11a-570458c20dfe,network=Network(ac41ca40-21af-4bcd-a64f-afc65a8556f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb25ae5ba-03')
Nov 22 14:22:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:22:27 user nova-compute[74776]:   <nova:package version="0.0.0"/>
Nov 22 14:22:27 user nova-compute[74776]:   <nova:name>tempest-device-tagging-server-1295290313</nova:name>
Nov 22 14:22:27 user nova-compute[74776]:   <nova:creationTime>2023-11-22 14:22:27</nova:creationTime>
Nov 22 14:22:27 user nova-compute[74776]:   <nova:flavor name="m1.tiny">
Nov 22 14:22:27 user nova-compute[74776]:     <nova:memory>512</nova:memory>
Nov 22 14:22:27 user nova-compute[74776]:     <nova:disk>1</nova:disk>
Nov 22 14:22:27 user nova-compute[74776]:     <nova:swap>0</nova:swap>
Nov 22 14:22:27 user nova-compute[74776]:     <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:22:27 user nova-compute[74776]:     <nova:vcpus>1</nova:vcpus>
Nov 22 14:22:27 user nova-compute[74776]:   </nova:flavor>
Nov 22 14:22:27 user nova-compute[74776]:   <nova:owner>
Nov 22 14:22:27 user nova-compute[74776]:     <nova:user uuid="1d173b822df3448bb49245f30afc0e17">tempest-TaggedAttachmentsTest-2066916431-project-member</nova:user>
Nov 22 14:22:27 user nova-compute[74776]:     <nova:project uuid="027310982a0047d9a0d06c29b5b6e1f2">tempest-TaggedAttachmentsTest-2066916431</nova:project>
Nov 22 14:22:27 user nova-compute[74776]:   </nova:owner>
Nov 22 14:22:27 user nova-compute[74776]:   <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:22:27 user nova-compute[74776]:   <nova:ports>
Nov 22 14:22:27 user nova-compute[74776]:     <nova:port uuid="d13f9065-d7f3-4274-929f-3ac85db8bf73">
Nov 22 14:22:27 user nova-compute[74776]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 14:22:27 user nova-compute[74776]:     </nova:port>
Nov 22 14:22:27 user nova-compute[74776]:   </nova:ports>
Nov 22 14:22:27 user nova-compute[74776]: </nova:instance>
Nov 22 14:22:27 user nova-compute[74776]:  {{(pid=74776) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 22 14:22:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9a9bc856-4e79-4c0f-a1c6-148f077cf7d3 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.113s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:28 user nova-compute[74776]: INFO nova.compute.manager [None req-f7046d7f-c6bb-4472-b09c-5364311fa502 tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Updating instance to original state: 'active'
Nov 22 14:22:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquiring lock "refresh_cache-6dcf355f-759d-4a9a-9fb6-394e242c03e4" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:22:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquired lock "refresh_cache-6dcf355f-759d-4a9a-9fb6-394e242c03e4" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:22:28 user nova-compute[74776]: DEBUG nova.network.neutron [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:22:29 user nova-compute[74776]: INFO nova.network.neutron [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Port b25ae5ba-034e-4c8f-b11a-570458c20dfe from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 22 14:22:29 user nova-compute[74776]: DEBUG nova.network.neutron [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Updating instance_info_cache with network_info: [{"id": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "address": "fa:16:3e:0f:a0:64", "network": {"id": "2fd2ca6a-6401-4865-99d6-647854bec84d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1799040535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13f9065-d7", "ovs_interfaceid": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:22:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Releasing lock "refresh_cache-6dcf355f-759d-4a9a-9fb6-394e242c03e4" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:22:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2012cc46-efb0-4a8b-b2bc-3b817e3f2145 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "interface-6dcf355f-759d-4a9a-9fb6-394e242c03e4-b25ae5ba-034e-4c8f-b11a-570458c20dfe" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.862s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:29 user nova-compute[74776]: DEBUG nova.compute.manager [req-9c1cb95a-5ba7-474d-b3ec-3ec79f7074b3 req-9fd0cee1-049d-4fe2-bfb3-4a76a6612108 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Received event network-vif-deleted-b25ae5ba-034e-4c8f-b11a-570458c20dfe {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TaMHeyJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:22:30 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:30 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:30 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2f3ea5-f20c-48a9-a227-4bcc2d83df6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:22:30 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d095f05c-f226-4a31-8b40-0dc424f100ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189] added
Nov 22 14:22:30 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[85074e4f-a33c-45df-b927-7faab1f592d5]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[332816b1-c873-41ba-b444-aa72a1e1a4f0]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TaMHeyJG {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TaMHeyJG" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e254db-e724-48f8-818c-acc8371c37d6]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TaMHeyJG'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1e2107-11f4-441d-9470-fe9cd7f4fa9e]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b6c7fc-43ad-4099-b821-bef4e05bad67]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:30 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:30 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260 --login" returned: 0 in 0.131s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b8e371-b448-494e-b090-d522c11a925a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189, portal: 172.16.0.220,3260]
Nov 22 14:22:30 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189, portal: 172.16.0.220,3260] successful.
Nov 22 14:22:30 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbf582a-2eb7-4448-ad81-fb228544b3dd]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb47eae4-5b85-432a-aaa6-51eb90b79009]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 (non-flash)
Nov 22 14:22:30 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:30 user nova-compute[74776]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 (non-flash)
Nov 22 14:22:30 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.433s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] HCTL ('40', '-', '-', 0) found on session 24 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cbaada-34ad-450e-b2e2-a0e85ecf0a60]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Searching for a device in session 24 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:22:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TaMHeyJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:22:31 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.479s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:31 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] <== connect_volume: return (1482ms) {'type': 'block', 'scsi_wwn': '23831343363343962', 'path': '/dev/sdi'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:22:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831343363343962', 'path': '/dev/sdi'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:22:31 user nova-compute[74776]: DEBUG nova.objects.instance [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lazy-loading 'flavor' on Instance uuid 4246c1b7-6873-421a-ab2a-59dfb6adcb38 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:22:31 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:22:31 user nova-compute[74776]:   <source dev="/dev/sdi"/>
Nov 22 14:22:31 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:22:31 user nova-compute[74776]:   <serial>40726f1b-fbf2-4327-a6e1-7fda35aa7189</serial>
Nov 22 14:22:31 user nova-compute[74776]: </disk>
Nov 22 14:22:31 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:22:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:22:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:22:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] No VIF found with MAC fa:16:3e:85:36:3e, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:22:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e9f39b0b-4490-4376-9088-128cb1241907 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.044s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:34 user nova-compute[74776]: DEBUG nova.compute.manager [req-77fa0d12-313a-41d6-b829-50e2ec2ade4f req-b139dbe0-2274-43bf-b04d-83732db5fa28 service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Received event network-changed-f8b7835a-016f-47b2-beee-46b3cb6f3391 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:34 user nova-compute[74776]: DEBUG nova.compute.manager [req-77fa0d12-313a-41d6-b829-50e2ec2ade4f req-b139dbe0-2274-43bf-b04d-83732db5fa28 service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Refreshing instance network info cache due to event network-changed-f8b7835a-016f-47b2-beee-46b3cb6f3391. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:22:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-77fa0d12-313a-41d6-b829-50e2ec2ade4f req-b139dbe0-2274-43bf-b04d-83732db5fa28 service nova] Acquiring lock "refresh_cache-370f25d8-d6f4-4de8-b356-d23e6d599f82" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:22:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-77fa0d12-313a-41d6-b829-50e2ec2ade4f req-b139dbe0-2274-43bf-b04d-83732db5fa28 service nova] Acquired lock "refresh_cache-370f25d8-d6f4-4de8-b356-d23e6d599f82" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:22:34 user nova-compute[74776]: DEBUG nova.network.neutron [req-77fa0d12-313a-41d6-b829-50e2ec2ade4f req-b139dbe0-2274-43bf-b04d-83732db5fa28 service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Refreshing network info cache for port f8b7835a-016f-47b2-beee-46b3cb6f3391 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:22:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:34 user nova-compute[74776]: INFO nova.compute.manager [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Detaching volume 40726f1b-fbf2-4327-a6e1-7fda35aa7189
Nov 22 14:22:34 user nova-compute[74776]: INFO nova.virt.block_device [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Attempting to driver detach volume 40726f1b-fbf2-4327-a6e1-7fda35aa7189 from mountpoint /dev/vdb
Nov 22 14:22:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Attempting to detach device vdb from instance 4246c1b7-6873-421a-ab2a-59dfb6adcb38 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:22:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:22:34 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:22:34 user nova-compute[74776]:   <source dev="/dev/sdi"/>
Nov 22 14:22:34 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:22:34 user nova-compute[74776]:   <serial>40726f1b-fbf2-4327-a6e1-7fda35aa7189</serial>
Nov 22 14:22:34 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:22:34 user nova-compute[74776]: </disk>
Nov 22 14:22:34 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:22:35 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Successfully detached device vdb from instance 4246c1b7-6873-421a-ab2a-59dfb6adcb38 from the persistent domain config.
Nov 22 14:22:35 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4246c1b7-6873-421a-ab2a-59dfb6adcb38 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:22:35 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:22:35 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:22:35 user nova-compute[74776]:   <source dev="/dev/sdi"/>
Nov 22 14:22:35 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:22:35 user nova-compute[74776]:   <serial>40726f1b-fbf2-4327-a6e1-7fda35aa7189</serial>
Nov 22 14:22:35 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:22:35 user nova-compute[74776]: </disk>
Nov 22 14:22:35 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:22:35 user nova-compute[74776]: DEBUG nova.network.neutron [req-77fa0d12-313a-41d6-b829-50e2ec2ade4f req-b139dbe0-2274-43bf-b04d-83732db5fa28 service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Updated VIF entry in instance network info cache for port f8b7835a-016f-47b2-beee-46b3cb6f3391. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:22:35 user nova-compute[74776]: DEBUG nova.network.neutron [req-77fa0d12-313a-41d6-b829-50e2ec2ade4f req-b139dbe0-2274-43bf-b04d-83732db5fa28 service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Updating instance_info_cache with network_info: [{"id": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "address": "fa:16:3e:81:7b:fe", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b7835a-01", "ovs_interfaceid": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:22:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-77fa0d12-313a-41d6-b829-50e2ec2ade4f req-b139dbe0-2274-43bf-b04d-83732db5fa28 service nova] Releasing lock "refresh_cache-370f25d8-d6f4-4de8-b356-d23e6d599f82" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:22:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:35 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4246c1b7-6873-421a-ab2a-59dfb6adcb38 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:22:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "98fb9b54-c428-4a48-b1ff-a976f971b764" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:37 user nova-compute[74776]: INFO nova.compute.manager [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Detaching volume b1591527-945f-4c2c-ae44-f65709df6065
Nov 22 14:22:37 user nova-compute[74776]: INFO nova.virt.block_device [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Attempting to driver detach volume b1591527-945f-4c2c-ae44-f65709df6065 from mountpoint /dev/vdb
Nov 22 14:22:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Attempting to detach device vdb from instance 98fb9b54-c428-4a48-b1ff-a976f971b764 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:22:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:22:37 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:22:37 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 14:22:37 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:22:37 user nova-compute[74776]:   <serial>b1591527-945f-4c2c-ae44-f65709df6065</serial>
Nov 22 14:22:37 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:22:37 user nova-compute[74776]: </disk>
Nov 22 14:22:37 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:22:37 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Successfully detached device vdb from instance 98fb9b54-c428-4a48-b1ff-a976f971b764 from the persistent domain config.
Nov 22 14:22:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98fb9b54-c428-4a48-b1ff-a976f971b764 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:22:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:22:37 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:22:37 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 14:22:37 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:22:37 user nova-compute[74776]:   <serial>b1591527-945f-4c2c-ae44-f65709df6065</serial>
Nov 22 14:22:37 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:22:37 user nova-compute[74776]: </disk>
Nov 22 14:22:37 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:22:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98fb9b54-c428-4a48-b1ff-a976f971b764 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "370f25d8-d6f4-4de8-b356-d23e6d599f82" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG nova.objects.instance [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lazy-loading 'flavor' on Instance uuid 370f25d8-d6f4-4de8-b356-d23e6d599f82 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "370f25d8-d6f4-4de8-b356-d23e6d599f82" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:38 user nova-compute[74776]: INFO nova.compute.manager [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Attaching volume bb7fc68f-a55a-4023-9c33-e1e828447e8c to /dev/vdb
Nov 22 14:22:38 user nova-compute[74776]: DEBUG os_brick.utils [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6ef874-a850-49c1-a291-e248cb629045]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac4e931-a240-46bb-8aa7-7c08648378ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[940bbe94-9fa9-4a89-a2ed-6215b53865ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fbc02c-10af-4da7-8014-8a8d32aef67e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:22:38 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:22:38 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9779348-9aea-4fd6-89f2-f7e2962b2d38]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG os_brick.utils [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:22:38 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Updating existing volume attachment record: d07b2b61-1450-4800-b786-913d43c1c3ea {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:22:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJtBOyPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:22:45 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:45 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:45 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e78e1e9-2b51-4ac1-b18b-568872f57925]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:22:45 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed82cd4-0d3e-4076-8149-512ae6f56dba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c] added
Nov 22 14:22:45 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36f8a01-1726-4eae-b9e6-cba176b5f34a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddae5b18-3dbf-4270-9eb7-f13307ecf3b8]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CJtBOyPV {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CJtBOyPV" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[761927f0-4dc5-4429-bcdc-7f938a8291f4]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CJtBOyPV'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[79906a74-b6fe-4c8e-8d32-85d8bf60c85b]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e905b6-3ab8-4a1c-9dab-7dc466e21226]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 (non-flash)
Nov 22 14:22:45 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 (non-flash)
Nov 22 14:22:45 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[14891ec4-95c1-42d5-ae7d-ba7765f9b26a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c, portal: 172.16.0.220,3260]
Nov 22 14:22:45 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c, portal: 172.16.0.220,3260] successful.
Nov 22 14:22:45 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[183d3ec6-fa5b-4a7c-9b5f-309fe905c387]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7cc29b-40de-4fd1-b9d0-f81de1949017]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:22:45 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 (non-flash)
Nov 22 14:22:45 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:22:45 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] HCTL ('41', '-', '-', 0) found on session 25 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbf1c7a-1c58-4551-8272-63db7b1eca62]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Searching for a device in session 25 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:22:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJtBOyPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:22:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26339373763373164', 'path': '/dev/sdj'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:22:46 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339373763373164', 'path': '/dev/sdj'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:22:46 user nova-compute[74776]: DEBUG nova.objects.instance [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lazy-loading 'flavor' on Instance uuid 370f25d8-d6f4-4de8-b356-d23e6d599f82 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:46 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:22:46 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:22:46 user nova-compute[74776]:   <source dev="/dev/sdj"/>
Nov 22 14:22:46 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:22:46 user nova-compute[74776]:   <serial>bb7fc68f-a55a-4023-9c33-e1e828447e8c</serial>
Nov 22 14:22:46 user nova-compute[74776]: </disk>
Nov 22 14:22:46 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:22:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:22:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:22:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] No VIF found with MAC fa:16:3e:81:7b:fe, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:22:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2a45b2d4-3164-4ccd-8df5-0e41dd93352b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.829s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "4a1cf058-5290-4d09-a979-89de319f2cbd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "4a1cf058-5290-4d09-a979-89de319f2cbd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:51 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:22:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:22:51 user nova-compute[74776]: INFO nova.compute.claims [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Claim successful on node user
Nov 22 14:22:51 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:22:51 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:22:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:51 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:22:51 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:22:51 user nova-compute[74776]: DEBUG nova.network.neutron [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:22:51 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:22:51 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:22:51 user nova-compute[74776]: DEBUG nova.policy [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1807bb240de749499809fd3dfb520d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee58d331979425eb9d48d2a52fc1f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:22:51 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:22:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:22:51 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Creating image(s)
Nov 22 14:22:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "/opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "/opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.179s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd/disk 1073741824" returned: 0 in 0.047s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:52 user nova-compute[74776]: DEBUG nova.network.neutron [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Successfully created port: e645f3db-3d2b-4694-93fe-64eb13e39926 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:22:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:52 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:22:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:52 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Cannot resize image /opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:22:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:22:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Ensure instance console log exists: /opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:22:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.network.neutron [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Successfully updated port: e645f3db-3d2b-4694-93fe-64eb13e39926 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "refresh_cache-4a1cf058-5290-4d09-a979-89de319f2cbd" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquired lock "refresh_cache-4a1cf058-5290-4d09-a979-89de319f2cbd" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.network.neutron [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-499e6144-2c84-4e34-81db-0ec731f143d6 req-103c3176-c4a5-42cb-b404-d68d8cecfa91 service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Received event network-changed-e645f3db-3d2b-4694-93fe-64eb13e39926 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-499e6144-2c84-4e34-81db-0ec731f143d6 req-103c3176-c4a5-42cb-b404-d68d8cecfa91 service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Refreshing instance network info cache due to event network-changed-e645f3db-3d2b-4694-93fe-64eb13e39926. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-499e6144-2c84-4e34-81db-0ec731f143d6 req-103c3176-c4a5-42cb-b404-d68d8cecfa91 service nova] Acquiring lock "refresh_cache-4a1cf058-5290-4d09-a979-89de319f2cbd" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.network.neutron [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.network.neutron [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Updating instance_info_cache with network_info: [{"id": "e645f3db-3d2b-4694-93fe-64eb13e39926", "address": "fa:16:3e:8a:72:fd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape645f3db-3d", "ovs_interfaceid": "e645f3db-3d2b-4694-93fe-64eb13e39926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Releasing lock "refresh_cache-4a1cf058-5290-4d09-a979-89de319f2cbd" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Instance network_info: |[{"id": "e645f3db-3d2b-4694-93fe-64eb13e39926", "address": "fa:16:3e:8a:72:fd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape645f3db-3d", "ovs_interfaceid": "e645f3db-3d2b-4694-93fe-64eb13e39926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-499e6144-2c84-4e34-81db-0ec731f143d6 req-103c3176-c4a5-42cb-b404-d68d8cecfa91 service nova] Acquired lock "refresh_cache-4a1cf058-5290-4d09-a979-89de319f2cbd" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.network.neutron [req-499e6144-2c84-4e34-81db-0ec731f143d6 req-103c3176-c4a5-42cb-b404-d68d8cecfa91 service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Refreshing network info cache for port e645f3db-3d2b-4694-93fe-64eb13e39926 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Start _get_guest_xml network_info=[{"id": "e645f3db-3d2b-4694-93fe-64eb13e39926", "address": "fa:16:3e:8a:72:fd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape645f3db-3d", "ovs_interfaceid": "e645f3db-3d2b-4694-93fe-64eb13e39926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:22:53 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:22:53 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:22:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2091847464',display_name='tempest-AttachVolumeNegativeTest-server-2091847464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2091847464',id=20,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfoV6u6Ihf+5e5JMy/FPSptBn7v5+Vu50sH5XP8VSwk1h7V6dQjLbBiq/wo2Lw3ezAxTaixxGyu+lNbsf4JM9afvB/6kTdrpWMHmVZZDgvJbiIaO/glkPibth9htx2lVA==',key_name='tempest-keypair-1955073636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dee58d331979425eb9d48d2a52fc1f68',ramdisk_id='',reservation_id='r-x32l9whb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-577275639',owner_user_name='tempest-AttachVolumeNegativeTest-577275639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:22:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1807bb240de749499809fd3dfb520d78',uuid=4a1cf058-5290-4d09-a979-89de319f2cbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e645f3db-3d2b-4694-93fe-64eb13e39926", "address": "fa:16:3e:8a:72:fd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape645f3db-3d", "ovs_interfaceid": "e645f3db-3d2b-4694-93fe-64eb13e39926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converting VIF {"id": "e645f3db-3d2b-4694-93fe-64eb13e39926", "address": "fa:16:3e:8a:72:fd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape645f3db-3d", "ovs_interfaceid": "e645f3db-3d2b-4694-93fe-64eb13e39926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:72:fd,bridge_name='br-int',has_traffic_filtering=True,id=e645f3db-3d2b-4694-93fe-64eb13e39926,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape645f3db-3d') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.objects.instance [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a1cf058-5290-4d09-a979-89de319f2cbd {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:22:53 user nova-compute[74776]:   <uuid>4a1cf058-5290-4d09-a979-89de319f2cbd</uuid>
Nov 22 14:22:53 user nova-compute[74776]:   <name>instance-00000014</name>
Nov 22 14:22:53 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:22:53 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:22:53 user nova-compute[74776]:   <metadata>
Nov 22 14:22:53 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:22:53 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:22:53 user nova-compute[74776]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2091847464</nova:name>
Nov 22 14:22:53 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:22:53</nova:creationTime>
Nov 22 14:22:53 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:22:53 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:22:53 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:22:53 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:22:53 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:22:53 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:22:53 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:22:53 user nova-compute[74776]:       <nova:owner>
Nov 22 14:22:53 user nova-compute[74776]:         <nova:user uuid="1807bb240de749499809fd3dfb520d78">tempest-AttachVolumeNegativeTest-577275639-project-member</nova:user>
Nov 22 14:22:53 user nova-compute[74776]:         <nova:project uuid="dee58d331979425eb9d48d2a52fc1f68">tempest-AttachVolumeNegativeTest-577275639</nova:project>
Nov 22 14:22:53 user nova-compute[74776]:       </nova:owner>
Nov 22 14:22:53 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:22:53 user nova-compute[74776]:       <nova:ports>
Nov 22 14:22:53 user nova-compute[74776]:         <nova:port uuid="e645f3db-3d2b-4694-93fe-64eb13e39926">
Nov 22 14:22:53 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 22 14:22:53 user nova-compute[74776]:         </nova:port>
Nov 22 14:22:53 user nova-compute[74776]:       </nova:ports>
Nov 22 14:22:53 user nova-compute[74776]:     </nova:instance>
Nov 22 14:22:53 user nova-compute[74776]:   </metadata>
Nov 22 14:22:53 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:22:53 user nova-compute[74776]:     <system>
Nov 22 14:22:53 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:22:53 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:22:53 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:22:53 user nova-compute[74776]:       <entry name="serial">4a1cf058-5290-4d09-a979-89de319f2cbd</entry>
Nov 22 14:22:53 user nova-compute[74776]:       <entry name="uuid">4a1cf058-5290-4d09-a979-89de319f2cbd</entry>
Nov 22 14:22:53 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:22:53 user nova-compute[74776]:     </system>
Nov 22 14:22:53 user nova-compute[74776]:   </sysinfo>
Nov 22 14:22:53 user nova-compute[74776]:   <os>
Nov 22 14:22:53 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:22:53 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:22:53 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:22:53 user nova-compute[74776]:   </os>
Nov 22 14:22:53 user nova-compute[74776]:   <features>
Nov 22 14:22:53 user nova-compute[74776]:     <acpi/>
Nov 22 14:22:53 user nova-compute[74776]:     <apic/>
Nov 22 14:22:53 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:22:53 user nova-compute[74776]:   </features>
Nov 22 14:22:53 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:22:53 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:22:53 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:22:53 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:22:53 user nova-compute[74776]:   </clock>
Nov 22 14:22:53 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:22:53 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:22:53 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:22:53 user nova-compute[74776]:   </cpu>
Nov 22 14:22:53 user nova-compute[74776]:   <devices>
Nov 22 14:22:53 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:22:53 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:22:53 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd/disk"/>
Nov 22 14:22:53 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:22:53 user nova-compute[74776]:     </disk>
Nov 22 14:22:53 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:22:53 user nova-compute[74776]:       <mac address="fa:16:3e:8a:72:fd"/>
Nov 22 14:22:53 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:22:53 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:22:53 user nova-compute[74776]:       <target dev="tape645f3db-3d"/>
Nov 22 14:22:53 user nova-compute[74776]:     </interface>
Nov 22 14:22:53 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:22:53 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd/console.log" append="off"/>
Nov 22 14:22:53 user nova-compute[74776]:     </serial>
Nov 22 14:22:53 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:22:53 user nova-compute[74776]:     <video>
Nov 22 14:22:53 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:22:53 user nova-compute[74776]:     </video>
Nov 22 14:22:53 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:22:53 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:22:53 user nova-compute[74776]:     </rng>
Nov 22 14:22:53 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:22:53 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:22:53 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:22:53 user nova-compute[74776]:     </memballoon>
Nov 22 14:22:53 user nova-compute[74776]:   </devices>
Nov 22 14:22:53 user nova-compute[74776]: </domain>
Nov 22 14:22:53 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:22:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2091847464',display_name='tempest-AttachVolumeNegativeTest-server-2091847464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2091847464',id=20,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfoV6u6Ihf+5e5JMy/FPSptBn7v5+Vu50sH5XP8VSwk1h7V6dQjLbBiq/wo2Lw3ezAxTaixxGyu+lNbsf4JM9afvB/6kTdrpWMHmVZZDgvJbiIaO/glkPibth9htx2lVA==',key_name='tempest-keypair-1955073636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dee58d331979425eb9d48d2a52fc1f68',ramdisk_id='',reservation_id='r-x32l9whb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-577275639',owner_user_name='tempest-AttachVolumeNegativeTest-577275639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:22:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1807bb240de749499809fd3dfb520d78',uuid=4a1cf058-5290-4d09-a979-89de319f2cbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e645f3db-3d2b-4694-93fe-64eb13e39926", "address": "fa:16:3e:8a:72:fd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape645f3db-3d", "ovs_interfaceid": "e645f3db-3d2b-4694-93fe-64eb13e39926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converting VIF {"id": "e645f3db-3d2b-4694-93fe-64eb13e39926", "address": "fa:16:3e:8a:72:fd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape645f3db-3d", "ovs_interfaceid": "e645f3db-3d2b-4694-93fe-64eb13e39926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:72:fd,bridge_name='br-int',has_traffic_filtering=True,id=e645f3db-3d2b-4694-93fe-64eb13e39926,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape645f3db-3d') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG os_vif [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:72:fd,bridge_name='br-int',has_traffic_filtering=True,id=e645f3db-3d2b-4694-93fe-64eb13e39926,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape645f3db-3d') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '24e19168-9ed1-5f24-ab3d-3ab3a9ce1564', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape645f3db-3d, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape645f3db-3d, col_values=(('qos', UUID('beb6ecdd-2e5d-46d7-ab65-71e1f03e5b27')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape645f3db-3d, col_values=(('external_ids', {'iface-id': 'e645f3db-3d2b-4694-93fe-64eb13e39926', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:72:fd', 'vm-uuid': '4a1cf058-5290-4d09-a979-89de319f2cbd'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:53 user nova-compute[74776]: INFO os_vif [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:72:fd,bridge_name='br-int',has_traffic_filtering=True,id=e645f3db-3d2b-4694-93fe-64eb13e39926,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape645f3db-3d')
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] No VIF found with MAC fa:16:3e:8a:72:fd, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.network.neutron [req-499e6144-2c84-4e34-81db-0ec731f143d6 req-103c3176-c4a5-42cb-b404-d68d8cecfa91 service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Updated VIF entry in instance network info cache for port e645f3db-3d2b-4694-93fe-64eb13e39926. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG nova.network.neutron [req-499e6144-2c84-4e34-81db-0ec731f143d6 req-103c3176-c4a5-42cb-b404-d68d8cecfa91 service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Updating instance_info_cache with network_info: [{"id": "e645f3db-3d2b-4694-93fe-64eb13e39926", "address": "fa:16:3e:8a:72:fd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape645f3db-3d", "ovs_interfaceid": "e645f3db-3d2b-4694-93fe-64eb13e39926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:22:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-499e6144-2c84-4e34-81db-0ec731f143d6 req-103c3176-c4a5-42cb-b404-d68d8cecfa91 service nova] Releasing lock "refresh_cache-4a1cf058-5290-4d09-a979-89de319f2cbd" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:22:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG nova.compute.manager [req-f4bfd82d-0974-49f4-b540-b68ddfc7b40e req-272cef08-d87d-4b7e-b923-666d2b5bd39e service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Received event network-vif-plugged-e645f3db-3d2b-4694-93fe-64eb13e39926 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f4bfd82d-0974-49f4-b540-b68ddfc7b40e req-272cef08-d87d-4b7e-b923-666d2b5bd39e service nova] Acquiring lock "4a1cf058-5290-4d09-a979-89de319f2cbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f4bfd82d-0974-49f4-b540-b68ddfc7b40e req-272cef08-d87d-4b7e-b923-666d2b5bd39e service nova] Lock "4a1cf058-5290-4d09-a979-89de319f2cbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f4bfd82d-0974-49f4-b540-b68ddfc7b40e req-272cef08-d87d-4b7e-b923-666d2b5bd39e service nova] Lock "4a1cf058-5290-4d09-a979-89de319f2cbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG nova.compute.manager [req-f4bfd82d-0974-49f4-b540-b68ddfc7b40e req-272cef08-d87d-4b7e-b923-666d2b5bd39e service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] No waiting events found dispatching network-vif-plugged-e645f3db-3d2b-4694-93fe-64eb13e39926 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:55 user nova-compute[74776]: WARNING nova.compute.manager [req-f4bfd82d-0974-49f4-b540-b68ddfc7b40e req-272cef08-d87d-4b7e-b923-666d2b5bd39e service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Received unexpected event network-vif-plugged-e645f3db-3d2b-4694-93fe-64eb13e39926 for instance with vm_state building and task_state spawning.
Nov 22 14:22:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:55 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4246c1b7-6873-421a-ab2a-59dfb6adcb38 is timed out.
Nov 22 14:22:55 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Successfully detached device vdb from instance 4246c1b7-6873-421a-ab2a-59dfb6adcb38 from the live domain config.
Nov 22 14:22:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TaMHeyJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:22:55 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:22:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1681803-0869-4312-8a3d-4ed26407ef75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:22:55 user nova-compute[74776]: No targets found.
Nov 22 14:22:55 user nova-compute[74776]: iSNS:
Nov 22 14:22:55 user nova-compute[74776]: No targets found.
Nov 22 14:22:55 user nova-compute[74776]: STATIC:
Nov 22 14:22:55 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189
Nov 22 14:22:55 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:55 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:55 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848
Nov 22 14:22:55 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:55 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:55 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a
Nov 22 14:22:55 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:55 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:55 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3
Nov 22 14:22:55 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:55 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:55 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c
Nov 22 14:22:55 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:55 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:55 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f
Nov 22 14:22:55 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:55 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:55 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3
Nov 22 14:22:55 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:55 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:55 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065
Nov 22 14:22:55 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:55 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:55 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f
Nov 22 14:22:55 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:55 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:55 user nova-compute[74776]: FIRMWARE:
Nov 22 14:22:55 user nova-compute[74776]: No targets found.
Nov 22 14:22:55 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:22:55 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:22:55 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a1c284-6aad-451c-b4ec-cb0c4b4a65cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a733dd5c-b19d-4705-ab53-dd8de8120f93]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:55 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:55 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:55 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:55 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:55 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:55 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:55 user nova-compute[74776]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 (non-flash)
Nov 22 14:22:55 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:22:55 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:55 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:55 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:55 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:55 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:55 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:55 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:55 user nova-compute[74776]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 (non-flash)
Nov 22 14:22:55 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:22:55 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c5815f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189'): ({'sdi'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Removing single pathed devices sdi {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8130130e-a621-4763-a1a1-043ce9eddcea]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f571d18-5a2f-43da-917b-d9e6a9be916e]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Flushing IO for device /dev/sdi {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[582f66fc-fb61-4039-ab35-2e5e31072308]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.045s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e730de-2a98-43ea-9c9b-127bb10ce55c]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] SCSI volumes sdi have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3153a345-25cf-4ebb-ac4c-813fc2f4d5f8]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bd1c8b-d928-414f-b6a8-c6aae2f261b7]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189, portal: 172.16.0.220,3260]
Nov 22 14:22:55 user nova-compute[74776]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189, portal: 172.16.0.220,3260] successful.
Nov 22 14:22:55 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40726f1b-fbf2-4327-a6e1-7fda35aa7189 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7e2ab3-d82e-4a2f-8b53-aef35838214c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] <== disconnect_volume: return (353ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:22:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:22:56 user nova-compute[74776]: DEBUG nova.objects.instance [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lazy-loading 'flavor' on Instance uuid 4246c1b7-6873-421a-ab2a-59dfb6adcb38 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-20bde688-7da2-4ab7-bcbd-be9ae965ac86 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.961s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:57 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:22:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:22:57 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Instance spawned successfully.
Nov 22 14:22:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:22:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:22:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:22:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:22:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:22:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:22:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:22:57 user nova-compute[74776]: DEBUG nova.compute.manager [req-342aebf2-7400-427b-89df-0623d7c94ccf req-a6d9ee9e-aa77-4262-9616-4b488ad837c4 service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Received event network-vif-plugged-e645f3db-3d2b-4694-93fe-64eb13e39926 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-342aebf2-7400-427b-89df-0623d7c94ccf req-a6d9ee9e-aa77-4262-9616-4b488ad837c4 service nova] Acquiring lock "4a1cf058-5290-4d09-a979-89de319f2cbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-342aebf2-7400-427b-89df-0623d7c94ccf req-a6d9ee9e-aa77-4262-9616-4b488ad837c4 service nova] Lock "4a1cf058-5290-4d09-a979-89de319f2cbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-342aebf2-7400-427b-89df-0623d7c94ccf req-a6d9ee9e-aa77-4262-9616-4b488ad837c4 service nova] Lock "4a1cf058-5290-4d09-a979-89de319f2cbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:57 user nova-compute[74776]: DEBUG nova.compute.manager [req-342aebf2-7400-427b-89df-0623d7c94ccf req-a6d9ee9e-aa77-4262-9616-4b488ad837c4 service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] No waiting events found dispatching network-vif-plugged-e645f3db-3d2b-4694-93fe-64eb13e39926 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:57 user nova-compute[74776]: WARNING nova.compute.manager [req-342aebf2-7400-427b-89df-0623d7c94ccf req-a6d9ee9e-aa77-4262-9616-4b488ad837c4 service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Received unexpected event network-vif-plugged-e645f3db-3d2b-4694-93fe-64eb13e39926 for instance with vm_state building and task_state spawning.
Nov 22 14:22:57 user nova-compute[74776]: INFO nova.compute.manager [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 22 14:22:57 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:22:57 user nova-compute[74776]: INFO nova.compute.manager [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Took 6.18 seconds to build instance.
Nov 22 14:22:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3d9123a2-8a64-477e-83c0-b23e589aa18f tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "4a1cf058-5290-4d09-a979-89de319f2cbd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.274s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquiring lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquiring lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:58 user nova-compute[74776]: INFO nova.compute.manager [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Terminating instance
Nov 22 14:22:58 user nova-compute[74776]: DEBUG nova.compute.manager [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:58 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 98fb9b54-c428-4a48-b1ff-a976f971b764 is timed out.
Nov 22 14:22:58 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Successfully detached device vdb from instance 98fb9b54-c428-4a48-b1ff-a976f971b764 from the live domain config.
Nov 22 14:22:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qQPSRHFt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:22:58 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:22:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d92b6f-f093-4588-ba14-a752cd9046be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:22:58 user nova-compute[74776]: No targets found.
Nov 22 14:22:58 user nova-compute[74776]: iSNS:
Nov 22 14:22:58 user nova-compute[74776]: No targets found.
Nov 22 14:22:58 user nova-compute[74776]: STATIC:
Nov 22 14:22:58 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848
Nov 22 14:22:58 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:58 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:58 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a
Nov 22 14:22:58 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:58 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:58 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3
Nov 22 14:22:58 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:58 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:58 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c
Nov 22 14:22:58 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:58 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:58 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f
Nov 22 14:22:58 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:58 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:58 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3
Nov 22 14:22:58 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:58 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:58 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065
Nov 22 14:22:58 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:58 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:58 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f
Nov 22 14:22:58 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:22:58 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:22:58 user nova-compute[74776]: FIRMWARE:
Nov 22 14:22:58 user nova-compute[74776]: No targets found.
Nov 22 14:22:58 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:22:58 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:22:58 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96795e7-49a9-4fc5-ac7b-44b6f4ccae94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e9b36f-8f5a-4c09-b3dc-10a666c12062]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:58 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:58 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:58 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:58 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:58 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:58 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:58 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:22:58 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 (non-flash)
Nov 22 14:22:58 user nova-compute[74776]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:22:58 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:22:58 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:22:58 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:22:58 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:22:58 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:22:58 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:22:58 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c582f0550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065'): ({'sdb'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Removing single pathed devices sdb {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfdb65c-75e7-4c19-bb0d-cdac9c9c2b75]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cc9822-276f-40fc-a9b3-0545f4a53e10]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Flushing IO for device /dev/sdb {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f10122f-dc01-4d69-a5cd-688a2d47e4de]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[482c0487-e22c-4d78-b49e-55e256f1a2f6]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8778602-4014-4b75-bc06-bec9d25050dc]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[641a1ae4-645b-4a01-bbc0-a06440d9ad75]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065, portal: 172.16.0.220,3260]
Nov 22 14:22:58 user nova-compute[74776]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065, portal: 172.16.0.220,3260] successful.
Nov 22 14:22:58 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1591527-945f-4c2c-ae44-f65709df6065 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9899d66-f289-47f6-b78f-7bde11abecdc]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] <== disconnect_volume: return (400ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:22:58 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Instance destroyed successfully.
Nov 22 14:22:58 user nova-compute[74776]: DEBUG nova.objects.instance [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lazy-loading 'resources' on Instance uuid 6dcf355f-759d-4a9a-9fb6-394e242c03e4 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:19:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1295290313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1295290313',id=12,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOi2wt6bwWC52YfMKFz0ZOdIihoSozV9972X7DtLjMCaPcI7UTCrW5QcIACFjc56Pj6b7cRSH9i47OvgkdTcAES+2IVEx2e8rM0Q9iF4eOSwA6MrKwoAcVhYd6C5lAkb1w==',key_name='tempest-keypair-973400344',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:19:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='027310982a0047d9a0d06c29b5b6e1f2',ramdisk_id='',reservation_id='r-n0ic6hqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2066916431',owner_user_name='tempest-TaggedAttachmentsTest-2066916431-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:19:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d173b822df3448bb49245f30afc0e17',uuid=6dcf355f-759d-4a9a-9fb6-394e242c03e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "address": "fa:16:3e:0f:a0:64", "network": {"id": "2fd2ca6a-6401-4865-99d6-647854bec84d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1799040535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13f9065-d7", "ovs_interfaceid": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Converting VIF {"id": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "address": "fa:16:3e:0f:a0:64", "network": {"id": "2fd2ca6a-6401-4865-99d6-647854bec84d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1799040535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "027310982a0047d9a0d06c29b5b6e1f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd13f9065-d7", "ovs_interfaceid": "d13f9065-d7f3-4274-929f-3ac85db8bf73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:a0:64,bridge_name='br-int',has_traffic_filtering=True,id=d13f9065-d7f3-4274-929f-3ac85db8bf73,network=Network(2fd2ca6a-6401-4865-99d6-647854bec84d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13f9065-d7') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG os_vif [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:a0:64,bridge_name='br-int',has_traffic_filtering=True,id=d13f9065-d7f3-4274-929f-3ac85db8bf73,network=Network(2fd2ca6a-6401-4865-99d6-647854bec84d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13f9065-d7') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd13f9065-d7, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a69df3b-2ec8-474d-8e07-bdddc9adb906) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:22:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:22:58 user nova-compute[74776]: INFO os_vif [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:a0:64,bridge_name='br-int',has_traffic_filtering=True,id=d13f9065-d7f3-4274-929f-3ac85db8bf73,network=Network(2fd2ca6a-6401-4865-99d6-647854bec84d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd13f9065-d7')
Nov 22 14:22:58 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Deleting instance files /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4_del
Nov 22 14:22:58 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Deletion of /opt/stack/data/nova/instances/6dcf355f-759d-4a9a-9fb6-394e242c03e4_del complete
Nov 22 14:22:59 user nova-compute[74776]: INFO nova.compute.manager [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 22 14:22:59 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:22:59 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:22:59 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:22:59 user nova-compute[74776]: DEBUG nova.compute.manager [req-1da814bd-5c65-42b0-98ec-2e92f28de7d8 req-eb384bb8-ef96-469d-b527-d54dc1ca33cc service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Received event network-vif-unplugged-d13f9065-d7f3-4274-929f-3ac85db8bf73 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1da814bd-5c65-42b0-98ec-2e92f28de7d8 req-eb384bb8-ef96-469d-b527-d54dc1ca33cc service nova] Acquiring lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1da814bd-5c65-42b0-98ec-2e92f28de7d8 req-eb384bb8-ef96-469d-b527-d54dc1ca33cc service nova] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1da814bd-5c65-42b0-98ec-2e92f28de7d8 req-eb384bb8-ef96-469d-b527-d54dc1ca33cc service nova] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:59 user nova-compute[74776]: DEBUG nova.compute.manager [req-1da814bd-5c65-42b0-98ec-2e92f28de7d8 req-eb384bb8-ef96-469d-b527-d54dc1ca33cc service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] No waiting events found dispatching network-vif-unplugged-d13f9065-d7f3-4274-929f-3ac85db8bf73 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:59 user nova-compute[74776]: DEBUG nova.compute.manager [req-1da814bd-5c65-42b0-98ec-2e92f28de7d8 req-eb384bb8-ef96-469d-b527-d54dc1ca33cc service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Received event network-vif-unplugged-d13f9065-d7f3-4274-929f-3ac85db8bf73 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:22:59 user nova-compute[74776]: DEBUG nova.compute.manager [req-1da814bd-5c65-42b0-98ec-2e92f28de7d8 req-eb384bb8-ef96-469d-b527-d54dc1ca33cc service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Received event network-vif-plugged-d13f9065-d7f3-4274-929f-3ac85db8bf73 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:22:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1da814bd-5c65-42b0-98ec-2e92f28de7d8 req-eb384bb8-ef96-469d-b527-d54dc1ca33cc service nova] Acquiring lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:22:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1da814bd-5c65-42b0-98ec-2e92f28de7d8 req-eb384bb8-ef96-469d-b527-d54dc1ca33cc service nova] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:22:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1da814bd-5c65-42b0-98ec-2e92f28de7d8 req-eb384bb8-ef96-469d-b527-d54dc1ca33cc service nova] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:59 user nova-compute[74776]: DEBUG nova.compute.manager [req-1da814bd-5c65-42b0-98ec-2e92f28de7d8 req-eb384bb8-ef96-469d-b527-d54dc1ca33cc service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] No waiting events found dispatching network-vif-plugged-d13f9065-d7f3-4274-929f-3ac85db8bf73 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:22:59 user nova-compute[74776]: WARNING nova.compute.manager [req-1da814bd-5c65-42b0-98ec-2e92f28de7d8 req-eb384bb8-ef96-469d-b527-d54dc1ca33cc service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Received unexpected event network-vif-plugged-d13f9065-d7f3-4274-929f-3ac85db8bf73 for instance with vm_state active and task_state deleting.
Nov 22 14:22:59 user nova-compute[74776]: DEBUG nova.objects.instance [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lazy-loading 'flavor' on Instance uuid 98fb9b54-c428-4a48-b1ff-a976f971b764 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:22:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-aeb1b083-63df-4434-b434-8af41bb71fca tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.844s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:22:59 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:22:59 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Took 0.74 seconds to deallocate network for instance.
Nov 22 14:23:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:00 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:23:00 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:23:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:00 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Deleted allocations for instance 6dcf355f-759d-4a9a-9fb6-394e242c03e4
Nov 22 14:23:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b8bb2fbd-37d1-4a5c-a843-0926816c1c49 tempest-TaggedAttachmentsTest-2066916431 tempest-TaggedAttachmentsTest-2066916431-project-member] Lock "6dcf355f-759d-4a9a-9fb6-394e242c03e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.407s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:01 user nova-compute[74776]: DEBUG nova.compute.manager [req-434a4931-3cd5-445a-b3ab-e712373bd7d8 req-0d1d1743-bc40-4cd5-920c-f414a8b498b0 service nova] [instance: 6dcf355f-759d-4a9a-9fb6-394e242c03e4] Received event network-vif-deleted-d13f9065-d7f3-4274-929f-3ac85db8bf73 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-10173686-5801-4694-9604-3d86e0729113 req-97cee592-bdfc-43d3-9c6d-c7351b6566f5 service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Received event network-changed-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-10173686-5801-4694-9604-3d86e0729113 req-97cee592-bdfc-43d3-9c6d-c7351b6566f5 service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Refreshing instance network info cache due to event network-changed-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:23:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-10173686-5801-4694-9604-3d86e0729113 req-97cee592-bdfc-43d3-9c6d-c7351b6566f5 service nova] Acquiring lock "refresh_cache-97fa95f1-f856-4b65-917f-9808bac6e576" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:23:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-10173686-5801-4694-9604-3d86e0729113 req-97cee592-bdfc-43d3-9c6d-c7351b6566f5 service nova] Acquired lock "refresh_cache-97fa95f1-f856-4b65-917f-9808bac6e576" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:23:02 user nova-compute[74776]: DEBUG nova.network.neutron [req-10173686-5801-4694-9604-3d86e0729113 req-97cee592-bdfc-43d3-9c6d-c7351b6566f5 service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Refreshing network info cache for port 2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:23:03 user nova-compute[74776]: DEBUG nova.network.neutron [req-10173686-5801-4694-9604-3d86e0729113 req-97cee592-bdfc-43d3-9c6d-c7351b6566f5 service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Updated VIF entry in instance network info cache for port 2ce1e50d-19f9-474c-9f47-2dc4eca12fb4. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:23:03 user nova-compute[74776]: DEBUG nova.network.neutron [req-10173686-5801-4694-9604-3d86e0729113 req-97cee592-bdfc-43d3-9c6d-c7351b6566f5 service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Updating instance_info_cache with network_info: [{"id": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "address": "fa:16:3e:30:f8:d1", "network": {"id": "f55f24e7-af68-4a8b-af50-ff18023189dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717554397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722073efd41d4ff2a3354a6dd1f6093a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1e50d-19", "ovs_interfaceid": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:23:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-10173686-5801-4694-9604-3d86e0729113 req-97cee592-bdfc-43d3-9c6d-c7351b6566f5 service nova] Releasing lock "refresh_cache-97fa95f1-f856-4b65-917f-9808bac6e576" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:23:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:04 user nova-compute[74776]: INFO nova.compute.manager [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Rebuilding instance
Nov 22 14:23:04 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG nova.compute.manager [req-969accac-a3e6-4577-8c99-f8c936e253ee req-64b432f4-1877-4e64-8c4a-6377145c82bc service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Received event network-vif-unplugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-969accac-a3e6-4577-8c99-f8c936e253ee req-64b432f4-1877-4e64-8c4a-6377145c82bc service nova] Acquiring lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-969accac-a3e6-4577-8c99-f8c936e253ee req-64b432f4-1877-4e64-8c4a-6377145c82bc service nova] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-969accac-a3e6-4577-8c99-f8c936e253ee req-64b432f4-1877-4e64-8c4a-6377145c82bc service nova] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG nova.compute.manager [req-969accac-a3e6-4577-8c99-f8c936e253ee req-64b432f4-1877-4e64-8c4a-6377145c82bc service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] No waiting events found dispatching network-vif-unplugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:04 user nova-compute[74776]: WARNING nova.compute.manager [req-969accac-a3e6-4577-8c99-f8c936e253ee req-64b432f4-1877-4e64-8c4a-6377145c82bc service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Received unexpected event network-vif-unplugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 for instance with vm_state active and task_state rebuilding.
Nov 22 14:23:04 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Instance destroyed successfully.
Nov 22 14:23:04 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Instance destroyed successfully.
Nov 22 14:23:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1117334062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-701035597',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYkU/2rQfSqsHtxK4fuxV+C9ojLZCEgNPlys0mLUFyCMchJcZzHAHb+3FUbvc2xdk3gHibee1w4iVYXBMvTV3V9mrEhNV3Yx2m3WYA430lr+k5smV5pmrxj35fa4s3h8g==',key_name='tempest-keypair-1544757416',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:21:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='722073efd41d4ff2a3354a6dd1f6093a',ramdisk_id='',reservation_id='r-4zg0peg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1866761054',owner_user_name='tempest-ServerActionsV293TestJSON-1866761054-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:23:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9bb1ba0806f4157873e2ef88d7c832f',uuid=97fa95f1-f856-4b65-917f-9808bac6e576,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "address": "fa:16:3e:30:f8:d1", "network": {"id": "f55f24e7-af68-4a8b-af50-ff18023189dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717554397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722073efd41d4ff2a3354a6dd1f6093a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1e50d-19", "ovs_interfaceid": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Converting VIF {"id": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "address": "fa:16:3e:30:f8:d1", "network": {"id": "f55f24e7-af68-4a8b-af50-ff18023189dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717554397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722073efd41d4ff2a3354a6dd1f6093a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1e50d-19", "ovs_interfaceid": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:f8:d1,bridge_name='br-int',has_traffic_filtering=True,id=2ce1e50d-19f9-474c-9f47-2dc4eca12fb4,network=Network(f55f24e7-af68-4a8b-af50-ff18023189dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1e50d-19') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG os_vif [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:f8:d1,bridge_name='br-int',has_traffic_filtering=True,id=2ce1e50d-19f9-474c-9f47-2dc4eca12fb4,network=Network(f55f24e7-af68-4a8b-af50-ff18023189dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1e50d-19') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ce1e50d-19, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=579eb7c4-a1f1-44cd-808e-ca1515b6121d) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:23:04 user nova-compute[74776]: INFO os_vif [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:f8:d1,bridge_name='br-int',has_traffic_filtering=True,id=2ce1e50d-19f9-474c-9f47-2dc4eca12fb4,network=Network(f55f24e7-af68-4a8b-af50-ff18023189dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1e50d-19')
Nov 22 14:23:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uoiazveY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:23:04 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 14:23:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[039e9555-8f72-4fef-970c-1a0eeb46382d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:23:04 user nova-compute[74776]: No targets found.
Nov 22 14:23:04 user nova-compute[74776]: iSNS:
Nov 22 14:23:04 user nova-compute[74776]: No targets found.
Nov 22 14:23:04 user nova-compute[74776]: STATIC:
Nov 22 14:23:04 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848
Nov 22 14:23:04 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:04 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:04 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a
Nov 22 14:23:04 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:04 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:04 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3
Nov 22 14:23:04 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:04 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:04 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c
Nov 22 14:23:04 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:04 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:04 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f
Nov 22 14:23:04 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:04 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:04 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3
Nov 22 14:23:04 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:04 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:04 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f
Nov 22 14:23:04 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:04 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:04 user nova-compute[74776]: FIRMWARE:
Nov 22 14:23:04 user nova-compute[74776]: No targets found.
Nov 22 14:23:04 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:23:04 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:23:04 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:23:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5287bcae-d623-412f-ae76-ebcb0d64e0b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2810b9ab-b6bb-42f1-9dc0-1238684506d2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:23:05 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:23:05 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c582f2170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f'): ({'sdd'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Removing single pathed devices sdd {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7576d5-f8b7-4b99-8a39-e82c1153e15e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28deeee-ce73-4c53-9e75-15b9bdbff275]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Flushing IO for device /dev/sdd {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f59c51-f582-435b-9cd5-51507b9cba06]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee7ce6f-a104-487b-b3f9-7a99d981f3cd]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] SCSI volumes sdd have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8198f80-7a9b-4818-8e09-354dee55db0b]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae93cdc6-13c4-45bf-a528-f367c6591dfc]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f, portal: 172.16.0.220,3260]
Nov 22 14:23:05 user nova-compute[74776]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f, portal: 172.16.0.220,3260] successful.
Nov 22 14:23:05 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[42edb29f-de90-4b18-8c71-bd0ff3d4b03a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] <== disconnect_volume: return (318ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:23:05 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Deleting instance files /opt/stack/data/nova/instances/97fa95f1-f856-4b65-917f-9808bac6e576_del
Nov 22 14:23:05 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Deletion of /opt/stack/data/nova/instances/97fa95f1-f856-4b65-917f-9808bac6e576_del complete
Nov 22 14:23:05 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 97fa95f1-f856-4b65-917f-9808bac6e576 could not be found.
Nov 22 14:23:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uoiazveY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:23:05 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5d6b7d-8b51-4a7d-991d-e94244c8708c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:23:05 user nova-compute[74776]: No targets found.
Nov 22 14:23:05 user nova-compute[74776]: iSNS:
Nov 22 14:23:05 user nova-compute[74776]: No targets found.
Nov 22 14:23:05 user nova-compute[74776]: STATIC:
Nov 22 14:23:05 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848
Nov 22 14:23:05 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:05 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:05 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a
Nov 22 14:23:05 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:05 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:05 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3
Nov 22 14:23:05 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:05 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:05 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c
Nov 22 14:23:05 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:05 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:05 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f
Nov 22 14:23:05 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:05 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:05 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3
Nov 22 14:23:05 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:05 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:05 user nova-compute[74776]: FIRMWARE:
Nov 22 14:23:05 user nova-compute[74776]: No targets found.
Nov 22 14:23:05 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:23:05 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:23:05 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef529a68-fd46-43f4-8777-f851cda09204]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1157c8d5-04de-4ac3-89c2-b69b459e6d71]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:23:05 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:23:05 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:23:05 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c5826ea70>, {}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Disconnecting from: [] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] <== disconnect_volume: return (77ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:23:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:23:06 user nova-compute[74776]: WARNING nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Nov 22 14:23:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid e96ab1bf-6f19-4e5f-b79d-f0266988090b {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 4629d82d-fd02-4a58-a535-b362b493e7c0 {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 98fb9b54-c428-4a48-b1ff-a976f971b764 {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 42b00137-df98-47d9-9d02-29b4707fed30 {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 525baf66-82cc-4e8d-a37a-c92c51d4673d {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 6f2ce4b2-660c-431f-b951-c6ec5090ef7e {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 4246c1b7-6873-421a-ab2a-59dfb6adcb38 {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 370f25d8-d6f4-4de8-b356-d23e6d599f82 {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 84dbab20-fe7f-4b9e-bc02-6c739029f69d {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 4a1cf058-5290-4d09-a979-89de319f2cbd {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid d7f3ff5e-292d-4e81-af58-b9a45adfbda1 {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 97fa95f1-f856-4b65-917f-9808bac6e576 {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "4629d82d-fd02-4a58-a535-b362b493e7c0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "98fb9b54-c428-4a48-b1ff-a976f971b764" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "42b00137-df98-47d9-9d02-29b4707fed30" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "42b00137-df98-47d9-9d02-29b4707fed30" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "525baf66-82cc-4e8d-a37a-c92c51d4673d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "370f25d8-d6f4-4de8-b356-d23e6d599f82" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "4a1cf058-5290-4d09-a979-89de319f2cbd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "4a1cf058-5290-4d09-a979-89de319f2cbd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "97fa95f1-f856-4b65-917f-9808bac6e576" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "97fa95f1-f856-4b65-917f-9808bac6e576" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:06 user nova-compute[74776]: INFO nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] During sync_power_state the instance has a pending task (rebuilding). Skip.
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "97fa95f1-f856-4b65-917f-9808bac6e576" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:06 user nova-compute[74776]: WARNING oslo_messaging._drivers.amqpdriver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "42b00137-df98-47d9-9d02-29b4707fed30" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "4a1cf058-5290-4d09-a979-89de319f2cbd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.122s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Preparing to wait for external event volume-reimaged-9f6f309a-fb40-466e-af42-74fa8649a83f {{(pid=74776) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Acquiring lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-01abb30f-7179-4266-baae-66b3621b0abf req-940ba987-13e8-4048-822b-696fd0318dfd service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Received event network-vif-plugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-01abb30f-7179-4266-baae-66b3621b0abf req-940ba987-13e8-4048-822b-696fd0318dfd service nova] Acquiring lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-01abb30f-7179-4266-baae-66b3621b0abf req-940ba987-13e8-4048-822b-696fd0318dfd service nova] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-01abb30f-7179-4266-baae-66b3621b0abf req-940ba987-13e8-4048-822b-696fd0318dfd service nova] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-01abb30f-7179-4266-baae-66b3621b0abf req-940ba987-13e8-4048-822b-696fd0318dfd service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] No event matching network-vif-plugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 in dict_keys([('volume-reimaged', '9f6f309a-fb40-466e-af42-74fa8649a83f')]) {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Nov 22 14:23:06 user nova-compute[74776]: WARNING nova.compute.manager [req-01abb30f-7179-4266-baae-66b3621b0abf req-940ba987-13e8-4048-822b-696fd0318dfd service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Received unexpected event network-vif-plugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 for instance with vm_state active and task_state rebuilding.
Nov 22 14:23:07 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:23:08 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:23:08 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:23:08 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:23:08 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 14:23:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:23:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:23:08 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:23:08 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid e96ab1bf-6f19-4e5f-b79d-f0266988090b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:23:09 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Updating instance_info_cache with network_info: [{"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:23:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-e96ab1bf-6f19-4e5f-b79d-f0266988090b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:23:09 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:23:09 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:23:09 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:23:09 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:23:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:09 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:23:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:23:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:23:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:23:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:23:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:23:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:23:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:14 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:23:14 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:23:14 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=7023MB free_disk=25.166030883789062GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:23:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:14 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 525baf66-82cc-4e8d-a37a-c92c51d4673d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:23:14 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6f2ce4b2-660c-431f-b951-c6ec5090ef7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:23:14 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4246c1b7-6873-421a-ab2a-59dfb6adcb38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:23:14 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 42b00137-df98-47d9-9d02-29b4707fed30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:23:14 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 97fa95f1-f856-4b65-917f-9808bac6e576 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:23:14 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4629d82d-fd02-4a58-a535-b362b493e7c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:23:14 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance d7f3ff5e-292d-4e81-af58-b9a45adfbda1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:23:14 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 98fb9b54-c428-4a48-b1ff-a976f971b764 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:23:14 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance e96ab1bf-6f19-4e5f-b79d-f0266988090b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:23:14 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 84dbab20-fe7f-4b9e-bc02-6c739029f69d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:23:14 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 370f25d8-d6f4-4de8-b356-d23e6d599f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:23:14 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4a1cf058-5290-4d09-a979-89de319f2cbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:23:14 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:23:14 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:23:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:15 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:23:15 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:23:15 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:23:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:16 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:23:16 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:23:16 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:23:16 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:23:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 req-25c138d7-a575-4c9b-ab1e-62b85e6d2533 service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Received event volume-reimaged-9f6f309a-fb40-466e-af42-74fa8649a83f {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 req-25c138d7-a575-4c9b-ab1e-62b85e6d2533 service nova] Acquiring lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 req-25c138d7-a575-4c9b-ab1e-62b85e6d2533 service nova] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 req-25c138d7-a575-4c9b-ab1e-62b85e6d2533 service nova] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 req-25c138d7-a575-4c9b-ab1e-62b85e6d2533 service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Processing event volume-reimaged-9f6f309a-fb40-466e-af42-74fa8649a83f {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Instance event wait completed in 15 seconds for volume-reimaged {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:23:21 user nova-compute[74776]: INFO nova.virt.block_device [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Booting with volume 9f6f309a-fb40-466e-af42-74fa8649a83f at /dev/vda
Nov 22 14:23:21 user nova-compute[74776]: DEBUG os_brick.utils [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23d50c2-0dd1-4fd4-a0f2-18e5f4e6f079]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03dacd8-cbc6-4042-8979-717bea1e7afe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[46545669-c64a-4462-aa36-6e48b49dca20]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dea30f7-1201-431c-aa8f-1b22d650b521]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:23:21 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:23:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f9d1f0-1be5-45fc-be3a-d6023b58ee04]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG os_brick.utils [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:23:21 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Updating existing volume attachment record: 843e48b2-bf95-4665-8eed-eb4d02e200ca {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:23:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-f03408b8-3844-4ede-9575-b41695da8555 req-2a5ede35-6b37-4362-b2dd-d4c00dbd1db7 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Received event network-changed-bc0c53a4-0e99-4794-863a-3dd7e2fd6622 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-f03408b8-3844-4ede-9575-b41695da8555 req-2a5ede35-6b37-4362-b2dd-d4c00dbd1db7 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Refreshing instance network info cache due to event network-changed-bc0c53a4-0e99-4794-863a-3dd7e2fd6622. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:23:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f03408b8-3844-4ede-9575-b41695da8555 req-2a5ede35-6b37-4362-b2dd-d4c00dbd1db7 service nova] Acquiring lock "refresh_cache-4246c1b7-6873-421a-ab2a-59dfb6adcb38" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:23:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f03408b8-3844-4ede-9575-b41695da8555 req-2a5ede35-6b37-4362-b2dd-d4c00dbd1db7 service nova] Acquired lock "refresh_cache-4246c1b7-6873-421a-ab2a-59dfb6adcb38" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:23:25 user nova-compute[74776]: DEBUG nova.network.neutron [req-f03408b8-3844-4ede-9575-b41695da8555 req-2a5ede35-6b37-4362-b2dd-d4c00dbd1db7 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Refreshing network info cache for port bc0c53a4-0e99-4794-863a-3dd7e2fd6622 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:23:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:25 user nova-compute[74776]: INFO nova.compute.manager [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Terminating instance
Nov 22 14:23:25 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:23:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-35b5f655-9708-40cb-a8b4-f7b499c7b5e0 req-f7d93ba6-1e7c-4ba8-86e5-393fd224fcf7 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Received event network-vif-unplugged-bc0c53a4-0e99-4794-863a-3dd7e2fd6622 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-35b5f655-9708-40cb-a8b4-f7b499c7b5e0 req-f7d93ba6-1e7c-4ba8-86e5-393fd224fcf7 service nova] Acquiring lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-35b5f655-9708-40cb-a8b4-f7b499c7b5e0 req-f7d93ba6-1e7c-4ba8-86e5-393fd224fcf7 service nova] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-35b5f655-9708-40cb-a8b4-f7b499c7b5e0 req-f7d93ba6-1e7c-4ba8-86e5-393fd224fcf7 service nova] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-35b5f655-9708-40cb-a8b4-f7b499c7b5e0 req-f7d93ba6-1e7c-4ba8-86e5-393fd224fcf7 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] No waiting events found dispatching network-vif-unplugged-bc0c53a4-0e99-4794-863a-3dd7e2fd6622 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-35b5f655-9708-40cb-a8b4-f7b499c7b5e0 req-f7d93ba6-1e7c-4ba8-86e5-393fd224fcf7 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Received event network-vif-unplugged-bc0c53a4-0e99-4794-863a-3dd7e2fd6622 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:23:26 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Instance destroyed successfully.
Nov 22 14:23:26 user nova-compute[74776]: DEBUG nova.objects.instance [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lazy-loading 'resources' on Instance uuid 4246c1b7-6873-421a-ab2a-59dfb6adcb38 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:20:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-944267041',display_name='tempest-TestStampPattern-server-944267041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-944267041',id=16,image_ref='5160a80a-adc3-4180-83fe-466ff64d15be',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwcdcEEHtV9OzSZWCbIN6wDgtlsxdHeeQue3/BMNcqHGBrCc/qx2sDq1Kmpv63TRxJ4I9ODFDrCABhThEkbpTezW8oRAjWlGjr+Las3LmrBBrpcK0n2dEwRuG9SNI1g0w==',key_name='tempest-TestStampPattern-1537282025',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:20:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='396c01f7adaa4f2dbc6963bd855597f3',ramdisk_id='',reservation_id='r-ybe5z66g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='42b00137-df98-47d9-9d02-29b4707fed30',image_min_disk='1',image_min_ram='0',image_owner_id='396c01f7adaa4f2dbc6963bd855597f3',image_owner_project_name='tempest-TestStampPattern-19907094',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-19907094-project-member',image_user_id='bdc62f686c7b496cb093b91dcd2d7e02',owner_project_name='tempest-TestStampPattern-19907094',owner_user_name='tempest-TestStampPattern-19907094-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:20:38Z,user_data=None,user_id='bdc62f686c7b496cb093b91dcd2d7e02',uuid=4246c1b7-6873-421a-ab2a-59dfb6adcb38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "address": "fa:16:3e:85:36:3e", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c53a4-0e", "ovs_interfaceid": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Converting VIF {"id": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "address": "fa:16:3e:85:36:3e", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c53a4-0e", "ovs_interfaceid": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:36:3e,bridge_name='br-int',has_traffic_filtering=True,id=bc0c53a4-0e99-4794-863a-3dd7e2fd6622,network=Network(d8fe5b03-bd5e-42d1-b634-8150f8a9f32b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc0c53a4-0e') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG os_vif [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:36:3e,bridge_name='br-int',has_traffic_filtering=True,id=bc0c53a4-0e99-4794-863a-3dd7e2fd6622,network=Network(d8fe5b03-bd5e-42d1-b634-8150f8a9f32b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc0c53a4-0e') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc0c53a4-0e, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32ee33a0-24e6-4f4f-98d7-62c0ff3189f8) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:26 user nova-compute[74776]: INFO os_vif [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:36:3e,bridge_name='br-int',has_traffic_filtering=True,id=bc0c53a4-0e99-4794-863a-3dd7e2fd6622,network=Network(d8fe5b03-bd5e-42d1-b634-8150f8a9f32b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc0c53a4-0e')
Nov 22 14:23:26 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Deleting instance files /opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38_del
Nov 22 14:23:26 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Deletion of /opt/stack/data/nova/instances/4246c1b7-6873-421a-ab2a-59dfb6adcb38_del complete
Nov 22 14:23:26 user nova-compute[74776]: INFO nova.compute.manager [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 22 14:23:26 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG nova.network.neutron [req-f03408b8-3844-4ede-9575-b41695da8555 req-2a5ede35-6b37-4362-b2dd-d4c00dbd1db7 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Updated VIF entry in instance network info cache for port bc0c53a4-0e99-4794-863a-3dd7e2fd6622. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG nova.network.neutron [req-f03408b8-3844-4ede-9575-b41695da8555 req-2a5ede35-6b37-4362-b2dd-d4c00dbd1db7 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Updating instance_info_cache with network_info: [{"id": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "address": "fa:16:3e:85:36:3e", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0c53a4-0e", "ovs_interfaceid": "bc0c53a4-0e99-4794-863a-3dd7e2fd6622", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f03408b8-3844-4ede-9575-b41695da8555 req-2a5ede35-6b37-4362-b2dd-d4c00dbd1db7 service nova] Releasing lock "refresh_cache-4246c1b7-6873-421a-ab2a-59dfb6adcb38" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:23:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:27 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:23:27 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Took 0.50 seconds to deallocate network for instance.
Nov 22 14:23:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:27 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:23:27 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:23:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:27 user nova-compute[74776]: DEBUG nova.compute.manager [req-286d8e2f-3663-435f-a70e-d2951fc5b080 req-24ea3dd4-ba48-46ad-a05b-4c5a75c09e58 service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Received event network-vif-deleted-bc0c53a4-0e99-4794-863a-3dd7e2fd6622 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:27 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Deleted allocations for instance 4246c1b7-6873-421a-ab2a-59dfb6adcb38
Nov 22 14:23:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c5e539fd-ea86-4c0f-8d2d-a2e70362826f tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.984s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.compute.manager [req-2c6d6b7c-f9ad-404b-8817-3cb41b4d2767 req-1b3e4aea-93b7-403d-9fc1-a5da1ca3f15e service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Received event network-vif-plugged-bc0c53a4-0e99-4794-863a-3dd7e2fd6622 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2c6d6b7c-f9ad-404b-8817-3cb41b4d2767 req-1b3e4aea-93b7-403d-9fc1-a5da1ca3f15e service nova] Acquiring lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2c6d6b7c-f9ad-404b-8817-3cb41b4d2767 req-1b3e4aea-93b7-403d-9fc1-a5da1ca3f15e service nova] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2c6d6b7c-f9ad-404b-8817-3cb41b4d2767 req-1b3e4aea-93b7-403d-9fc1-a5da1ca3f15e service nova] Lock "4246c1b7-6873-421a-ab2a-59dfb6adcb38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.compute.manager [req-2c6d6b7c-f9ad-404b-8817-3cb41b4d2767 req-1b3e4aea-93b7-403d-9fc1-a5da1ca3f15e service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] No waiting events found dispatching network-vif-plugged-bc0c53a4-0e99-4794-863a-3dd7e2fd6622 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:28 user nova-compute[74776]: WARNING nova.compute.manager [req-2c6d6b7c-f9ad-404b-8817-3cb41b4d2767 req-1b3e4aea-93b7-403d-9fc1-a5da1ca3f15e service nova] [instance: 4246c1b7-6873-421a-ab2a-59dfb6adcb38] Received unexpected event network-vif-plugged-bc0c53a4-0e99-4794-863a-3dd7e2fd6622 for instance with vm_state deleted and task_state None.
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "98fb9b54-c428-4a48-b1ff-a976f971b764" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:28 user nova-compute[74776]: INFO nova.compute.manager [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Terminating instance
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.compute.manager [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:23:28 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Creating image(s)
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Did not create local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Ensure instance console log exists: /opt/stack/data/nova/instances/97fa95f1-f856-4b65-917f-9808bac6e576/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Start _get_guest_xml network_info=[{"id": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "address": "fa:16:3e:30:f8:d1", "network": {"id": "f55f24e7-af68-4a8b-af50-ff18023189dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717554397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722073efd41d4ff2a3354a6dd1f6093a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1e50d-19", "ovs_interfaceid": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '843e48b2-bf95-4665-8eed-eb4d02e200ca', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uoiazveY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '97fa95f1-f856-4b65-917f-9808bac6e576', 'attached_at': '', 'detached_at': '', 'volume_id': '9f6f309a-fb40-466e-af42-74fa8649a83f', 'serial': '9f6f309a-fb40-466e-af42-74fa8649a83f'}, 'boot_index': 0, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:28 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 22 14:23:28 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.objects.instance [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lazy-loading 'vcpu_model' on Instance uuid 97fa95f1-f856-4b65-917f-9808bac6e576 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uoiazveY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:23:28 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 14:23:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:23:28 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 22 14:23:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:23:28 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1456444-4325-454c-85d0-61720aaec9df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:23:28 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa1352a-884c-4182-a18a-75641377e5fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f] added
Nov 22 14:23:28 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddd35f4-be51-4129-a9c3-ecb6ace42414]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[92202067-4fe9-4b74-8b7c-d36eca1c142f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uoiazveY {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uoiazveY" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f277dc-2991-48e1-8c75-27c93c6b6339]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uoiazveY'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba35135f-b3d2-4b40-9c3b-3637ca065b13]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f8188e-5809-4262-b1ca-e414fb6a99cc]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:23:28 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:23:28 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:23:28 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:23:28 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:23:28 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:23:28 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:23:28 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:23:28 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:23:28 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:23:28 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:23:28 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:23:28 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:23:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aed2a7d-b35c-4a2f-84d0-18cf256352cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f, portal: 172.16.0.220,3260]
Nov 22 14:23:29 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f, portal: 172.16.0.220,3260] successful.
Nov 22 14:23:29 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d7a528-4456-4db0-a4e3-3458abc810c6]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ac60f4-eded-46f6-b709-79cb39d17d2c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:23:29 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:23:29 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:23:29 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:23:29 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:23:29 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:23:29 user nova-compute[74776]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:23:29 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:23:29 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:23:29 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:23:29 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:23:29 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:23:29 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:23:29 user nova-compute[74776]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:23:29 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dec013-6699-4efa-a93b-728c563c706d]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uoiazveY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:23:29 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Instance destroyed successfully.
Nov 22 14:23:29 user nova-compute[74776]: DEBUG nova.objects.instance [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lazy-loading 'resources' on Instance uuid 98fb9b54-c428-4a48-b1ff-a976f971b764 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-804906559',display_name='tempest-ServerStableDeviceRescueTest-server-804906559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-804906559',id=4,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAszFWs96WQDQ4zYntrFAx3Zcw0snWwm1TTQJlxZEpXPnyU1gHlkBcEFtwU06oa8C/AZE8SlO743T94XNGt69XQf2jZZS+I5C2FccEUKDASTvZnvk1o9fr1Z+E+wPYuW1Q==',key_name='tempest-keypair-1870049157',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:20:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a92fd48cf9c34eac867c14bf962c3a0c',ramdisk_id='',reservation_id='r-s4c0loch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1477734383',owner_user_name='tempest-ServerStableDeviceRescueTest-1477734383-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:22:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='385e459f09fd41d4bba0ad13430dc0fd',uuid=98fb9b54-c428-4a48-b1ff-a976f971b764,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "address": "fa:16:3e:7c:6e:68", "network": {"id": "32c8e7a3-6995-4931-ad2d-e8c3eb351538", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92fd48cf9c34eac867c14bf962c3a0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd255982-4c", "ovs_interfaceid": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Converting VIF {"id": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "address": "fa:16:3e:7c:6e:68", "network": {"id": "32c8e7a3-6995-4931-ad2d-e8c3eb351538", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-43390964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a92fd48cf9c34eac867c14bf962c3a0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd255982-4c", "ovs_interfaceid": "dd255982-4c19-4bf3-b01c-ba063b6f561e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6e:68,bridge_name='br-int',has_traffic_filtering=True,id=dd255982-4c19-4bf3-b01c-ba063b6f561e,network=Network(32c8e7a3-6995-4931-ad2d-e8c3eb351538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd255982-4c') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG os_vif [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6e:68,bridge_name='br-int',has_traffic_filtering=True,id=dd255982-4c19-4bf3-b01c-ba063b6f561e,network=Network(32c8e7a3-6995-4931-ad2d-e8c3eb351538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd255982-4c') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd255982-4c, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85df811a-9b0f-487f-9e94-18eeca7bfbbc) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:29 user nova-compute[74776]: INFO os_vif [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:6e:68,bridge_name='br-int',has_traffic_filtering=True,id=dd255982-4c19-4bf3-b01c-ba063b6f561e,network=Network(32c8e7a3-6995-4931-ad2d-e8c3eb351538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd255982-4c')
Nov 22 14:23:29 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Deleting instance files /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764_del
Nov 22 14:23:29 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Deletion of /opt/stack/data/nova/instances/98fb9b54-c428-4a48-b1ff-a976f971b764_del complete
Nov 22 14:23:29 user nova-compute[74776]: INFO nova.compute.manager [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 22 14:23:29 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG nova.compute.manager [req-966d7ace-1dd2-4e7e-972a-4a9281f4b777 req-d86e4573-8934-4632-9bc3-ba11dd679feb service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received event network-vif-unplugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-966d7ace-1dd2-4e7e-972a-4a9281f4b777 req-d86e4573-8934-4632-9bc3-ba11dd679feb service nova] Acquiring lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-966d7ace-1dd2-4e7e-972a-4a9281f4b777 req-d86e4573-8934-4632-9bc3-ba11dd679feb service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-966d7ace-1dd2-4e7e-972a-4a9281f4b777 req-d86e4573-8934-4632-9bc3-ba11dd679feb service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG nova.compute.manager [req-966d7ace-1dd2-4e7e-972a-4a9281f4b777 req-d86e4573-8934-4632-9bc3-ba11dd679feb service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] No waiting events found dispatching network-vif-unplugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG nova.compute.manager [req-966d7ace-1dd2-4e7e-972a-4a9281f4b777 req-d86e4573-8934-4632-9bc3-ba11dd679feb service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received event network-vif-unplugged-dd255982-4c19-4bf3-b01c-ba063b6f561e for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG nova.compute.manager [req-966d7ace-1dd2-4e7e-972a-4a9281f4b777 req-d86e4573-8934-4632-9bc3-ba11dd679feb service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received event network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-966d7ace-1dd2-4e7e-972a-4a9281f4b777 req-d86e4573-8934-4632-9bc3-ba11dd679feb service nova] Acquiring lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-966d7ace-1dd2-4e7e-972a-4a9281f4b777 req-d86e4573-8934-4632-9bc3-ba11dd679feb service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-966d7ace-1dd2-4e7e-972a-4a9281f4b777 req-d86e4573-8934-4632-9bc3-ba11dd679feb service nova] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:29 user nova-compute[74776]: DEBUG nova.compute.manager [req-966d7ace-1dd2-4e7e-972a-4a9281f4b777 req-d86e4573-8934-4632-9bc3-ba11dd679feb service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] No waiting events found dispatching network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:29 user nova-compute[74776]: WARNING nova.compute.manager [req-966d7ace-1dd2-4e7e-972a-4a9281f4b777 req-d86e4573-8934-4632-9bc3-ba11dd679feb service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received unexpected event network-vif-plugged-dd255982-4c19-4bf3-b01c-ba063b6f561e for instance with vm_state active and task_state deleting.
Nov 22 14:23:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23162353131336333', 'path': '/dev/sdb'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162353131336333', 'path': '/dev/sdb'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T14:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1117334062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-701035597',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYkU/2rQfSqsHtxK4fuxV+C9ojLZCEgNPlys0mLUFyCMchJcZzHAHb+3FUbvc2xdk3gHibee1w4iVYXBMvTV3V9mrEhNV3Yx2m3WYA430lr+k5smV5pmrxj35fa4s3h8g==',key_name='tempest-keypair-1544757416',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:21:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='722073efd41d4ff2a3354a6dd1f6093a',ramdisk_id='',reservation_id='r-4zg0peg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1866761054',owner_user_name='tempest-ServerActionsV293TestJSON-1866761054-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9bb1ba0806f4157873e2ef88d7c832f',uuid=97fa95f1-f856-4b65-917f-9808bac6e576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "address": "fa:16:3e:30:f8:d1", "network": {"id": "f55f24e7-af68-4a8b-af50-ff18023189dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717554397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722073efd41d4ff2a3354a6dd1f6093a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1e50d-19", "ovs_interfaceid": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Converting VIF {"id": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "address": "fa:16:3e:30:f8:d1", "network": {"id": "f55f24e7-af68-4a8b-af50-ff18023189dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717554397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722073efd41d4ff2a3354a6dd1f6093a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1e50d-19", "ovs_interfaceid": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:f8:d1,bridge_name='br-int',has_traffic_filtering=True,id=2ce1e50d-19f9-474c-9f47-2dc4eca12fb4,network=Network(f55f24e7-af68-4a8b-af50-ff18023189dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1e50d-19') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:23:30 user nova-compute[74776]:   <uuid>97fa95f1-f856-4b65-917f-9808bac6e576</uuid>
Nov 22 14:23:30 user nova-compute[74776]:   <name>instance-00000012</name>
Nov 22 14:23:30 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:23:30 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:23:30 user nova-compute[74776]:   <metadata>
Nov 22 14:23:30 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:23:30 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:23:30 user nova-compute[74776]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1117334062</nova:name>
Nov 22 14:23:30 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:23:28</nova:creationTime>
Nov 22 14:23:30 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:23:30 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:23:30 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:23:30 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:23:30 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:23:30 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:23:30 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:23:30 user nova-compute[74776]:       <nova:owner>
Nov 22 14:23:30 user nova-compute[74776]:         <nova:user uuid="a9bb1ba0806f4157873e2ef88d7c832f">tempest-ServerActionsV293TestJSON-1866761054-project-member</nova:user>
Nov 22 14:23:30 user nova-compute[74776]:         <nova:project uuid="722073efd41d4ff2a3354a6dd1f6093a">tempest-ServerActionsV293TestJSON-1866761054</nova:project>
Nov 22 14:23:30 user nova-compute[74776]:       </nova:owner>
Nov 22 14:23:30 user nova-compute[74776]:       <nova:ports>
Nov 22 14:23:30 user nova-compute[74776]:         <nova:port uuid="2ce1e50d-19f9-474c-9f47-2dc4eca12fb4">
Nov 22 14:23:30 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 14:23:30 user nova-compute[74776]:         </nova:port>
Nov 22 14:23:30 user nova-compute[74776]:       </nova:ports>
Nov 22 14:23:30 user nova-compute[74776]:     </nova:instance>
Nov 22 14:23:30 user nova-compute[74776]:   </metadata>
Nov 22 14:23:30 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:23:30 user nova-compute[74776]:     <system>
Nov 22 14:23:30 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:23:30 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:23:30 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:23:30 user nova-compute[74776]:       <entry name="serial">97fa95f1-f856-4b65-917f-9808bac6e576</entry>
Nov 22 14:23:30 user nova-compute[74776]:       <entry name="uuid">97fa95f1-f856-4b65-917f-9808bac6e576</entry>
Nov 22 14:23:30 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:23:30 user nova-compute[74776]:     </system>
Nov 22 14:23:30 user nova-compute[74776]:   </sysinfo>
Nov 22 14:23:30 user nova-compute[74776]:   <os>
Nov 22 14:23:30 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:23:30 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:23:30 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:23:30 user nova-compute[74776]:   </os>
Nov 22 14:23:30 user nova-compute[74776]:   <features>
Nov 22 14:23:30 user nova-compute[74776]:     <acpi/>
Nov 22 14:23:30 user nova-compute[74776]:     <apic/>
Nov 22 14:23:30 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:23:30 user nova-compute[74776]:   </features>
Nov 22 14:23:30 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:23:30 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:23:30 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:23:30 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:23:30 user nova-compute[74776]:   </clock>
Nov 22 14:23:30 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:23:30 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:23:30 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:23:30 user nova-compute[74776]:   </cpu>
Nov 22 14:23:30 user nova-compute[74776]:   <devices>
Nov 22 14:23:30 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:23:30 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:23:30 user nova-compute[74776]:       <source dev="/dev/sdb"/>
Nov 22 14:23:30 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:23:30 user nova-compute[74776]:       <serial>9f6f309a-fb40-466e-af42-74fa8649a83f</serial>
Nov 22 14:23:30 user nova-compute[74776]:     </disk>
Nov 22 14:23:30 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:23:30 user nova-compute[74776]:       <mac address="fa:16:3e:30:f8:d1"/>
Nov 22 14:23:30 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:23:30 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:23:30 user nova-compute[74776]:       <target dev="tap2ce1e50d-19"/>
Nov 22 14:23:30 user nova-compute[74776]:     </interface>
Nov 22 14:23:30 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:23:30 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/97fa95f1-f856-4b65-917f-9808bac6e576/console.log" append="off"/>
Nov 22 14:23:30 user nova-compute[74776]:     </serial>
Nov 22 14:23:30 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:23:30 user nova-compute[74776]:     <video>
Nov 22 14:23:30 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:23:30 user nova-compute[74776]:     </video>
Nov 22 14:23:30 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:23:30 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:23:30 user nova-compute[74776]:     </rng>
Nov 22 14:23:30 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:23:30 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:23:30 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:23:30 user nova-compute[74776]:     </memballoon>
Nov 22 14:23:30 user nova-compute[74776]:   </devices>
Nov 22 14:23:30 user nova-compute[74776]: </domain>
Nov 22 14:23:30 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T14:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1117334062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-701035597',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYkU/2rQfSqsHtxK4fuxV+C9ojLZCEgNPlys0mLUFyCMchJcZzHAHb+3FUbvc2xdk3gHibee1w4iVYXBMvTV3V9mrEhNV3Yx2m3WYA430lr+k5smV5pmrxj35fa4s3h8g==',key_name='tempest-keypair-1544757416',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:21:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='722073efd41d4ff2a3354a6dd1f6093a',ramdisk_id='',reservation_id='r-4zg0peg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1866761054',owner_user_name='tempest-ServerActionsV293TestJSON-1866761054-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9bb1ba0806f4157873e2ef88d7c832f',uuid=97fa95f1-f856-4b65-917f-9808bac6e576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "address": "fa:16:3e:30:f8:d1", "network": {"id": "f55f24e7-af68-4a8b-af50-ff18023189dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717554397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722073efd41d4ff2a3354a6dd1f6093a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1e50d-19", "ovs_interfaceid": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Converting VIF {"id": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "address": "fa:16:3e:30:f8:d1", "network": {"id": "f55f24e7-af68-4a8b-af50-ff18023189dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717554397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722073efd41d4ff2a3354a6dd1f6093a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1e50d-19", "ovs_interfaceid": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:f8:d1,bridge_name='br-int',has_traffic_filtering=True,id=2ce1e50d-19f9-474c-9f47-2dc4eca12fb4,network=Network(f55f24e7-af68-4a8b-af50-ff18023189dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1e50d-19') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG os_vif [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:f8:d1,bridge_name='br-int',has_traffic_filtering=True,id=2ce1e50d-19f9-474c-9f47-2dc4eca12fb4,network=Network(f55f24e7-af68-4a8b-af50-ff18023189dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1e50d-19') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83112e88-6101-578d-ab30-e2a5360937b5', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ce1e50d-19, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ce1e50d-19, col_values=(('qos', UUID('70954a36-4e60-4077-b1e0-d811925876f6')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ce1e50d-19, col_values=(('external_ids', {'iface-id': '2ce1e50d-19f9-474c-9f47-2dc4eca12fb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:f8:d1', 'vm-uuid': '97fa95f1-f856-4b65-917f-9808bac6e576'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:30 user nova-compute[74776]: INFO os_vif [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:f8:d1,bridge_name='br-int',has_traffic_filtering=True,id=2ce1e50d-19f9-474c-9f47-2dc4eca12fb4,network=Network(f55f24e7-af68-4a8b-af50-ff18023189dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1e50d-19')
Nov 22 14:23:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] No VIF found with MAC fa:16:3e:30:f8:d1, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:23:30 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Took 1.11 seconds to deallocate network for instance.
Nov 22 14:23:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:23:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:31 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Deleted allocations for instance 98fb9b54-c428-4a48-b1ff-a976f971b764
Nov 22 14:23:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-baaf96d3-5e49-40f8-b172-91f1ef7d777b tempest-ServerStableDeviceRescueTest-1477734383 tempest-ServerStableDeviceRescueTest-1477734383-project-member] Lock "98fb9b54-c428-4a48-b1ff-a976f971b764" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.629s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "f4f30fe7-b234-4f81-b081-3214f5ebe789" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "f4f30fe7-b234-4f81-b081-3214f5ebe789" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:31 user nova-compute[74776]: DEBUG nova.compute.manager [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:23:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-6ce0458c-bc25-425a-a57a-bebbfe29b190 req-2f76033d-3689-4512-9fce-68671355d5dc service nova] [instance: 98fb9b54-c428-4a48-b1ff-a976f971b764] Received event network-vif-deleted-dd255982-4c19-4bf3-b01c-ba063b6f561e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:31 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:23:31 user nova-compute[74776]: INFO nova.compute.claims [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Claim successful on node user
Nov 22 14:23:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-b0a55003-c23b-4f67-a053-a74ae22f56bd req-766ce8a1-c9d6-4ff9-b77d-1cc327bb5c50 service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Received event network-vif-plugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b0a55003-c23b-4f67-a053-a74ae22f56bd req-766ce8a1-c9d6-4ff9-b77d-1cc327bb5c50 service nova] Acquiring lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b0a55003-c23b-4f67-a053-a74ae22f56bd req-766ce8a1-c9d6-4ff9-b77d-1cc327bb5c50 service nova] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b0a55003-c23b-4f67-a053-a74ae22f56bd req-766ce8a1-c9d6-4ff9-b77d-1cc327bb5c50 service nova] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-b0a55003-c23b-4f67-a053-a74ae22f56bd req-766ce8a1-c9d6-4ff9-b77d-1cc327bb5c50 service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] No waiting events found dispatching network-vif-plugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:31 user nova-compute[74776]: WARNING nova.compute.manager [req-b0a55003-c23b-4f67-a053-a74ae22f56bd req-766ce8a1-c9d6-4ff9-b77d-1cc327bb5c50 service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Received unexpected event network-vif-plugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 for instance with vm_state active and task_state rebuild_spawning.
Nov 22 14:23:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG nova.compute.manager [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG nova.compute.manager [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG nova.network.neutron [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:23:32 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:23:32 user nova-compute[74776]: DEBUG nova.compute.manager [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG nova.policy [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dea876275c70471d9cba1c3158bd63e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359aba8e95e4090a02fb0a46012f20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG nova.compute.manager [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:23:32 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Creating image(s)
Nov 22 14:23:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "/opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "/opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.168s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.170s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk 1073741824" returned: 0 in 0.099s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:32 user nova-compute[74776]: DEBUG nova.network.neutron [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Successfully created port: 669801ba-1e1d-4ef3-bad3-d1961e58f5af {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.170s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Cannot resize image /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Ensure instance console log exists: /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.network.neutron [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Successfully updated port: 669801ba-1e1d-4ef3-bad3-d1961e58f5af {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "refresh_cache-f4f30fe7-b234-4f81-b081-3214f5ebe789" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquired lock "refresh_cache-f4f30fe7-b234-4f81-b081-3214f5ebe789" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.network.neutron [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.network.neutron [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:23:33 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Instance spawned successfully.
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.compute.manager [req-129e40fb-3c98-41f0-a1c8-04bdb25acd40 req-6cabfae0-fd66-4b8f-b9ff-0f546cd3934c service nova] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Received event network-changed-669801ba-1e1d-4ef3-bad3-d1961e58f5af {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.compute.manager [req-129e40fb-3c98-41f0-a1c8-04bdb25acd40 req-6cabfae0-fd66-4b8f-b9ff-0f546cd3934c service nova] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Refreshing instance network info cache due to event network-changed-669801ba-1e1d-4ef3-bad3-d1961e58f5af. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-129e40fb-3c98-41f0-a1c8-04bdb25acd40 req-6cabfae0-fd66-4b8f-b9ff-0f546cd3934c service nova] Acquiring lock "refresh_cache-f4f30fe7-b234-4f81-b081-3214f5ebe789" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.objects.instance [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74776) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.network.neutron [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Updating instance_info_cache with network_info: [{"id": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "address": "fa:16:3e:46:10:91", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669801ba-1e", "ovs_interfaceid": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Releasing lock "refresh_cache-f4f30fe7-b234-4f81-b081-3214f5ebe789" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Instance network_info: |[{"id": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "address": "fa:16:3e:46:10:91", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669801ba-1e", "ovs_interfaceid": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-129e40fb-3c98-41f0-a1c8-04bdb25acd40 req-6cabfae0-fd66-4b8f-b9ff-0f546cd3934c service nova] Acquired lock "refresh_cache-f4f30fe7-b234-4f81-b081-3214f5ebe789" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.network.neutron [req-129e40fb-3c98-41f0-a1c8-04bdb25acd40 req-6cabfae0-fd66-4b8f-b9ff-0f546cd3934c service nova] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Refreshing network info cache for port 669801ba-1e1d-4ef3-bad3-d1961e58f5af {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Start _get_guest_xml network_info=[{"id": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "address": "fa:16:3e:46:10:91", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669801ba-1e", "ovs_interfaceid": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.compute.manager [req-b52ea237-5d20-4936-97e1-085e0d5eec9a req-4f76e22a-6133-4d36-a598-ba28635324ea service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Received event network-vif-plugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b52ea237-5d20-4936-97e1-085e0d5eec9a req-4f76e22a-6133-4d36-a598-ba28635324ea service nova] Acquiring lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b52ea237-5d20-4936-97e1-085e0d5eec9a req-4f76e22a-6133-4d36-a598-ba28635324ea service nova] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b52ea237-5d20-4936-97e1-085e0d5eec9a req-4f76e22a-6133-4d36-a598-ba28635324ea service nova] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.compute.manager [req-b52ea237-5d20-4936-97e1-085e0d5eec9a req-4f76e22a-6133-4d36-a598-ba28635324ea service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] No waiting events found dispatching network-vif-plugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:33 user nova-compute[74776]: WARNING nova.compute.manager [req-b52ea237-5d20-4936-97e1-085e0d5eec9a req-4f76e22a-6133-4d36-a598-ba28635324ea service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Received unexpected event network-vif-plugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 for instance with vm_state active and task_state None.
Nov 22 14:23:33 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:23:33 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:23:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-935050610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-935050610',id=21,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d359aba8e95e4090a02fb0a46012f20b',ramdisk_id='',reservation_id='r-yqi145qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-202976361',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:23:32Z,user_data=None,user_id='dea876275c70471d9cba1c3158bd63e2',uuid=f4f30fe7-b234-4f81-b081-3214f5ebe789,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "address": "fa:16:3e:46:10:91", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669801ba-1e", "ovs_interfaceid": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converting VIF {"id": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "address": "fa:16:3e:46:10:91", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669801ba-1e", "ovs_interfaceid": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:10:91,bridge_name='br-int',has_traffic_filtering=True,id=669801ba-1e1d-4ef3-bad3-d1961e58f5af,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap669801ba-1e') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.objects.instance [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'pci_devices' on Instance uuid f4f30fe7-b234-4f81-b081-3214f5ebe789 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ba86c78-a2ed-4c5b-84da-10764f3d5c92 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.108s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:23:33 user nova-compute[74776]:   <uuid>f4f30fe7-b234-4f81-b081-3214f5ebe789</uuid>
Nov 22 14:23:33 user nova-compute[74776]:   <name>instance-00000015</name>
Nov 22 14:23:33 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:23:33 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:23:33 user nova-compute[74776]:   <metadata>
Nov 22 14:23:33 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:23:33 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:23:33 user nova-compute[74776]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-935050610</nova:name>
Nov 22 14:23:33 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:23:33</nova:creationTime>
Nov 22 14:23:33 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:23:33 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:23:33 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:23:33 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:23:33 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:23:33 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:23:33 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:23:33 user nova-compute[74776]:       <nova:owner>
Nov 22 14:23:33 user nova-compute[74776]:         <nova:user uuid="dea876275c70471d9cba1c3158bd63e2">tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member</nova:user>
Nov 22 14:23:33 user nova-compute[74776]:         <nova:project uuid="d359aba8e95e4090a02fb0a46012f20b">tempest-ServerBootFromVolumeStableRescueTest-202976361</nova:project>
Nov 22 14:23:33 user nova-compute[74776]:       </nova:owner>
Nov 22 14:23:33 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:23:33 user nova-compute[74776]:       <nova:ports>
Nov 22 14:23:33 user nova-compute[74776]:         <nova:port uuid="669801ba-1e1d-4ef3-bad3-d1961e58f5af">
Nov 22 14:23:33 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 22 14:23:33 user nova-compute[74776]:         </nova:port>
Nov 22 14:23:33 user nova-compute[74776]:       </nova:ports>
Nov 22 14:23:33 user nova-compute[74776]:     </nova:instance>
Nov 22 14:23:33 user nova-compute[74776]:   </metadata>
Nov 22 14:23:33 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:23:33 user nova-compute[74776]:     <system>
Nov 22 14:23:33 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:23:33 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:23:33 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:23:33 user nova-compute[74776]:       <entry name="serial">f4f30fe7-b234-4f81-b081-3214f5ebe789</entry>
Nov 22 14:23:33 user nova-compute[74776]:       <entry name="uuid">f4f30fe7-b234-4f81-b081-3214f5ebe789</entry>
Nov 22 14:23:33 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:23:33 user nova-compute[74776]:     </system>
Nov 22 14:23:33 user nova-compute[74776]:   </sysinfo>
Nov 22 14:23:33 user nova-compute[74776]:   <os>
Nov 22 14:23:33 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:23:33 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:23:33 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:23:33 user nova-compute[74776]:   </os>
Nov 22 14:23:33 user nova-compute[74776]:   <features>
Nov 22 14:23:33 user nova-compute[74776]:     <acpi/>
Nov 22 14:23:33 user nova-compute[74776]:     <apic/>
Nov 22 14:23:33 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:23:33 user nova-compute[74776]:   </features>
Nov 22 14:23:33 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:23:33 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:23:33 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:23:33 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:23:33 user nova-compute[74776]:   </clock>
Nov 22 14:23:33 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:23:33 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:23:33 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:23:33 user nova-compute[74776]:   </cpu>
Nov 22 14:23:33 user nova-compute[74776]:   <devices>
Nov 22 14:23:33 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:23:33 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:23:33 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk"/>
Nov 22 14:23:33 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:23:33 user nova-compute[74776]:     </disk>
Nov 22 14:23:33 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:23:33 user nova-compute[74776]:       <mac address="fa:16:3e:46:10:91"/>
Nov 22 14:23:33 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:23:33 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:23:33 user nova-compute[74776]:       <target dev="tap669801ba-1e"/>
Nov 22 14:23:33 user nova-compute[74776]:     </interface>
Nov 22 14:23:33 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:23:33 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/console.log" append="off"/>
Nov 22 14:23:33 user nova-compute[74776]:     </serial>
Nov 22 14:23:33 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:23:33 user nova-compute[74776]:     <video>
Nov 22 14:23:33 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:23:33 user nova-compute[74776]:     </video>
Nov 22 14:23:33 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:23:33 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:23:33 user nova-compute[74776]:     </rng>
Nov 22 14:23:33 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:23:33 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:23:33 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:23:33 user nova-compute[74776]:     </memballoon>
Nov 22 14:23:33 user nova-compute[74776]:   </devices>
Nov 22 14:23:33 user nova-compute[74776]: </domain>
Nov 22 14:23:33 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:23:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-935050610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-935050610',id=21,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d359aba8e95e4090a02fb0a46012f20b',ramdisk_id='',reservation_id='r-yqi145qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-202976361',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:23:32Z,user_data=None,user_id='dea876275c70471d9cba1c3158bd63e2',uuid=f4f30fe7-b234-4f81-b081-3214f5ebe789,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "address": "fa:16:3e:46:10:91", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669801ba-1e", "ovs_interfaceid": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converting VIF {"id": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "address": "fa:16:3e:46:10:91", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669801ba-1e", "ovs_interfaceid": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:10:91,bridge_name='br-int',has_traffic_filtering=True,id=669801ba-1e1d-4ef3-bad3-d1961e58f5af,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap669801ba-1e') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG os_vif [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:10:91,bridge_name='br-int',has_traffic_filtering=True,id=669801ba-1e1d-4ef3-bad3-d1961e58f5af,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap669801ba-1e') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7499c630-5d87-5c34-8171-7f327116289d', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap669801ba-1e, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap669801ba-1e, col_values=(('qos', UUID('7341e2c1-6aa2-4d5c-9ac6-a55e502a6a6a')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap669801ba-1e, col_values=(('external_ids', {'iface-id': '669801ba-1e1d-4ef3-bad3-d1961e58f5af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:10:91', 'vm-uuid': 'f4f30fe7-b234-4f81-b081-3214f5ebe789'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:23:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:33 user nova-compute[74776]: INFO os_vif [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:10:91,bridge_name='br-int',has_traffic_filtering=True,id=669801ba-1e1d-4ef3-bad3-d1961e58f5af,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap669801ba-1e')
Nov 22 14:23:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:23:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] No VIF found with MAC fa:16:3e:46:10:91, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:23:34 user nova-compute[74776]: DEBUG nova.compute.manager [req-d55659b0-a434-42d0-b3bb-6d1281b0bb07 req-74811de0-963b-43ee-a837-ff719111e505 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-changed-a9601d6f-cfc5-47b5-8260-414d5ac1157f {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:34 user nova-compute[74776]: DEBUG nova.compute.manager [req-d55659b0-a434-42d0-b3bb-6d1281b0bb07 req-74811de0-963b-43ee-a837-ff719111e505 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Refreshing instance network info cache due to event network-changed-a9601d6f-cfc5-47b5-8260-414d5ac1157f. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:23:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d55659b0-a434-42d0-b3bb-6d1281b0bb07 req-74811de0-963b-43ee-a837-ff719111e505 service nova] Acquiring lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:23:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d55659b0-a434-42d0-b3bb-6d1281b0bb07 req-74811de0-963b-43ee-a837-ff719111e505 service nova] Acquired lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:23:34 user nova-compute[74776]: DEBUG nova.network.neutron [req-d55659b0-a434-42d0-b3bb-6d1281b0bb07 req-74811de0-963b-43ee-a837-ff719111e505 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Refreshing network info cache for port a9601d6f-cfc5-47b5-8260-414d5ac1157f {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:23:34 user nova-compute[74776]: DEBUG nova.network.neutron [req-129e40fb-3c98-41f0-a1c8-04bdb25acd40 req-6cabfae0-fd66-4b8f-b9ff-0f546cd3934c service nova] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Updated VIF entry in instance network info cache for port 669801ba-1e1d-4ef3-bad3-d1961e58f5af. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:23:34 user nova-compute[74776]: DEBUG nova.network.neutron [req-129e40fb-3c98-41f0-a1c8-04bdb25acd40 req-6cabfae0-fd66-4b8f-b9ff-0f546cd3934c service nova] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Updating instance_info_cache with network_info: [{"id": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "address": "fa:16:3e:46:10:91", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669801ba-1e", "ovs_interfaceid": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:23:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-129e40fb-3c98-41f0-a1c8-04bdb25acd40 req-6cabfae0-fd66-4b8f-b9ff-0f546cd3934c service nova] Releasing lock "refresh_cache-f4f30fe7-b234-4f81-b081-3214f5ebe789" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:23:34 user nova-compute[74776]: DEBUG nova.network.neutron [req-d55659b0-a434-42d0-b3bb-6d1281b0bb07 req-74811de0-963b-43ee-a837-ff719111e505 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Updated VIF entry in instance network info cache for port a9601d6f-cfc5-47b5-8260-414d5ac1157f. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:23:34 user nova-compute[74776]: DEBUG nova.network.neutron [req-d55659b0-a434-42d0-b3bb-6d1281b0bb07 req-74811de0-963b-43ee-a837-ff719111e505 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Updating instance_info_cache with network_info: [{"id": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "address": "fa:16:3e:c7:ba:0a", "network": {"id": "10549d92-6312-459c-b167-bdd2396d9c88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1836352595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9601d6f-cf", "ovs_interfaceid": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81b8bd85-da35-47cb-880f-6b3de9efd406", "address": "fa:16:3e:59:13:7f", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b8bd85-da", "ovs_interfaceid": "81b8bd85-da35-47cb-880f-6b3de9efd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "address": "fa:16:3e:92:19:97", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6ff5ee-91", "ovs_interfaceid": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e631b486-fff8-4c8b-b688-138a941b0440", "address": "fa:16:3e:47:e8:14", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape631b486-ff", "ovs_interfaceid": "e631b486-fff8-4c8b-b688-138a941b0440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c7053999-2290-4f4e-a386-1ffc306de05a", "address": "fa:16:3e:3b:bf:db", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7053999-22", "ovs_interfaceid": "c7053999-2290-4f4e-a386-1ffc306de05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6f96288-8194-465b-90bd-640ecaec56e4", "address": "fa:16:3e:53:9d:81", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f96288-81", "ovs_interfaceid": "e6f96288-8194-465b-90bd-640ecaec56e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "address": "fa:16:3e:dd:3e:54", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0b6445-b3", "ovs_interfaceid": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:23:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d55659b0-a434-42d0-b3bb-6d1281b0bb07 req-74811de0-963b-43ee-a837-ff719111e505 service nova] Releasing lock "refresh_cache-84dbab20-fe7f-4b9e-bc02-6c739029f69d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:23:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:36 user nova-compute[74776]: DEBUG nova.compute.manager [req-cb6d3673-f8b1-48d6-804e-71ef1bfce893 req-badf05c2-12d2-478f-b61c-2130d2180db6 service nova] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Received event network-vif-plugged-669801ba-1e1d-4ef3-bad3-d1961e58f5af {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cb6d3673-f8b1-48d6-804e-71ef1bfce893 req-badf05c2-12d2-478f-b61c-2130d2180db6 service nova] Acquiring lock "f4f30fe7-b234-4f81-b081-3214f5ebe789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cb6d3673-f8b1-48d6-804e-71ef1bfce893 req-badf05c2-12d2-478f-b61c-2130d2180db6 service nova] Lock "f4f30fe7-b234-4f81-b081-3214f5ebe789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cb6d3673-f8b1-48d6-804e-71ef1bfce893 req-badf05c2-12d2-478f-b61c-2130d2180db6 service nova] Lock "f4f30fe7-b234-4f81-b081-3214f5ebe789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:36 user nova-compute[74776]: DEBUG nova.compute.manager [req-cb6d3673-f8b1-48d6-804e-71ef1bfce893 req-badf05c2-12d2-478f-b61c-2130d2180db6 service nova] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] No waiting events found dispatching network-vif-plugged-669801ba-1e1d-4ef3-bad3-d1961e58f5af {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:36 user nova-compute[74776]: WARNING nova.compute.manager [req-cb6d3673-f8b1-48d6-804e-71ef1bfce893 req-badf05c2-12d2-478f-b61c-2130d2180db6 service nova] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Received unexpected event network-vif-plugged-669801ba-1e1d-4ef3-bad3-d1961e58f5af for instance with vm_state building and task_state spawning.
Nov 22 14:23:36 user nova-compute[74776]: DEBUG nova.compute.manager [req-cb6d3673-f8b1-48d6-804e-71ef1bfce893 req-badf05c2-12d2-478f-b61c-2130d2180db6 service nova] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Received event network-vif-plugged-669801ba-1e1d-4ef3-bad3-d1961e58f5af {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cb6d3673-f8b1-48d6-804e-71ef1bfce893 req-badf05c2-12d2-478f-b61c-2130d2180db6 service nova] Acquiring lock "f4f30fe7-b234-4f81-b081-3214f5ebe789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cb6d3673-f8b1-48d6-804e-71ef1bfce893 req-badf05c2-12d2-478f-b61c-2130d2180db6 service nova] Lock "f4f30fe7-b234-4f81-b081-3214f5ebe789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cb6d3673-f8b1-48d6-804e-71ef1bfce893 req-badf05c2-12d2-478f-b61c-2130d2180db6 service nova] Lock "f4f30fe7-b234-4f81-b081-3214f5ebe789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:36 user nova-compute[74776]: DEBUG nova.compute.manager [req-cb6d3673-f8b1-48d6-804e-71ef1bfce893 req-badf05c2-12d2-478f-b61c-2130d2180db6 service nova] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] No waiting events found dispatching network-vif-plugged-669801ba-1e1d-4ef3-bad3-d1961e58f5af {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:36 user nova-compute[74776]: WARNING nova.compute.manager [req-cb6d3673-f8b1-48d6-804e-71ef1bfce893 req-badf05c2-12d2-478f-b61c-2130d2180db6 service nova] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Received unexpected event network-vif-plugged-669801ba-1e1d-4ef3-bad3-d1961e58f5af for instance with vm_state building and task_state spawning.
Nov 22 14:23:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:36 user nova-compute[74776]: INFO nova.compute.manager [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Terminating instance
Nov 22 14:23:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG nova.compute.manager [req-8deaae6e-cff8-4ef9-b373-23a96c12323a req-8afb0d70-0bbd-4b4c-bbff-505f9a0e7d09 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-unplugged-a9601d6f-cfc5-47b5-8260-414d5ac1157f {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8deaae6e-cff8-4ef9-b373-23a96c12323a req-8afb0d70-0bbd-4b4c-bbff-505f9a0e7d09 service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8deaae6e-cff8-4ef9-b373-23a96c12323a req-8afb0d70-0bbd-4b4c-bbff-505f9a0e7d09 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8deaae6e-cff8-4ef9-b373-23a96c12323a req-8afb0d70-0bbd-4b4c-bbff-505f9a0e7d09 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG nova.compute.manager [req-8deaae6e-cff8-4ef9-b373-23a96c12323a req-8afb0d70-0bbd-4b4c-bbff-505f9a0e7d09 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-unplugged-a9601d6f-cfc5-47b5-8260-414d5ac1157f {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG nova.compute.manager [req-8deaae6e-cff8-4ef9-b373-23a96c12323a req-8afb0d70-0bbd-4b4c-bbff-505f9a0e7d09 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-unplugged-a9601d6f-cfc5-47b5-8260-414d5ac1157f for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG nova.compute.manager [req-ad041fbc-ab4b-40d8-bb0a-3b7652962682 req-252a9146-e71a-406f-8230-9f4e3f83aa9a service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-unplugged-df6ff5ee-9150-4078-8357-caeb01f35ff8 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ad041fbc-ab4b-40d8-bb0a-3b7652962682 req-252a9146-e71a-406f-8230-9f4e3f83aa9a service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ad041fbc-ab4b-40d8-bb0a-3b7652962682 req-252a9146-e71a-406f-8230-9f4e3f83aa9a service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ad041fbc-ab4b-40d8-bb0a-3b7652962682 req-252a9146-e71a-406f-8230-9f4e3f83aa9a service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG nova.compute.manager [req-ad041fbc-ab4b-40d8-bb0a-3b7652962682 req-252a9146-e71a-406f-8230-9f4e3f83aa9a service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-unplugged-df6ff5ee-9150-4078-8357-caeb01f35ff8 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG nova.compute.manager [req-ad041fbc-ab4b-40d8-bb0a-3b7652962682 req-252a9146-e71a-406f-8230-9f4e3f83aa9a service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-unplugged-df6ff5ee-9150-4078-8357-caeb01f35ff8 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG nova.compute.manager [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:23:37 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Instance spawned successfully.
Nov 22 14:23:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:37 user nova-compute[74776]: INFO nova.compute.manager [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 22 14:23:37 user nova-compute[74776]: DEBUG nova.compute.manager [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:23:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:38 user nova-compute[74776]: INFO nova.compute.manager [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Took 6.34 seconds to build instance.
Nov 22 14:23:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-edf09b66-891d-44bc-88b1-bea6b694ff82 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "f4f30fe7-b234-4f81-b081-3214f5ebe789" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.550s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG nova.compute.manager [req-c7bfaa27-61e6-43a7-b306-bc87959ed144 req-9cad7c09-6b91-44b9-b0fc-10228873a84c service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-unplugged-0f0b6445-b307-4db8-ae22-121bdc8777c6 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c7bfaa27-61e6-43a7-b306-bc87959ed144 req-9cad7c09-6b91-44b9-b0fc-10228873a84c service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c7bfaa27-61e6-43a7-b306-bc87959ed144 req-9cad7c09-6b91-44b9-b0fc-10228873a84c service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c7bfaa27-61e6-43a7-b306-bc87959ed144 req-9cad7c09-6b91-44b9-b0fc-10228873a84c service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG nova.compute.manager [req-c7bfaa27-61e6-43a7-b306-bc87959ed144 req-9cad7c09-6b91-44b9-b0fc-10228873a84c service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-unplugged-0f0b6445-b307-4db8-ae22-121bdc8777c6 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG nova.compute.manager [req-c7bfaa27-61e6-43a7-b306-bc87959ed144 req-9cad7c09-6b91-44b9-b0fc-10228873a84c service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-unplugged-0f0b6445-b307-4db8-ae22-121bdc8777c6 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG nova.compute.manager [req-c7bfaa27-61e6-43a7-b306-bc87959ed144 req-9cad7c09-6b91-44b9-b0fc-10228873a84c service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-plugged-0f0b6445-b307-4db8-ae22-121bdc8777c6 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c7bfaa27-61e6-43a7-b306-bc87959ed144 req-9cad7c09-6b91-44b9-b0fc-10228873a84c service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c7bfaa27-61e6-43a7-b306-bc87959ed144 req-9cad7c09-6b91-44b9-b0fc-10228873a84c service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c7bfaa27-61e6-43a7-b306-bc87959ed144 req-9cad7c09-6b91-44b9-b0fc-10228873a84c service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG nova.compute.manager [req-c7bfaa27-61e6-43a7-b306-bc87959ed144 req-9cad7c09-6b91-44b9-b0fc-10228873a84c service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-plugged-0f0b6445-b307-4db8-ae22-121bdc8777c6 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:38 user nova-compute[74776]: WARNING nova.compute.manager [req-c7bfaa27-61e6-43a7-b306-bc87959ed144 req-9cad7c09-6b91-44b9-b0fc-10228873a84c service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received unexpected event network-vif-plugged-0f0b6445-b307-4db8-ae22-121bdc8777c6 for instance with vm_state active and task_state deleting.
Nov 22 14:23:38 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Instance destroyed successfully.
Nov 22 14:23:38 user nova-compute[74776]: DEBUG nova.objects.instance [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lazy-loading 'resources' on Instance uuid 84dbab20-fe7f-4b9e-bc02-6c739029f69d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-404720208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-404720208',id=19,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9gPq9VvMiaCjz4jYQfD2X7t/kdIY759yEoUNDsiedT8w0+KrpqXNAWDUJBS32NG8AcPT9hsMwWnSuTON9ZI8QrT5b4OI2633ygBIkQus263nx/aRlzu77alZ84xwlRow==',key_name='tempest-keypair-1960061017',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:22:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c09ea5e02a3340b0b2326971a28fd88a',ramdisk_id='',reservation_id='r-ul5083f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1402092407',owner_user_name='tempest-TaggedBootDevicesTest-1402092407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:22:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3997118da5d641489bf9e772eabc156e',uuid=84dbab20-fe7f-4b9e-bc02-6c739029f69d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "address": "fa:16:3e:c7:ba:0a", "network": {"id": "10549d92-6312-459c-b167-bdd2396d9c88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1836352595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9601d6f-cf", "ovs_interfaceid": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converting VIF {"id": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "address": "fa:16:3e:c7:ba:0a", "network": {"id": "10549d92-6312-459c-b167-bdd2396d9c88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1836352595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9601d6f-cf", "ovs_interfaceid": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:ba:0a,bridge_name='br-int',has_traffic_filtering=True,id=a9601d6f-cfc5-47b5-8260-414d5ac1157f,network=Network(10549d92-6312-459c-b167-bdd2396d9c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9601d6f-cf') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG os_vif [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:ba:0a,bridge_name='br-int',has_traffic_filtering=True,id=a9601d6f-cfc5-47b5-8260-414d5ac1157f,network=Network(10549d92-6312-459c-b167-bdd2396d9c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9601d6f-cf') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9601d6f-cf, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b32a9eeb-c5a1-47d4-86a3-dd95c3ac9f4c) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:38 user nova-compute[74776]: INFO os_vif [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:ba:0a,bridge_name='br-int',has_traffic_filtering=True,id=a9601d6f-cfc5-47b5-8260-414d5ac1157f,network=Network(10549d92-6312-459c-b167-bdd2396d9c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9601d6f-cf')
Nov 22 14:23:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-404720208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-404720208',id=19,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9gPq9VvMiaCjz4jYQfD2X7t/kdIY759yEoUNDsiedT8w0+KrpqXNAWDUJBS32NG8AcPT9hsMwWnSuTON9ZI8QrT5b4OI2633ygBIkQus263nx/aRlzu77alZ84xwlRow==',key_name='tempest-keypair-1960061017',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:22:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c09ea5e02a3340b0b2326971a28fd88a',ramdisk_id='',reservation_id='r-ul5083f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1402092407',owner_user_name='tempest-TaggedBootDevicesTest-1402092407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:22:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3997118da5d641489bf9e772eabc156e',uuid=84dbab20-fe7f-4b9e-bc02-6c739029f69d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81b8bd85-da35-47cb-880f-6b3de9efd406", "address": "fa:16:3e:59:13:7f", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b8bd85-da", "ovs_interfaceid": "81b8bd85-da35-47cb-880f-6b3de9efd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converting VIF {"id": "81b8bd85-da35-47cb-880f-6b3de9efd406", "address": "fa:16:3e:59:13:7f", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b8bd85-da", "ovs_interfaceid": "81b8bd85-da35-47cb-880f-6b3de9efd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:13:7f,bridge_name='br-int',has_traffic_filtering=True,id=81b8bd85-da35-47cb-880f-6b3de9efd406,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap81b8bd85-da') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG os_vif [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:13:7f,bridge_name='br-int',has_traffic_filtering=True,id=81b8bd85-da35-47cb-880f-6b3de9efd406,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap81b8bd85-da') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81b8bd85-da, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=17ce8286-9c6e-4407-82b7-d7c9c4d01804) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: INFO os_vif [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:13:7f,bridge_name='br-int',has_traffic_filtering=True,id=81b8bd85-da35-47cb-880f-6b3de9efd406,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap81b8bd85-da')
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-404720208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-404720208',id=19,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9gPq9VvMiaCjz4jYQfD2X7t/kdIY759yEoUNDsiedT8w0+KrpqXNAWDUJBS32NG8AcPT9hsMwWnSuTON9ZI8QrT5b4OI2633ygBIkQus263nx/aRlzu77alZ84xwlRow==',key_name='tempest-keypair-1960061017',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:22:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c09ea5e02a3340b0b2326971a28fd88a',ramdisk_id='',reservation_id='r-ul5083f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1402092407',owner_user_name='tempest-TaggedBootDevicesTest-1402092407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:22:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3997118da5d641489bf9e772eabc156e',uuid=84dbab20-fe7f-4b9e-bc02-6c739029f69d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "address": "fa:16:3e:92:19:97", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6ff5ee-91", "ovs_interfaceid": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converting VIF {"id": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "address": "fa:16:3e:92:19:97", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6ff5ee-91", "ovs_interfaceid": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:19:97,bridge_name='br-int',has_traffic_filtering=True,id=df6ff5ee-9150-4078-8357-caeb01f35ff8,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdf6ff5ee-91') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_vif [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:19:97,bridge_name='br-int',has_traffic_filtering=True,id=df6ff5ee-9150-4078-8357-caeb01f35ff8,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdf6ff5ee-91') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf6ff5ee-91, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5aba6e20-b3e5-49fb-afe2-0ee4f8ee3b2a) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: INFO os_vif [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:19:97,bridge_name='br-int',has_traffic_filtering=True,id=df6ff5ee-9150-4078-8357-caeb01f35ff8,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdf6ff5ee-91')
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-404720208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-404720208',id=19,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9gPq9VvMiaCjz4jYQfD2X7t/kdIY759yEoUNDsiedT8w0+KrpqXNAWDUJBS32NG8AcPT9hsMwWnSuTON9ZI8QrT5b4OI2633ygBIkQus263nx/aRlzu77alZ84xwlRow==',key_name='tempest-keypair-1960061017',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:22:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c09ea5e02a3340b0b2326971a28fd88a',ramdisk_id='',reservation_id='r-ul5083f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1402092407',owner_user_name='tempest-TaggedBootDevicesTest-1402092407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:22:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3997118da5d641489bf9e772eabc156e',uuid=84dbab20-fe7f-4b9e-bc02-6c739029f69d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e631b486-fff8-4c8b-b688-138a941b0440", "address": "fa:16:3e:47:e8:14", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape631b486-ff", "ovs_interfaceid": "e631b486-fff8-4c8b-b688-138a941b0440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converting VIF {"id": "e631b486-fff8-4c8b-b688-138a941b0440", "address": "fa:16:3e:47:e8:14", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape631b486-ff", "ovs_interfaceid": "e631b486-fff8-4c8b-b688-138a941b0440", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:e8:14,bridge_name='br-int',has_traffic_filtering=True,id=e631b486-fff8-4c8b-b688-138a941b0440,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape631b486-ff') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_vif [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:e8:14,bridge_name='br-int',has_traffic_filtering=True,id=e631b486-fff8-4c8b-b688-138a941b0440,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape631b486-ff') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape631b486-ff, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=efd76e1f-1059-4154-a25e-69142c94f8ff) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: INFO os_vif [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:e8:14,bridge_name='br-int',has_traffic_filtering=True,id=e631b486-fff8-4c8b-b688-138a941b0440,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape631b486-ff')
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-404720208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-404720208',id=19,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9gPq9VvMiaCjz4jYQfD2X7t/kdIY759yEoUNDsiedT8w0+KrpqXNAWDUJBS32NG8AcPT9hsMwWnSuTON9ZI8QrT5b4OI2633ygBIkQus263nx/aRlzu77alZ84xwlRow==',key_name='tempest-keypair-1960061017',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:22:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c09ea5e02a3340b0b2326971a28fd88a',ramdisk_id='',reservation_id='r-ul5083f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1402092407',owner_user_name='tempest-TaggedBootDevicesTest-1402092407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:22:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3997118da5d641489bf9e772eabc156e',uuid=84dbab20-fe7f-4b9e-bc02-6c739029f69d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7053999-2290-4f4e-a386-1ffc306de05a", "address": "fa:16:3e:3b:bf:db", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7053999-22", "ovs_interfaceid": "c7053999-2290-4f4e-a386-1ffc306de05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converting VIF {"id": "c7053999-2290-4f4e-a386-1ffc306de05a", "address": "fa:16:3e:3b:bf:db", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7053999-22", "ovs_interfaceid": "c7053999-2290-4f4e-a386-1ffc306de05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bf:db,bridge_name='br-int',has_traffic_filtering=True,id=c7053999-2290-4f4e-a386-1ffc306de05a,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7053999-22') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_vif [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bf:db,bridge_name='br-int',has_traffic_filtering=True,id=c7053999-2290-4f4e-a386-1ffc306de05a,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7053999-22') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7053999-22, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a07421bf-c143-4fb8-89cf-9c7d1c62c68f) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: INFO os_vif [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bf:db,bridge_name='br-int',has_traffic_filtering=True,id=c7053999-2290-4f4e-a386-1ffc306de05a,network=Network(dfac7dba-79ff-445b-ba5b-400b5eccb749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7053999-22')
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-404720208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-404720208',id=19,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9gPq9VvMiaCjz4jYQfD2X7t/kdIY759yEoUNDsiedT8w0+KrpqXNAWDUJBS32NG8AcPT9hsMwWnSuTON9ZI8QrT5b4OI2633ygBIkQus263nx/aRlzu77alZ84xwlRow==',key_name='tempest-keypair-1960061017',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:22:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c09ea5e02a3340b0b2326971a28fd88a',ramdisk_id='',reservation_id='r-ul5083f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1402092407',owner_user_name='tempest-TaggedBootDevicesTest-1402092407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:22:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3997118da5d641489bf9e772eabc156e',uuid=84dbab20-fe7f-4b9e-bc02-6c739029f69d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6f96288-8194-465b-90bd-640ecaec56e4", "address": "fa:16:3e:53:9d:81", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f96288-81", "ovs_interfaceid": "e6f96288-8194-465b-90bd-640ecaec56e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converting VIF {"id": "e6f96288-8194-465b-90bd-640ecaec56e4", "address": "fa:16:3e:53:9d:81", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f96288-81", "ovs_interfaceid": "e6f96288-8194-465b-90bd-640ecaec56e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:9d:81,bridge_name='br-int',has_traffic_filtering=True,id=e6f96288-8194-465b-90bd-640ecaec56e4,network=Network(01e2dcf7-2a81-4621-b5d8-254a7ef53b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6f96288-81') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_vif [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:9d:81,bridge_name='br-int',has_traffic_filtering=True,id=e6f96288-8194-465b-90bd-640ecaec56e4,network=Network(01e2dcf7-2a81-4621-b5d8-254a7ef53b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6f96288-81') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6f96288-81, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38953088-0568-4ccb-a08e-720e5d390b18) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: INFO os_vif [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:9d:81,bridge_name='br-int',has_traffic_filtering=True,id=e6f96288-8194-465b-90bd-640ecaec56e4,network=Network(01e2dcf7-2a81-4621-b5d8-254a7ef53b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6f96288-81')
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-22T14:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-404720208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-404720208',id=19,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9gPq9VvMiaCjz4jYQfD2X7t/kdIY759yEoUNDsiedT8w0+KrpqXNAWDUJBS32NG8AcPT9hsMwWnSuTON9ZI8QrT5b4OI2633ygBIkQus263nx/aRlzu77alZ84xwlRow==',key_name='tempest-keypair-1960061017',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:22:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c09ea5e02a3340b0b2326971a28fd88a',ramdisk_id='',reservation_id='r-ul5083f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1402092407',owner_user_name='tempest-TaggedBootDevicesTest-1402092407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:22:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3997118da5d641489bf9e772eabc156e',uuid=84dbab20-fe7f-4b9e-bc02-6c739029f69d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "address": "fa:16:3e:dd:3e:54", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0b6445-b3", "ovs_interfaceid": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converting VIF {"id": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "address": "fa:16:3e:dd:3e:54", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0b6445-b3", "ovs_interfaceid": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:3e:54,bridge_name='br-int',has_traffic_filtering=True,id=0f0b6445-b307-4db8-ae22-121bdc8777c6,network=Network(01e2dcf7-2a81-4621-b5d8-254a7ef53b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0b6445-b3') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_vif [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:3e:54,bridge_name='br-int',has_traffic_filtering=True,id=0f0b6445-b307-4db8-ae22-121bdc8777c6,network=Network(01e2dcf7-2a81-4621-b5d8-254a7ef53b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0b6445-b3') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f0b6445-b3, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69c32532-f5df-45f9-bcfa-28a75b90d153) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:39 user nova-compute[74776]: INFO os_vif [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:3e:54,bridge_name='br-int',has_traffic_filtering=True,id=0f0b6445-b307-4db8-ae22-121bdc8777c6,network=Network(01e2dcf7-2a81-4621-b5d8-254a7ef53b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0b6445-b3')
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AFuQCvIb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:23:39 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad2744a-a0e3-4979-9552-ba32228543e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:23:39 user nova-compute[74776]: No targets found.
Nov 22 14:23:39 user nova-compute[74776]: iSNS:
Nov 22 14:23:39 user nova-compute[74776]: No targets found.
Nov 22 14:23:39 user nova-compute[74776]: STATIC:
Nov 22 14:23:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848
Nov 22 14:23:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a
Nov 22 14:23:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3
Nov 22 14:23:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c
Nov 22 14:23:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f
Nov 22 14:23:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3
Nov 22 14:23:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f
Nov 22 14:23:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:39 user nova-compute[74776]: FIRMWARE:
Nov 22 14:23:39 user nova-compute[74776]: No targets found.
Nov 22 14:23:39 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:23:39 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:23:39 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f79710b-e1b7-409d-ad9c-164e5946f167]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61ff7b1-d69d-4eaf-9483-7ab3d1c74b9a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:23:39 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:23:39 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c784ce200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f'): ({'sdg'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Removing single pathed devices sdg {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bd52b2-ad64-4659-9991-7b42ea66e458]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-plugged-a9601d6f-cfc5-47b5-8260-414d5ac1157f {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-plugged-a9601d6f-cfc5-47b5-8260-414d5ac1157f {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:39 user nova-compute[74776]: WARNING nova.compute.manager [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received unexpected event network-vif-plugged-a9601d6f-cfc5-47b5-8260-414d5ac1157f for instance with vm_state active and task_state deleting.
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-unplugged-81b8bd85-da35-47cb-880f-6b3de9efd406 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-unplugged-81b8bd85-da35-47cb-880f-6b3de9efd406 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-unplugged-81b8bd85-da35-47cb-880f-6b3de9efd406 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-plugged-81b8bd85-da35-47cb-880f-6b3de9efd406 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-plugged-81b8bd85-da35-47cb-880f-6b3de9efd406 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:39 user nova-compute[74776]: WARNING nova.compute.manager [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received unexpected event network-vif-plugged-81b8bd85-da35-47cb-880f-6b3de9efd406 for instance with vm_state active and task_state deleting.
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-unplugged-c7053999-2290-4f4e-a386-1ffc306de05a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-unplugged-c7053999-2290-4f4e-a386-1ffc306de05a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-unplugged-c7053999-2290-4f4e-a386-1ffc306de05a for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-plugged-c7053999-2290-4f4e-a386-1ffc306de05a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-plugged-c7053999-2290-4f4e-a386-1ffc306de05a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:39 user nova-compute[74776]: WARNING nova.compute.manager [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received unexpected event network-vif-plugged-c7053999-2290-4f4e-a386-1ffc306de05a for instance with vm_state active and task_state deleting.
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-unplugged-e6f96288-8194-465b-90bd-640ecaec56e4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-unplugged-e6f96288-8194-465b-90bd-640ecaec56e4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-unplugged-e6f96288-8194-465b-90bd-640ecaec56e4 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-plugged-e6f96288-8194-465b-90bd-640ecaec56e4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-plugged-e6f96288-8194-465b-90bd-640ecaec56e4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:39 user nova-compute[74776]: WARNING nova.compute.manager [req-7b5bf92b-1c99-4997-bf97-3d12b8878f7a req-9f13f013-c5bb-4cb9-8273-c9f4a6c1fbe1 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received unexpected event network-vif-plugged-e6f96288-8194-465b-90bd-640ecaec56e4 for instance with vm_state active and task_state deleting.
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce7826a-a24f-472c-b557-333e34100076]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Flushing IO for device /dev/sdg {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb73a7b-2ba2-409e-8f69-47ae217de41a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-377b0657-f95f-430e-9e11-ac6c5059ca2a req-1d5d30ae-d245-4b0a-9c9a-6f35fd4d0db2 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-plugged-df6ff5ee-9150-4078-8357-caeb01f35ff8 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-377b0657-f95f-430e-9e11-ac6c5059ca2a req-1d5d30ae-d245-4b0a-9c9a-6f35fd4d0db2 service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-377b0657-f95f-430e-9e11-ac6c5059ca2a req-1d5d30ae-d245-4b0a-9c9a-6f35fd4d0db2 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-377b0657-f95f-430e-9e11-ac6c5059ca2a req-1d5d30ae-d245-4b0a-9c9a-6f35fd4d0db2 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-377b0657-f95f-430e-9e11-ac6c5059ca2a req-1d5d30ae-d245-4b0a-9c9a-6f35fd4d0db2 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-plugged-df6ff5ee-9150-4078-8357-caeb01f35ff8 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:39 user nova-compute[74776]: WARNING nova.compute.manager [req-377b0657-f95f-430e-9e11-ac6c5059ca2a req-1d5d30ae-d245-4b0a-9c9a-6f35fd4d0db2 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received unexpected event network-vif-plugged-df6ff5ee-9150-4078-8357-caeb01f35ff8 for instance with vm_state active and task_state deleting.
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-377b0657-f95f-430e-9e11-ac6c5059ca2a req-1d5d30ae-d245-4b0a-9c9a-6f35fd4d0db2 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-unplugged-e631b486-fff8-4c8b-b688-138a941b0440 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-377b0657-f95f-430e-9e11-ac6c5059ca2a req-1d5d30ae-d245-4b0a-9c9a-6f35fd4d0db2 service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-377b0657-f95f-430e-9e11-ac6c5059ca2a req-1d5d30ae-d245-4b0a-9c9a-6f35fd4d0db2 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-377b0657-f95f-430e-9e11-ac6c5059ca2a req-1d5d30ae-d245-4b0a-9c9a-6f35fd4d0db2 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-377b0657-f95f-430e-9e11-ac6c5059ca2a req-1d5d30ae-d245-4b0a-9c9a-6f35fd4d0db2 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-unplugged-e631b486-fff8-4c8b-b688-138a941b0440 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-377b0657-f95f-430e-9e11-ac6c5059ca2a req-1d5d30ae-d245-4b0a-9c9a-6f35fd4d0db2 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-unplugged-e631b486-fff8-4c8b-b688-138a941b0440 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-377b0657-f95f-430e-9e11-ac6c5059ca2a req-1d5d30ae-d245-4b0a-9c9a-6f35fd4d0db2 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-plugged-e631b486-fff8-4c8b-b688-138a941b0440 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-377b0657-f95f-430e-9e11-ac6c5059ca2a req-1d5d30ae-d245-4b0a-9c9a-6f35fd4d0db2 service nova] Acquiring lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-377b0657-f95f-430e-9e11-ac6c5059ca2a req-1d5d30ae-d245-4b0a-9c9a-6f35fd4d0db2 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-377b0657-f95f-430e-9e11-ac6c5059ca2a req-1d5d30ae-d245-4b0a-9c9a-6f35fd4d0db2 service nova] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-377b0657-f95f-430e-9e11-ac6c5059ca2a req-1d5d30ae-d245-4b0a-9c9a-6f35fd4d0db2 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] No waiting events found dispatching network-vif-plugged-e631b486-fff8-4c8b-b688-138a941b0440 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:23:39 user nova-compute[74776]: WARNING nova.compute.manager [req-377b0657-f95f-430e-9e11-ac6c5059ca2a req-1d5d30ae-d245-4b0a-9c9a-6f35fd4d0db2 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received unexpected event network-vif-plugged-e631b486-fff8-4c8b-b688-138a941b0440 for instance with vm_state active and task_state deleting.
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.103s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[60367309-b53c-4604-8433-38ef14632d7d]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] SCSI volumes sdg have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[690dd584-9bd2-42e5-9218-da6dd15771ae]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c11a61-fe68-4e0c-be7d-e7a531964eaa]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f, portal: 172.16.0.220,3260]
Nov 22 14:23:39 user nova-compute[74776]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f, portal: 172.16.0.220,3260] successful.
Nov 22 14:23:39 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:504cd7d5-84cc-40ad-bbe4-009c0933038f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[321d844b-b97a-498f-b0b4-ab95d528f869]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] <== disconnect_volume: return (438ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FEWrZIgj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:23:39 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf0c41f-28bd-4edd-b0c0-0ad093bdc9a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:23:39 user nova-compute[74776]: No targets found.
Nov 22 14:23:39 user nova-compute[74776]: iSNS:
Nov 22 14:23:39 user nova-compute[74776]: No targets found.
Nov 22 14:23:39 user nova-compute[74776]: STATIC:
Nov 22 14:23:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848
Nov 22 14:23:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a
Nov 22 14:23:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3
Nov 22 14:23:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c
Nov 22 14:23:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3
Nov 22 14:23:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f
Nov 22 14:23:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:39 user nova-compute[74776]: FIRMWARE:
Nov 22 14:23:39 user nova-compute[74776]: No targets found.
Nov 22 14:23:39 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:23:39 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:23:39 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5ef79d-2dae-4efe-8739-acd9524998c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cc1351-bbb2-4800-9e79-7e7cdaba2cc3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:23:39 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:23:39 user nova-compute[74776]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:23:39 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c784ce200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848'): ({'sde'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Removing single pathed devices sde {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23bf8d5-03ad-4b60-8b51-9c6729aebf7e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[877dd79d-5e66-4a3c-af3c-b56d622378ae]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Flushing IO for device /dev/sde {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72a1327-f089-47fc-b5d3-b3159fdcf0e7]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[474f6d1b-4d18-43b0-85bf-4ca4ba90ee50]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] SCSI volumes sde have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[54de99fd-ae96-4ba0-870f-3b48dd4ebc0f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:23:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd8bf69-0d06-4b67-b80d-f591fddd135e]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848, portal: 172.16.0.220,3260]
Nov 22 14:23:40 user nova-compute[74776]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848, portal: 172.16.0.220,3260] successful.
Nov 22 14:23:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:721375eb-40a3-4db4-9ee2-a9a6d2460848 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f11cb3b-a5a6-40ee-8da0-d2283196b8be]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] <== disconnect_volume: return (341ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fuKZVYwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:23:40 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c802f029-7f71-478a-8f0b-89b3da8137ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:23:40 user nova-compute[74776]: No targets found.
Nov 22 14:23:40 user nova-compute[74776]: iSNS:
Nov 22 14:23:40 user nova-compute[74776]: No targets found.
Nov 22 14:23:40 user nova-compute[74776]: STATIC:
Nov 22 14:23:40 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a
Nov 22 14:23:40 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:40 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:40 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3
Nov 22 14:23:40 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:40 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:40 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c
Nov 22 14:23:40 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:40 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:40 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3
Nov 22 14:23:40 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:40 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:40 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f
Nov 22 14:23:40 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:23:40 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:23:40 user nova-compute[74776]: FIRMWARE:
Nov 22 14:23:40 user nova-compute[74776]: No targets found.
Nov 22 14:23:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:23:40 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:23:40 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dc9319-f11e-4c46-b8f7-d6f554da5620]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec453f11-47a3-4d70-8f0d-7b0b2042e9f3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:23:40 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:23:40 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:23:40 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:23:40 user nova-compute[74776]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:23:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a (non-flash)
Nov 22 14:23:40 user nova-compute[74776]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:23:40 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:23:40 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:23:40 user nova-compute[74776]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:23:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c582756c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a'): ({'sdc'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Removing single pathed devices sdc {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88fda91-12e5-4743-b05a-41dd152fc48f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d3f05b-812a-46fa-8490-eed38d0fbbba]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Flushing IO for device /dev/sdc {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[655d9b4c-8889-4de8-90bd-618e81676857]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9180ae23-853b-4463-a003-5337832217c8]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bddd5e-5d74-4e5c-9e81-01f987742107]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6594dc89-c091-45db-89cd-be239dd05c58]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a, portal: 172.16.0.220,3260]
Nov 22 14:23:40 user nova-compute[74776]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a, portal: 172.16.0.220,3260] successful.
Nov 22 14:23:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:929bce78-5b35-40bc-916b-a5420406834a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ed1886-8f5c-473d-98d9-5701be80dc1a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] <== disconnect_volume: return (325ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:23:40 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Deleting instance files /opt/stack/data/nova/instances/84dbab20-fe7f-4b9e-bc02-6c739029f69d_del
Nov 22 14:23:40 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Deletion of /opt/stack/data/nova/instances/84dbab20-fe7f-4b9e-bc02-6c739029f69d_del complete
Nov 22 14:23:40 user nova-compute[74776]: INFO nova.compute.manager [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Took 3.57 seconds to destroy the instance on the hypervisor.
Nov 22 14:23:40 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:23:40 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:23:42 user nova-compute[74776]: DEBUG nova.compute.manager [req-35cff01c-155f-4fb4-a578-401086033147 req-55dd5333-b154-4ef0-abe0-d9a08308e8a6 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-deleted-e631b486-fff8-4c8b-b688-138a941b0440 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:42 user nova-compute[74776]: INFO nova.compute.manager [req-35cff01c-155f-4fb4-a578-401086033147 req-55dd5333-b154-4ef0-abe0-d9a08308e8a6 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Neutron deleted interface e631b486-fff8-4c8b-b688-138a941b0440; detaching it from the instance and deleting it from the info cache
Nov 22 14:23:42 user nova-compute[74776]: DEBUG nova.network.neutron [req-35cff01c-155f-4fb4-a578-401086033147 req-55dd5333-b154-4ef0-abe0-d9a08308e8a6 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Updating instance_info_cache with network_info: [{"id": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "address": "fa:16:3e:c7:ba:0a", "network": {"id": "10549d92-6312-459c-b167-bdd2396d9c88", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1836352595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9601d6f-cf", "ovs_interfaceid": "a9601d6f-cfc5-47b5-8260-414d5ac1157f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "81b8bd85-da35-47cb-880f-6b3de9efd406", "address": "fa:16:3e:59:13:7f", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81b8bd85-da", "ovs_interfaceid": "81b8bd85-da35-47cb-880f-6b3de9efd406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "address": "fa:16:3e:92:19:97", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf6ff5ee-91", "ovs_interfaceid": "df6ff5ee-9150-4078-8357-caeb01f35ff8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c7053999-2290-4f4e-a386-1ffc306de05a", "address": "fa:16:3e:3b:bf:db", "network": {"id": "dfac7dba-79ff-445b-ba5b-400b5eccb749", "bridge": "br-int", "label": "tempest-device-tagging-net1-1255119792", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7053999-22", "ovs_interfaceid": "c7053999-2290-4f4e-a386-1ffc306de05a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6f96288-8194-465b-90bd-640ecaec56e4", "address": "fa:16:3e:53:9d:81", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6f96288-81", "ovs_interfaceid": "e6f96288-8194-465b-90bd-640ecaec56e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "address": "fa:16:3e:dd:3e:54", "network": {"id": "01e2dcf7-2a81-4621-b5d8-254a7ef53b7f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1849951285", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c09ea5e02a3340b0b2326971a28fd88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0b6445-b3", "ovs_interfaceid": "0f0b6445-b307-4db8-ae22-121bdc8777c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:23:42 user nova-compute[74776]: DEBUG nova.compute.manager [req-35cff01c-155f-4fb4-a578-401086033147 req-55dd5333-b154-4ef0-abe0-d9a08308e8a6 service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Detach interface failed, port_id=e631b486-fff8-4c8b-b688-138a941b0440, reason: Instance 84dbab20-fe7f-4b9e-bc02-6c739029f69d could not be found. {{(pid=74776) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 14:23:43 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:23:43 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Took 3.49 seconds to deallocate network for instance.
Nov 22 14:23:44 user nova-compute[74776]: DEBUG nova.compute.manager [req-8f15996f-4aa0-4ae3-ba16-757bff26c12b req-f9e1a0ff-1d2e-4029-a21d-cde8cf2849aa service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-deleted-e6f96288-8194-465b-90bd-640ecaec56e4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:44 user nova-compute[74776]: DEBUG nova.compute.manager [req-8f15996f-4aa0-4ae3-ba16-757bff26c12b req-f9e1a0ff-1d2e-4029-a21d-cde8cf2849aa service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-deleted-0f0b6445-b307-4db8-ae22-121bdc8777c6 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:44 user nova-compute[74776]: DEBUG nova.compute.manager [req-8f15996f-4aa0-4ae3-ba16-757bff26c12b req-f9e1a0ff-1d2e-4029-a21d-cde8cf2849aa service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-deleted-a9601d6f-cfc5-47b5-8260-414d5ac1157f {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:44 user nova-compute[74776]: DEBUG nova.compute.manager [req-8f15996f-4aa0-4ae3-ba16-757bff26c12b req-f9e1a0ff-1d2e-4029-a21d-cde8cf2849aa service nova] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Received event network-vif-deleted-c7053999-2290-4f4e-a386-1ffc306de05a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:23:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:46 user nova-compute[74776]: INFO nova.compute.manager [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] [instance: 84dbab20-fe7f-4b9e-bc02-6c739029f69d] Took 2.25 seconds to detach 3 volumes for instance.
Nov 22 14:23:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:23:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:23:46 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:23:46 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:23:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:46 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Deleted allocations for instance 84dbab20-fe7f-4b9e-bc02-6c739029f69d
Nov 22 14:23:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1b9f162f-c307-4099-a54b-638f1cce43f9 tempest-TaggedBootDevicesTest-1402092407 tempest-TaggedBootDevicesTest-1402092407-project-member] Lock "84dbab20-fe7f-4b9e-bc02-6c739029f69d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.888s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:23:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:23:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:08 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:24:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:09 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:24:09 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:24:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:24:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:24:09 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:24:10 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Updating instance_info_cache with network_info: [{"id": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "address": "fa:16:3e:a5:87:db", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabaa3c9b-98", "ovs_interfaceid": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:24:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:24:10 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:24:10 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:24:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:10 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:24:11 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:24:11 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:24:11 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:24:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:11 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:24:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:24:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:24:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:24:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:24:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:15 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:24:15 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:24:16 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=7323MB free_disk=25.223743438720703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:24:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:16 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4629d82d-fd02-4a58-a535-b362b493e7c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:24:16 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 42b00137-df98-47d9-9d02-29b4707fed30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:24:16 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance d7f3ff5e-292d-4e81-af58-b9a45adfbda1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:24:16 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance e96ab1bf-6f19-4e5f-b79d-f0266988090b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:24:16 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 525baf66-82cc-4e8d-a37a-c92c51d4673d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:24:16 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6f2ce4b2-660c-431f-b951-c6ec5090ef7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:24:16 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 370f25d8-d6f4-4de8-b356-d23e6d599f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:24:16 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 97fa95f1-f856-4b65-917f-9808bac6e576 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:24:16 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4a1cf058-5290-4d09-a979-89de319f2cbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:24:16 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f4f30fe7-b234-4f81-b081-3214f5ebe789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:24:16 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:24:16 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:24:16 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:24:16 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:24:16 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:24:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:17 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:24:17 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:24:17 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:24:17 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:24:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-f6418c9a-0bf3-498d-a332-430658760969 req-d6e80b30-d00d-44c6-b5e5-e6ee0f8adbbf service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Received event network-changed-1c7ec696-a871-442f-aec4-902014c6ea9a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:24:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-f6418c9a-0bf3-498d-a332-430658760969 req-d6e80b30-d00d-44c6-b5e5-e6ee0f8adbbf service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Refreshing instance network info cache due to event network-changed-1c7ec696-a871-442f-aec4-902014c6ea9a. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:24:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f6418c9a-0bf3-498d-a332-430658760969 req-d6e80b30-d00d-44c6-b5e5-e6ee0f8adbbf service nova] Acquiring lock "refresh_cache-42b00137-df98-47d9-9d02-29b4707fed30" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:24:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f6418c9a-0bf3-498d-a332-430658760969 req-d6e80b30-d00d-44c6-b5e5-e6ee0f8adbbf service nova] Acquired lock "refresh_cache-42b00137-df98-47d9-9d02-29b4707fed30" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:24:23 user nova-compute[74776]: DEBUG nova.network.neutron [req-f6418c9a-0bf3-498d-a332-430658760969 req-d6e80b30-d00d-44c6-b5e5-e6ee0f8adbbf service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Refreshing network info cache for port 1c7ec696-a871-442f-aec4-902014c6ea9a {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:24:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "42b00137-df98-47d9-9d02-29b4707fed30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "42b00137-df98-47d9-9d02-29b4707fed30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "42b00137-df98-47d9-9d02-29b4707fed30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "42b00137-df98-47d9-9d02-29b4707fed30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "42b00137-df98-47d9-9d02-29b4707fed30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:23 user nova-compute[74776]: INFO nova.compute.manager [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Terminating instance
Nov 22 14:24:23 user nova-compute[74776]: DEBUG nova.compute.manager [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-158c6898-e2ca-46b5-b5b9-c9905c139847 req-da522794-37c2-4206-aa1d-534078a03e5a service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Received event network-vif-unplugged-1c7ec696-a871-442f-aec4-902014c6ea9a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-158c6898-e2ca-46b5-b5b9-c9905c139847 req-da522794-37c2-4206-aa1d-534078a03e5a service nova] Acquiring lock "42b00137-df98-47d9-9d02-29b4707fed30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-158c6898-e2ca-46b5-b5b9-c9905c139847 req-da522794-37c2-4206-aa1d-534078a03e5a service nova] Lock "42b00137-df98-47d9-9d02-29b4707fed30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-158c6898-e2ca-46b5-b5b9-c9905c139847 req-da522794-37c2-4206-aa1d-534078a03e5a service nova] Lock "42b00137-df98-47d9-9d02-29b4707fed30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-158c6898-e2ca-46b5-b5b9-c9905c139847 req-da522794-37c2-4206-aa1d-534078a03e5a service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] No waiting events found dispatching network-vif-unplugged-1c7ec696-a871-442f-aec4-902014c6ea9a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-158c6898-e2ca-46b5-b5b9-c9905c139847 req-da522794-37c2-4206-aa1d-534078a03e5a service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Received event network-vif-unplugged-1c7ec696-a871-442f-aec4-902014c6ea9a for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG nova.network.neutron [req-f6418c9a-0bf3-498d-a332-430658760969 req-d6e80b30-d00d-44c6-b5e5-e6ee0f8adbbf service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Updated VIF entry in instance network info cache for port 1c7ec696-a871-442f-aec4-902014c6ea9a. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG nova.network.neutron [req-f6418c9a-0bf3-498d-a332-430658760969 req-d6e80b30-d00d-44c6-b5e5-e6ee0f8adbbf service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Updating instance_info_cache with network_info: [{"id": "1c7ec696-a871-442f-aec4-902014c6ea9a", "address": "fa:16:3e:03:d6:8f", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7ec696-a8", "ovs_interfaceid": "1c7ec696-a871-442f-aec4-902014c6ea9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f6418c9a-0bf3-498d-a332-430658760969 req-d6e80b30-d00d-44c6-b5e5-e6ee0f8adbbf service nova] Releasing lock "refresh_cache-42b00137-df98-47d9-9d02-29b4707fed30" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:24:24 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Instance destroyed successfully.
Nov 22 14:24:24 user nova-compute[74776]: DEBUG nova.objects.instance [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lazy-loading 'resources' on Instance uuid 42b00137-df98-47d9-9d02-29b4707fed30 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:17:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1730019454',display_name='tempest-TestStampPattern-server-1730019454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1730019454',id=9,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwcdcEEHtV9OzSZWCbIN6wDgtlsxdHeeQue3/BMNcqHGBrCc/qx2sDq1Kmpv63TRxJ4I9ODFDrCABhThEkbpTezW8oRAjWlGjr+Las3LmrBBrpcK0n2dEwRuG9SNI1g0w==',key_name='tempest-TestStampPattern-1537282025',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='396c01f7adaa4f2dbc6963bd855597f3',ramdisk_id='',reservation_id='r-bmnk9nnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-19907094',owner_user_name='tempest-TestStampPattern-19907094-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:20:26Z,user_data=None,user_id='bdc62f686c7b496cb093b91dcd2d7e02',uuid=42b00137-df98-47d9-9d02-29b4707fed30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c7ec696-a871-442f-aec4-902014c6ea9a", "address": "fa:16:3e:03:d6:8f", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7ec696-a8", "ovs_interfaceid": "1c7ec696-a871-442f-aec4-902014c6ea9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Converting VIF {"id": "1c7ec696-a871-442f-aec4-902014c6ea9a", "address": "fa:16:3e:03:d6:8f", "network": {"id": "d8fe5b03-bd5e-42d1-b634-8150f8a9f32b", "bridge": "br-int", "label": "tempest-TestStampPattern-1966551483-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396c01f7adaa4f2dbc6963bd855597f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c7ec696-a8", "ovs_interfaceid": "1c7ec696-a871-442f-aec4-902014c6ea9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:d6:8f,bridge_name='br-int',has_traffic_filtering=True,id=1c7ec696-a871-442f-aec4-902014c6ea9a,network=Network(d8fe5b03-bd5e-42d1-b634-8150f8a9f32b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c7ec696-a8') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG os_vif [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:d6:8f,bridge_name='br-int',has_traffic_filtering=True,id=1c7ec696-a871-442f-aec4-902014c6ea9a,network=Network(d8fe5b03-bd5e-42d1-b634-8150f8a9f32b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c7ec696-a8') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c7ec696-a8, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51e62663-ef74-451c-9dc6-100ed2f3c903) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:24 user nova-compute[74776]: INFO os_vif [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:d6:8f,bridge_name='br-int',has_traffic_filtering=True,id=1c7ec696-a871-442f-aec4-902014c6ea9a,network=Network(d8fe5b03-bd5e-42d1-b634-8150f8a9f32b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c7ec696-a8')
Nov 22 14:24:24 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Deleting instance files /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30_del
Nov 22 14:24:24 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Deletion of /opt/stack/data/nova/instances/42b00137-df98-47d9-9d02-29b4707fed30_del complete
Nov 22 14:24:24 user nova-compute[74776]: INFO nova.compute.manager [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 22 14:24:24 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:24:24 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:24:25 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:24:25 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Took 0.49 seconds to deallocate network for instance.
Nov 22 14:24:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-ce5f4eef-1d51-463a-999f-752a0a56acfe req-02039b20-629b-457e-8582-f41264221408 service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Received event network-vif-deleted-1c7ec696-a871-442f-aec4-902014c6ea9a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:24:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:25 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:24:25 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:24:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:25 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Deleted allocations for instance 42b00137-df98-47d9-9d02-29b4707fed30
Nov 22 14:24:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-20e5e275-dbb4-4ade-bbef-99edc0219da3 tempest-TestStampPattern-19907094 tempest-TestStampPattern-19907094-project-member] Lock "42b00137-df98-47d9-9d02-29b4707fed30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.892s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-9a0fa2d0-997e-4a67-993a-c1f5f3567d34 req-a457e217-a487-4688-b88d-a372ceb94555 service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Received event network-vif-plugged-1c7ec696-a871-442f-aec4-902014c6ea9a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:24:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9a0fa2d0-997e-4a67-993a-c1f5f3567d34 req-a457e217-a487-4688-b88d-a372ceb94555 service nova] Acquiring lock "42b00137-df98-47d9-9d02-29b4707fed30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9a0fa2d0-997e-4a67-993a-c1f5f3567d34 req-a457e217-a487-4688-b88d-a372ceb94555 service nova] Lock "42b00137-df98-47d9-9d02-29b4707fed30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9a0fa2d0-997e-4a67-993a-c1f5f3567d34 req-a457e217-a487-4688-b88d-a372ceb94555 service nova] Lock "42b00137-df98-47d9-9d02-29b4707fed30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-9a0fa2d0-997e-4a67-993a-c1f5f3567d34 req-a457e217-a487-4688-b88d-a372ceb94555 service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] No waiting events found dispatching network-vif-plugged-1c7ec696-a871-442f-aec4-902014c6ea9a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:24:26 user nova-compute[74776]: WARNING nova.compute.manager [req-9a0fa2d0-997e-4a67-993a-c1f5f3567d34 req-a457e217-a487-4688-b88d-a372ceb94555 service nova] [instance: 42b00137-df98-47d9-9d02-29b4707fed30] Received unexpected event network-vif-plugged-1c7ec696-a871-442f-aec4-902014c6ea9a for instance with vm_state deleted and task_state None.
Nov 22 14:24:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "016bf051-9034-4124-948d-995aacf77caf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "016bf051-9034-4124-948d-995aacf77caf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:24:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:24:36 user nova-compute[74776]: INFO nova.compute.claims [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Claim successful on node user
Nov 22 14:24:36 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:24:36 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:24:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:24:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:24:36 user nova-compute[74776]: DEBUG nova.network.neutron [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:24:36 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:24:36 user nova-compute[74776]: DEBUG nova.policy [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c63eae228f99474899ce0620a4affe75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d6da4f9f4149479a779475a69c9110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:24:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:24:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:24:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:24:36 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Creating image(s)
Nov 22 14:24:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "/opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "/opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "/opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.169s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk 1073741824" returned: 0 in 0.065s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:37 user nova-compute[74776]: DEBUG nova.network.neutron [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Successfully created port: 19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:24:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.201s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:37 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Checking if we can resize image /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:24:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:37 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Cannot resize image /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:24:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:24:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Ensure instance console log exists: /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:24:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.network.neutron [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Successfully updated port: 19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "refresh_cache-016bf051-9034-4124-948d-995aacf77caf" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquired lock "refresh_cache-016bf051-9034-4124-948d-995aacf77caf" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.network.neutron [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.compute.manager [req-c782aec4-7311-4829-acf5-7440ed9d0383 req-c4b7e7a3-1d37-4e7e-8f0a-f939bea732a3 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Received event network-changed-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.compute.manager [req-c782aec4-7311-4829-acf5-7440ed9d0383 req-c4b7e7a3-1d37-4e7e-8f0a-f939bea732a3 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Refreshing instance network info cache due to event network-changed-19e9bf95-eee7-41e4-95ab-4f18f612d2c5. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c782aec4-7311-4829-acf5-7440ed9d0383 req-c4b7e7a3-1d37-4e7e-8f0a-f939bea732a3 service nova] Acquiring lock "refresh_cache-016bf051-9034-4124-948d-995aacf77caf" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.network.neutron [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.network.neutron [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Updating instance_info_cache with network_info: [{"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Releasing lock "refresh_cache-016bf051-9034-4124-948d-995aacf77caf" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Instance network_info: |[{"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c782aec4-7311-4829-acf5-7440ed9d0383 req-c4b7e7a3-1d37-4e7e-8f0a-f939bea732a3 service nova] Acquired lock "refresh_cache-016bf051-9034-4124-948d-995aacf77caf" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.network.neutron [req-c782aec4-7311-4829-acf5-7440ed9d0383 req-c4b7e7a3-1d37-4e7e-8f0a-f939bea732a3 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Refreshing network info cache for port 19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Start _get_guest_xml network_info=[{"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:24:38 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:24:38 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-23240802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-23240802',id=22,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKduD23N0jjd+/3aswFbVaCynWvn+B/yMtXKe3RKoy1nzyj4V1/dApS8ji97SS0HNw9OqdGuyusGE/CV8+iyxp5s4Ox44gq/tz45m/A8mDHXREpPgLCGWwIAVtzjkC4U5g==',key_name='tempest-keypair-1418035038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1d6da4f9f4149479a779475a69c9110',ramdisk_id='',reservation_id='r-7q3t55ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1293931160',owner_user_name='tempest-AttachVolumeShelveTestJSON-1293931160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:24:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c63eae228f99474899ce0620a4affe75',uuid=016bf051-9034-4124-948d-995aacf77caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converting VIF {"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1f:4f,bridge_name='br-int',has_traffic_filtering=True,id=19e9bf95-eee7-41e4-95ab-4f18f612d2c5,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e9bf95-ee') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.objects.instance [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lazy-loading 'pci_devices' on Instance uuid 016bf051-9034-4124-948d-995aacf77caf {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:24:38 user nova-compute[74776]:   <uuid>016bf051-9034-4124-948d-995aacf77caf</uuid>
Nov 22 14:24:38 user nova-compute[74776]:   <name>instance-00000016</name>
Nov 22 14:24:38 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:24:38 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:24:38 user nova-compute[74776]:   <metadata>
Nov 22 14:24:38 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:24:38 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:24:38 user nova-compute[74776]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-23240802</nova:name>
Nov 22 14:24:38 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:24:38</nova:creationTime>
Nov 22 14:24:38 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:24:38 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:24:38 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:24:38 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:24:38 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:24:38 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:24:38 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:24:38 user nova-compute[74776]:       <nova:owner>
Nov 22 14:24:38 user nova-compute[74776]:         <nova:user uuid="c63eae228f99474899ce0620a4affe75">tempest-AttachVolumeShelveTestJSON-1293931160-project-member</nova:user>
Nov 22 14:24:38 user nova-compute[74776]:         <nova:project uuid="b1d6da4f9f4149479a779475a69c9110">tempest-AttachVolumeShelveTestJSON-1293931160</nova:project>
Nov 22 14:24:38 user nova-compute[74776]:       </nova:owner>
Nov 22 14:24:38 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:24:38 user nova-compute[74776]:       <nova:ports>
Nov 22 14:24:38 user nova-compute[74776]:         <nova:port uuid="19e9bf95-eee7-41e4-95ab-4f18f612d2c5">
Nov 22 14:24:38 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 14:24:38 user nova-compute[74776]:         </nova:port>
Nov 22 14:24:38 user nova-compute[74776]:       </nova:ports>
Nov 22 14:24:38 user nova-compute[74776]:     </nova:instance>
Nov 22 14:24:38 user nova-compute[74776]:   </metadata>
Nov 22 14:24:38 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:24:38 user nova-compute[74776]:     <system>
Nov 22 14:24:38 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:24:38 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:24:38 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:24:38 user nova-compute[74776]:       <entry name="serial">016bf051-9034-4124-948d-995aacf77caf</entry>
Nov 22 14:24:38 user nova-compute[74776]:       <entry name="uuid">016bf051-9034-4124-948d-995aacf77caf</entry>
Nov 22 14:24:38 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:24:38 user nova-compute[74776]:     </system>
Nov 22 14:24:38 user nova-compute[74776]:   </sysinfo>
Nov 22 14:24:38 user nova-compute[74776]:   <os>
Nov 22 14:24:38 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:24:38 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:24:38 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:24:38 user nova-compute[74776]:   </os>
Nov 22 14:24:38 user nova-compute[74776]:   <features>
Nov 22 14:24:38 user nova-compute[74776]:     <acpi/>
Nov 22 14:24:38 user nova-compute[74776]:     <apic/>
Nov 22 14:24:38 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:24:38 user nova-compute[74776]:   </features>
Nov 22 14:24:38 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:24:38 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:24:38 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:24:38 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:24:38 user nova-compute[74776]:   </clock>
Nov 22 14:24:38 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:24:38 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:24:38 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:24:38 user nova-compute[74776]:   </cpu>
Nov 22 14:24:38 user nova-compute[74776]:   <devices>
Nov 22 14:24:38 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:24:38 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:24:38 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk"/>
Nov 22 14:24:38 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:24:38 user nova-compute[74776]:     </disk>
Nov 22 14:24:38 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:24:38 user nova-compute[74776]:       <mac address="fa:16:3e:c7:1f:4f"/>
Nov 22 14:24:38 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:24:38 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:24:38 user nova-compute[74776]:       <target dev="tap19e9bf95-ee"/>
Nov 22 14:24:38 user nova-compute[74776]:     </interface>
Nov 22 14:24:38 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:24:38 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/console.log" append="off"/>
Nov 22 14:24:38 user nova-compute[74776]:     </serial>
Nov 22 14:24:38 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:24:38 user nova-compute[74776]:     <video>
Nov 22 14:24:38 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:24:38 user nova-compute[74776]:     </video>
Nov 22 14:24:38 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:24:38 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:24:38 user nova-compute[74776]:     </rng>
Nov 22 14:24:38 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:24:38 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:24:38 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:24:38 user nova-compute[74776]:     </memballoon>
Nov 22 14:24:38 user nova-compute[74776]:   </devices>
Nov 22 14:24:38 user nova-compute[74776]: </domain>
Nov 22 14:24:38 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-23240802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-23240802',id=22,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKduD23N0jjd+/3aswFbVaCynWvn+B/yMtXKe3RKoy1nzyj4V1/dApS8ji97SS0HNw9OqdGuyusGE/CV8+iyxp5s4Ox44gq/tz45m/A8mDHXREpPgLCGWwIAVtzjkC4U5g==',key_name='tempest-keypair-1418035038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1d6da4f9f4149479a779475a69c9110',ramdisk_id='',reservation_id='r-7q3t55ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1293931160',owner_user_name='tempest-AttachVolumeShelveTestJSON-1293931160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:24:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c63eae228f99474899ce0620a4affe75',uuid=016bf051-9034-4124-948d-995aacf77caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converting VIF {"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1f:4f,bridge_name='br-int',has_traffic_filtering=True,id=19e9bf95-eee7-41e4-95ab-4f18f612d2c5,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e9bf95-ee') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG os_vif [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1f:4f,bridge_name='br-int',has_traffic_filtering=True,id=19e9bf95-eee7-41e4-95ab-4f18f612d2c5,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e9bf95-ee') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0f73024-cd57-50db-aed9-496e91b29b64', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19e9bf95-ee, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19e9bf95-ee, col_values=(('qos', UUID('ad47ffd7-605f-4f9d-abbd-38f26db498f3')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19e9bf95-ee, col_values=(('external_ids', {'iface-id': '19e9bf95-eee7-41e4-95ab-4f18f612d2c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:1f:4f', 'vm-uuid': '016bf051-9034-4124-948d-995aacf77caf'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:38 user nova-compute[74776]: INFO os_vif [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1f:4f,bridge_name='br-int',has_traffic_filtering=True,id=19e9bf95-eee7-41e4-95ab-4f18f612d2c5,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e9bf95-ee')
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:24:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] No VIF found with MAC fa:16:3e:c7:1f:4f, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:24:39 user nova-compute[74776]: DEBUG nova.network.neutron [req-c782aec4-7311-4829-acf5-7440ed9d0383 req-c4b7e7a3-1d37-4e7e-8f0a-f939bea732a3 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Updated VIF entry in instance network info cache for port 19e9bf95-eee7-41e4-95ab-4f18f612d2c5. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:24:39 user nova-compute[74776]: DEBUG nova.network.neutron [req-c782aec4-7311-4829-acf5-7440ed9d0383 req-c4b7e7a3-1d37-4e7e-8f0a-f939bea732a3 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Updating instance_info_cache with network_info: [{"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:24:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c782aec4-7311-4829-acf5-7440ed9d0383 req-c4b7e7a3-1d37-4e7e-8f0a-f939bea732a3 service nova] Releasing lock "refresh_cache-016bf051-9034-4124-948d-995aacf77caf" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:24:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:40 user nova-compute[74776]: DEBUG nova.compute.manager [req-6c26c1a6-56b3-4220-a56e-d76b158d8525 req-9022a8bf-dd3b-4c89-bedf-151ddc07a20b service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Received event network-vif-plugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:24:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6c26c1a6-56b3-4220-a56e-d76b158d8525 req-9022a8bf-dd3b-4c89-bedf-151ddc07a20b service nova] Acquiring lock "016bf051-9034-4124-948d-995aacf77caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6c26c1a6-56b3-4220-a56e-d76b158d8525 req-9022a8bf-dd3b-4c89-bedf-151ddc07a20b service nova] Lock "016bf051-9034-4124-948d-995aacf77caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6c26c1a6-56b3-4220-a56e-d76b158d8525 req-9022a8bf-dd3b-4c89-bedf-151ddc07a20b service nova] Lock "016bf051-9034-4124-948d-995aacf77caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:40 user nova-compute[74776]: DEBUG nova.compute.manager [req-6c26c1a6-56b3-4220-a56e-d76b158d8525 req-9022a8bf-dd3b-4c89-bedf-151ddc07a20b service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] No waiting events found dispatching network-vif-plugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:24:40 user nova-compute[74776]: WARNING nova.compute.manager [req-6c26c1a6-56b3-4220-a56e-d76b158d8525 req-9022a8bf-dd3b-4c89-bedf-151ddc07a20b service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Received unexpected event network-vif-plugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 for instance with vm_state building and task_state spawning.
Nov 22 14:24:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG nova.compute.manager [req-60b94317-f8b5-4a40-8068-e8721ad110d5 req-c542f97a-e2b1-4267-a320-cea024f3a044 service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Received event network-changed-e645f3db-3d2b-4694-93fe-64eb13e39926 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG nova.compute.manager [req-60b94317-f8b5-4a40-8068-e8721ad110d5 req-c542f97a-e2b1-4267-a320-cea024f3a044 service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Refreshing instance network info cache due to event network-changed-e645f3db-3d2b-4694-93fe-64eb13e39926. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-60b94317-f8b5-4a40-8068-e8721ad110d5 req-c542f97a-e2b1-4267-a320-cea024f3a044 service nova] Acquiring lock "refresh_cache-4a1cf058-5290-4d09-a979-89de319f2cbd" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-60b94317-f8b5-4a40-8068-e8721ad110d5 req-c542f97a-e2b1-4267-a320-cea024f3a044 service nova] Acquired lock "refresh_cache-4a1cf058-5290-4d09-a979-89de319f2cbd" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG nova.network.neutron [req-60b94317-f8b5-4a40-8068-e8721ad110d5 req-c542f97a-e2b1-4267-a320-cea024f3a044 service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Refreshing network info cache for port e645f3db-3d2b-4694-93fe-64eb13e39926 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG nova.compute.manager [req-4e3799de-cc3f-47b9-89a1-3110253f6895 req-22ef6f8b-9c2e-4d8f-b32d-6c8d039c1d5e service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Received event network-vif-plugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4e3799de-cc3f-47b9-89a1-3110253f6895 req-22ef6f8b-9c2e-4d8f-b32d-6c8d039c1d5e service nova] Acquiring lock "016bf051-9034-4124-948d-995aacf77caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4e3799de-cc3f-47b9-89a1-3110253f6895 req-22ef6f8b-9c2e-4d8f-b32d-6c8d039c1d5e service nova] Lock "016bf051-9034-4124-948d-995aacf77caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4e3799de-cc3f-47b9-89a1-3110253f6895 req-22ef6f8b-9c2e-4d8f-b32d-6c8d039c1d5e service nova] Lock "016bf051-9034-4124-948d-995aacf77caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG nova.compute.manager [req-4e3799de-cc3f-47b9-89a1-3110253f6895 req-22ef6f8b-9c2e-4d8f-b32d-6c8d039c1d5e service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] No waiting events found dispatching network-vif-plugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:24:42 user nova-compute[74776]: WARNING nova.compute.manager [req-4e3799de-cc3f-47b9-89a1-3110253f6895 req-22ef6f8b-9c2e-4d8f-b32d-6c8d039c1d5e service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Received unexpected event network-vif-plugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 for instance with vm_state building and task_state spawning.
Nov 22 14:24:42 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:24:42 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 016bf051-9034-4124-948d-995aacf77caf] Instance spawned successfully.
Nov 22 14:24:42 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:24:42 user nova-compute[74776]: INFO nova.compute.manager [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 22 14:24:42 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:24:42 user nova-compute[74776]: INFO nova.compute.manager [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Took 6.45 seconds to build instance.
Nov 22 14:24:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ab19d19-0e3b-46f6-ba84-49adfb4f0f1f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "016bf051-9034-4124-948d-995aacf77caf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.548s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "4a1cf058-5290-4d09-a979-89de319f2cbd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "4a1cf058-5290-4d09-a979-89de319f2cbd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "4a1cf058-5290-4d09-a979-89de319f2cbd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "4a1cf058-5290-4d09-a979-89de319f2cbd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "4a1cf058-5290-4d09-a979-89de319f2cbd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:42 user nova-compute[74776]: INFO nova.compute.manager [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Terminating instance
Nov 22 14:24:42 user nova-compute[74776]: DEBUG nova.compute.manager [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG nova.network.neutron [req-60b94317-f8b5-4a40-8068-e8721ad110d5 req-c542f97a-e2b1-4267-a320-cea024f3a044 service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Updated VIF entry in instance network info cache for port e645f3db-3d2b-4694-93fe-64eb13e39926. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:24:42 user nova-compute[74776]: DEBUG nova.network.neutron [req-60b94317-f8b5-4a40-8068-e8721ad110d5 req-c542f97a-e2b1-4267-a320-cea024f3a044 service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Updating instance_info_cache with network_info: [{"id": "e645f3db-3d2b-4694-93fe-64eb13e39926", "address": "fa:16:3e:8a:72:fd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape645f3db-3d", "ovs_interfaceid": "e645f3db-3d2b-4694-93fe-64eb13e39926", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:24:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-60b94317-f8b5-4a40-8068-e8721ad110d5 req-c542f97a-e2b1-4267-a320-cea024f3a044 service nova] Releasing lock "refresh_cache-4a1cf058-5290-4d09-a979-89de319f2cbd" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:24:43 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Instance destroyed successfully.
Nov 22 14:24:43 user nova-compute[74776]: DEBUG nova.objects.instance [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lazy-loading 'resources' on Instance uuid 4a1cf058-5290-4d09-a979-89de319f2cbd {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:24:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:22:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2091847464',display_name='tempest-AttachVolumeNegativeTest-server-2091847464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2091847464',id=20,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfoV6u6Ihf+5e5JMy/FPSptBn7v5+Vu50sH5XP8VSwk1h7V6dQjLbBiq/wo2Lw3ezAxTaixxGyu+lNbsf4JM9afvB/6kTdrpWMHmVZZDgvJbiIaO/glkPibth9htx2lVA==',key_name='tempest-keypair-1955073636',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:22:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dee58d331979425eb9d48d2a52fc1f68',ramdisk_id='',reservation_id='r-x32l9whb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-577275639',owner_user_name='tempest-AttachVolumeNegativeTest-577275639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:22:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1807bb240de749499809fd3dfb520d78',uuid=4a1cf058-5290-4d09-a979-89de319f2cbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e645f3db-3d2b-4694-93fe-64eb13e39926", "address": "fa:16:3e:8a:72:fd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape645f3db-3d", "ovs_interfaceid": "e645f3db-3d2b-4694-93fe-64eb13e39926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:24:43 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converting VIF {"id": "e645f3db-3d2b-4694-93fe-64eb13e39926", "address": "fa:16:3e:8a:72:fd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape645f3db-3d", "ovs_interfaceid": "e645f3db-3d2b-4694-93fe-64eb13e39926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:24:43 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:72:fd,bridge_name='br-int',has_traffic_filtering=True,id=e645f3db-3d2b-4694-93fe-64eb13e39926,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape645f3db-3d') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:24:43 user nova-compute[74776]: DEBUG os_vif [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:72:fd,bridge_name='br-int',has_traffic_filtering=True,id=e645f3db-3d2b-4694-93fe-64eb13e39926,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape645f3db-3d') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:24:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape645f3db-3d, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:24:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=beb6ecdd-2e5d-46d7-ab65-71e1f03e5b27) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:24:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:24:43 user nova-compute[74776]: INFO os_vif [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:72:fd,bridge_name='br-int',has_traffic_filtering=True,id=e645f3db-3d2b-4694-93fe-64eb13e39926,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape645f3db-3d')
Nov 22 14:24:43 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Deleting instance files /opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd_del
Nov 22 14:24:43 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Deletion of /opt/stack/data/nova/instances/4a1cf058-5290-4d09-a979-89de319f2cbd_del complete
Nov 22 14:24:43 user nova-compute[74776]: INFO nova.compute.manager [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 22 14:24:43 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:24:43 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:24:43 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:24:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:44 user nova-compute[74776]: DEBUG nova.compute.manager [req-ba06efdc-1c91-45fe-9d7f-9daae5d3f683 req-d592d9c3-fdb6-49d7-968e-df18eb66da8f service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Received event network-vif-unplugged-e645f3db-3d2b-4694-93fe-64eb13e39926 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:24:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ba06efdc-1c91-45fe-9d7f-9daae5d3f683 req-d592d9c3-fdb6-49d7-968e-df18eb66da8f service nova] Acquiring lock "4a1cf058-5290-4d09-a979-89de319f2cbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ba06efdc-1c91-45fe-9d7f-9daae5d3f683 req-d592d9c3-fdb6-49d7-968e-df18eb66da8f service nova] Lock "4a1cf058-5290-4d09-a979-89de319f2cbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ba06efdc-1c91-45fe-9d7f-9daae5d3f683 req-d592d9c3-fdb6-49d7-968e-df18eb66da8f service nova] Lock "4a1cf058-5290-4d09-a979-89de319f2cbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:44 user nova-compute[74776]: DEBUG nova.compute.manager [req-ba06efdc-1c91-45fe-9d7f-9daae5d3f683 req-d592d9c3-fdb6-49d7-968e-df18eb66da8f service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] No waiting events found dispatching network-vif-unplugged-e645f3db-3d2b-4694-93fe-64eb13e39926 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:24:44 user nova-compute[74776]: DEBUG nova.compute.manager [req-ba06efdc-1c91-45fe-9d7f-9daae5d3f683 req-d592d9c3-fdb6-49d7-968e-df18eb66da8f service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Received event network-vif-unplugged-e645f3db-3d2b-4694-93fe-64eb13e39926 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:24:44 user nova-compute[74776]: DEBUG nova.compute.manager [req-ba06efdc-1c91-45fe-9d7f-9daae5d3f683 req-d592d9c3-fdb6-49d7-968e-df18eb66da8f service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Received event network-vif-plugged-e645f3db-3d2b-4694-93fe-64eb13e39926 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:24:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ba06efdc-1c91-45fe-9d7f-9daae5d3f683 req-d592d9c3-fdb6-49d7-968e-df18eb66da8f service nova] Acquiring lock "4a1cf058-5290-4d09-a979-89de319f2cbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ba06efdc-1c91-45fe-9d7f-9daae5d3f683 req-d592d9c3-fdb6-49d7-968e-df18eb66da8f service nova] Lock "4a1cf058-5290-4d09-a979-89de319f2cbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ba06efdc-1c91-45fe-9d7f-9daae5d3f683 req-d592d9c3-fdb6-49d7-968e-df18eb66da8f service nova] Lock "4a1cf058-5290-4d09-a979-89de319f2cbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:44 user nova-compute[74776]: DEBUG nova.compute.manager [req-ba06efdc-1c91-45fe-9d7f-9daae5d3f683 req-d592d9c3-fdb6-49d7-968e-df18eb66da8f service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] No waiting events found dispatching network-vif-plugged-e645f3db-3d2b-4694-93fe-64eb13e39926 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:24:44 user nova-compute[74776]: WARNING nova.compute.manager [req-ba06efdc-1c91-45fe-9d7f-9daae5d3f683 req-d592d9c3-fdb6-49d7-968e-df18eb66da8f service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Received unexpected event network-vif-plugged-e645f3db-3d2b-4694-93fe-64eb13e39926 for instance with vm_state active and task_state deleting.
Nov 22 14:24:44 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:24:44 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Took 1.18 seconds to deallocate network for instance.
Nov 22 14:24:44 user nova-compute[74776]: DEBUG nova.compute.manager [req-ff22a684-dfd0-4f52-a07a-dc4c18e35647 req-ecc3c045-aaa5-4ce2-8067-00131e95bc73 service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Received event network-vif-deleted-e645f3db-3d2b-4694-93fe-64eb13e39926 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:24:44 user nova-compute[74776]: INFO nova.compute.manager [req-ff22a684-dfd0-4f52-a07a-dc4c18e35647 req-ecc3c045-aaa5-4ce2-8067-00131e95bc73 service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Neutron deleted interface e645f3db-3d2b-4694-93fe-64eb13e39926; detaching it from the instance and deleting it from the info cache
Nov 22 14:24:44 user nova-compute[74776]: DEBUG nova.network.neutron [req-ff22a684-dfd0-4f52-a07a-dc4c18e35647 req-ecc3c045-aaa5-4ce2-8067-00131e95bc73 service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:24:44 user nova-compute[74776]: DEBUG nova.compute.manager [req-ff22a684-dfd0-4f52-a07a-dc4c18e35647 req-ecc3c045-aaa5-4ce2-8067-00131e95bc73 service nova] [instance: 4a1cf058-5290-4d09-a979-89de319f2cbd] Detach interface failed, port_id=e645f3db-3d2b-4694-93fe-64eb13e39926, reason: Instance 4a1cf058-5290-4d09-a979-89de319f2cbd could not be found. {{(pid=74776) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 14:24:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:45 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:24:45 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:24:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:45 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Deleted allocations for instance 4a1cf058-5290-4d09-a979-89de319f2cbd
Nov 22 14:24:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-315f1315-3676-4369-85fc-a01b33104495 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "4a1cf058-5290-4d09-a979-89de319f2cbd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.461s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:55 user nova-compute[74776]: INFO nova.compute.manager [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Detaching volume f4f9db8e-6078-4602-be9a-f6e8b1e727b3
Nov 22 14:24:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:55 user nova-compute[74776]: INFO nova.virt.block_device [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Attempting to driver detach volume f4f9db8e-6078-4602-be9a-f6e8b1e727b3 from mountpoint /dev/vdb
Nov 22 14:24:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Attempting to detach device vdb from instance d7f3ff5e-292d-4e81-af58-b9a45adfbda1 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:24:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:24:55 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:24:55 user nova-compute[74776]:   <source dev="/dev/sdh"/>
Nov 22 14:24:55 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:24:55 user nova-compute[74776]:   <serial>f4f9db8e-6078-4602-be9a-f6e8b1e727b3</serial>
Nov 22 14:24:55 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 14:24:55 user nova-compute[74776]: </disk>
Nov 22 14:24:55 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:24:55 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Successfully detached device vdb from instance d7f3ff5e-292d-4e81-af58-b9a45adfbda1 from the persistent domain config.
Nov 22 14:24:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d7f3ff5e-292d-4e81-af58-b9a45adfbda1 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:24:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:24:55 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:24:55 user nova-compute[74776]:   <source dev="/dev/sdh"/>
Nov 22 14:24:55 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:24:55 user nova-compute[74776]:   <serial>f4f9db8e-6078-4602-be9a-f6e8b1e727b3</serial>
Nov 22 14:24:55 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 14:24:55 user nova-compute[74776]: </disk>
Nov 22 14:24:55 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:24:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Acquiring lock "97fa95f1-f856-4b65-917f-9808bac6e576" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "97fa95f1-f856-4b65-917f-9808bac6e576" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Acquiring lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:55 user nova-compute[74776]: INFO nova.compute.manager [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Terminating instance
Nov 22 14:24:55 user nova-compute[74776]: DEBUG nova.compute.manager [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:24:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:55 user nova-compute[74776]: INFO nova.compute.manager [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Terminating instance
Nov 22 14:24:55 user nova-compute[74776]: DEBUG nova.compute.manager [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:24:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d7f3ff5e-292d-4e81-af58-b9a45adfbda1 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:24:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-244ddfe3-55e6-4bbb-84af-1beae0df5c89 req-a06e009f-acbb-4961-84fe-18a3d293189d service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Received event network-vif-unplugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-244ddfe3-55e6-4bbb-84af-1beae0df5c89 req-a06e009f-acbb-4961-84fe-18a3d293189d service nova] Acquiring lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-244ddfe3-55e6-4bbb-84af-1beae0df5c89 req-a06e009f-acbb-4961-84fe-18a3d293189d service nova] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-244ddfe3-55e6-4bbb-84af-1beae0df5c89 req-a06e009f-acbb-4961-84fe-18a3d293189d service nova] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-244ddfe3-55e6-4bbb-84af-1beae0df5c89 req-a06e009f-acbb-4961-84fe-18a3d293189d service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] No waiting events found dispatching network-vif-unplugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-244ddfe3-55e6-4bbb-84af-1beae0df5c89 req-a06e009f-acbb-4961-84fe-18a3d293189d service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Received event network-vif-unplugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-e0918802-f954-4960-924d-1f6be0091f3f req-450f8927-8757-4149-98dd-b5837c18dac7 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received event network-vif-unplugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e0918802-f954-4960-924d-1f6be0091f3f req-450f8927-8757-4149-98dd-b5837c18dac7 service nova] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e0918802-f954-4960-924d-1f6be0091f3f req-450f8927-8757-4149-98dd-b5837c18dac7 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e0918802-f954-4960-924d-1f6be0091f3f req-450f8927-8757-4149-98dd-b5837c18dac7 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-e0918802-f954-4960-924d-1f6be0091f3f req-450f8927-8757-4149-98dd-b5837c18dac7 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] No waiting events found dispatching network-vif-unplugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-e0918802-f954-4960-924d-1f6be0091f3f req-450f8927-8757-4149-98dd-b5837c18dac7 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received event network-vif-unplugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:56 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Instance destroyed successfully.
Nov 22 14:24:56 user nova-compute[74776]: DEBUG nova.objects.instance [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lazy-loading 'resources' on Instance uuid 97fa95f1-f856-4b65-917f-9808bac6e576 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T14:21:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1117334062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-701035597',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYkU/2rQfSqsHtxK4fuxV+C9ojLZCEgNPlys0mLUFyCMchJcZzHAHb+3FUbvc2xdk3gHibee1w4iVYXBMvTV3V9mrEhNV3Yx2m3WYA430lr+k5smV5pmrxj35fa4s3h8g==',key_name='tempest-keypair-1544757416',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:23:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='722073efd41d4ff2a3354a6dd1f6093a',ramdisk_id='',reservation_id='r-4zg0peg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1866761054',owner_user_name='tempest-ServerActionsV293TestJSON-1866761054-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:23:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a9bb1ba0806f4157873e2ef88d7c832f',uuid=97fa95f1-f856-4b65-917f-9808bac6e576,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "address": "fa:16:3e:30:f8:d1", "network": {"id": "f55f24e7-af68-4a8b-af50-ff18023189dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717554397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722073efd41d4ff2a3354a6dd1f6093a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1e50d-19", "ovs_interfaceid": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Converting VIF {"id": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "address": "fa:16:3e:30:f8:d1", "network": {"id": "f55f24e7-af68-4a8b-af50-ff18023189dd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717554397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722073efd41d4ff2a3354a6dd1f6093a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ce1e50d-19", "ovs_interfaceid": "2ce1e50d-19f9-474c-9f47-2dc4eca12fb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:f8:d1,bridge_name='br-int',has_traffic_filtering=True,id=2ce1e50d-19f9-474c-9f47-2dc4eca12fb4,network=Network(f55f24e7-af68-4a8b-af50-ff18023189dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1e50d-19') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG os_vif [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:f8:d1,bridge_name='br-int',has_traffic_filtering=True,id=2ce1e50d-19f9-474c-9f47-2dc4eca12fb4,network=Network(f55f24e7-af68-4a8b-af50-ff18023189dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1e50d-19') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ce1e50d-19, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70954a36-4e60-4077-b1e0-d811925876f6) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:24:56 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Instance destroyed successfully.
Nov 22 14:24:56 user nova-compute[74776]: DEBUG nova.objects.instance [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lazy-loading 'resources' on Instance uuid e96ab1bf-6f19-4e5f-b79d-f0266988090b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:56 user nova-compute[74776]: INFO os_vif [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:f8:d1,bridge_name='br-int',has_traffic_filtering=True,id=2ce1e50d-19f9-474c-9f47-2dc4eca12fb4,network=Network(f55f24e7-af68-4a8b-af50-ff18023189dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ce1e50d-19')
Nov 22 14:24:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1644694208',display_name='tempest-ServerActionsTestOtherB-server-1644694208',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1644694208',id=2,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNubZ7Gk5h0q4OD6Enksl8Cxk/zzd+sbOwMvtIBBZUt9W+DL2N76A0FAo5K8lTdtosYaw4CTfnxfM5nY6xMBLxjo0J1fnDDgRvxTybxKH1mCAazzdEjSajoOw371LIwgmw==',key_name='tempest-keypair-1933513143',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:22:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba1b35da14434fa09c3331d9c44d63fb',ramdisk_id='',reservation_id='r-fmg969sn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1073417585',owner_user_name='tempest-ServerActionsTestOtherB-1073417585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84f6a2d2d72f42f1ba0ee9b623a0a9ca',uuid=e96ab1bf-6f19-4e5f-b79d-f0266988090b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Converting VIF {"id": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "address": "fa:16:3e:b6:46:f7", "network": {"id": "1287337f-aeac-4c5f-a6f0-3af84b13c33b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-588979287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba1b35da14434fa09c3331d9c44d63fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5911a175-03", "ovs_interfaceid": "5911a175-03ae-4ed9-8c40-fc54c69233b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:46:f7,bridge_name='br-int',has_traffic_filtering=True,id=5911a175-03ae-4ed9-8c40-fc54c69233b4,network=Network(1287337f-aeac-4c5f-a6f0-3af84b13c33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5911a175-03') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG os_vif [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:46:f7,bridge_name='br-int',has_traffic_filtering=True,id=5911a175-03ae-4ed9-8c40-fc54c69233b4,network=Network(1287337f-aeac-4c5f-a6f0-3af84b13c33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5911a175-03') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5911a175-03, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:24:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uoiazveY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:24:57 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3170328-3ef6-4eb0-85c7-19ca32e805aa) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:57 user nova-compute[74776]: INFO os_vif [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:46:f7,bridge_name='br-int',has_traffic_filtering=True,id=5911a175-03ae-4ed9-8c40-fc54c69233b4,network=Network(1287337f-aeac-4c5f-a6f0-3af84b13c33b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5911a175-03')
Nov 22 14:24:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvAJsUuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:24:57 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[75460104-5d1f-479e-bdff-e9a5893e9730]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:24:57 user nova-compute[74776]: No targets found.
Nov 22 14:24:57 user nova-compute[74776]: iSNS:
Nov 22 14:24:57 user nova-compute[74776]: No targets found.
Nov 22 14:24:57 user nova-compute[74776]: STATIC:
Nov 22 14:24:57 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3
Nov 22 14:24:57 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:24:57 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:24:57 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c
Nov 22 14:24:57 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:24:57 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:24:57 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3
Nov 22 14:24:57 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:24:57 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:24:57 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f
Nov 22 14:24:57 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:24:57 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:24:57 user nova-compute[74776]: FIRMWARE:
Nov 22 14:24:57 user nova-compute[74776]: No targets found.
Nov 22 14:24:57 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:24:57 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:24:57 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cd1ddb-550a-45db-b367-d112295f6962]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d70f0d8-9397-42bd-bad9-74d04294d6ff]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:24:57 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:24:57 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:24:57 user nova-compute[74776]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:24:57 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:24:57 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:24:57 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:24:57 user nova-compute[74776]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f (non-flash)
Nov 22 14:24:57 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c5826dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f'): ({'sdb'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Removing single pathed devices sdb {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.040s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1338c31d-d493-4d21-9619-8afe1bdf9124]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc09bf53-e137-4283-9b40-6c001d8074d5]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Flushing IO for device /dev/sdb {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4008d068-ea46-42a2-8f66-561c9df49d82]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[205ad501-2c61-432d-866e-54b5594e79e2]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2708671f-9c21-43a8-8b27-9d1349ffa938]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ffd1ce-c908-4997-8eaf-5a2a8213e5f5]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f, portal: 172.16.0.220,3260]
Nov 22 14:24:57 user nova-compute[74776]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f, portal: 172.16.0.220,3260] successful.
Nov 22 14:24:57 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f6f309a-fb40-466e-af42-74fa8649a83f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfaa4c6-1661-442f-b202-2d8e6feddd0e]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] <== disconnect_volume: return (374ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:24:57 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Deleting instance files /opt/stack/data/nova/instances/97fa95f1-f856-4b65-917f-9808bac6e576_del
Nov 22 14:24:57 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Deletion of /opt/stack/data/nova/instances/97fa95f1-f856-4b65-917f-9808bac6e576_del complete
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.349s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[138ee680-cec8-4d08-be90-b51ade32c875]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:24:57 user nova-compute[74776]: No targets found.
Nov 22 14:24:57 user nova-compute[74776]: iSNS:
Nov 22 14:24:57 user nova-compute[74776]: No targets found.
Nov 22 14:24:57 user nova-compute[74776]: STATIC:
Nov 22 14:24:57 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3
Nov 22 14:24:57 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:24:57 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:24:57 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c
Nov 22 14:24:57 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:24:57 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:24:57 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3
Nov 22 14:24:57 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:24:57 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:24:57 user nova-compute[74776]: FIRMWARE:
Nov 22 14:24:57 user nova-compute[74776]: No targets found.
Nov 22 14:24:57 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:24:57 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:24:57 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[56054725-e3e0-4b85-873c-3699e6404e08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:57 user nova-compute[74776]: INFO nova.compute.manager [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Took 1.72 seconds to destroy the instance on the hypervisor.
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7f2efb-dddf-40cc-8c29-abb4222e91f3]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:24:57 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:24:57 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:24:57 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 (non-flash)
Nov 22 14:24:57 user nova-compute[74776]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:24:57 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:24:57 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c586124d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3'): ({'sdf'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Removing single pathed devices sdf {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a716083b-0bed-44fa-864a-9d29e0da3ddc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.030s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb773110-79c0-42b3-bc97-99a494d8972c]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Flushing IO for device /dev/sdf {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef510cc9-37f6-432a-a106-bc88c13dbad3]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.058s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44c834f-f322-4564-9306-647941b64ba2]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] SCSI volumes sdf have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b94805a-9b55-4ca4-a4d9-6cc79873e652]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec137302-c588-4a00-bc36-2a52df96629a]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260]
Nov 22 14:24:57 user nova-compute[74776]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3, portal: 172.16.0.220,3260] successful.
Nov 22 14:24:57 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80d952a7-ba34-425d-b34d-dbb03e3fb7e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab054de-17dd-41f1-8a46-84b9993c0e2f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] <== disconnect_volume: return (730ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:24:57 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Deleting instance files /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b_del
Nov 22 14:24:57 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Deletion of /opt/stack/data/nova/instances/e96ab1bf-6f19-4e5f-b79d-f0266988090b_del complete
Nov 22 14:24:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:24:57 user nova-compute[74776]: INFO nova.compute.manager [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Took 2.02 seconds to destroy the instance on the hypervisor.
Nov 22 14:24:57 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:24:57 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG nova.compute.manager [req-ae8f89c1-0bbf-4fe7-8fec-03cd4cfc9ff8 req-8537b452-ed53-43f2-a11e-95ee7c35f9f6 service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Received event network-vif-plugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ae8f89c1-0bbf-4fe7-8fec-03cd4cfc9ff8 req-8537b452-ed53-43f2-a11e-95ee7c35f9f6 service nova] Acquiring lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ae8f89c1-0bbf-4fe7-8fec-03cd4cfc9ff8 req-8537b452-ed53-43f2-a11e-95ee7c35f9f6 service nova] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ae8f89c1-0bbf-4fe7-8fec-03cd4cfc9ff8 req-8537b452-ed53-43f2-a11e-95ee7c35f9f6 service nova] Lock "97fa95f1-f856-4b65-917f-9808bac6e576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG nova.compute.manager [req-ae8f89c1-0bbf-4fe7-8fec-03cd4cfc9ff8 req-8537b452-ed53-43f2-a11e-95ee7c35f9f6 service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] No waiting events found dispatching network-vif-plugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:24:58 user nova-compute[74776]: WARNING nova.compute.manager [req-ae8f89c1-0bbf-4fe7-8fec-03cd4cfc9ff8 req-8537b452-ed53-43f2-a11e-95ee7c35f9f6 service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Received unexpected event network-vif-plugged-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 for instance with vm_state active and task_state deleting.
Nov 22 14:24:58 user nova-compute[74776]: DEBUG nova.compute.manager [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG nova.compute.manager [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] No waiting events found dispatching network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:24:58 user nova-compute[74776]: WARNING nova.compute.manager [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received unexpected event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 for instance with vm_state active and task_state deleting.
Nov 22 14:24:58 user nova-compute[74776]: DEBUG nova.compute.manager [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG nova.compute.manager [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] No waiting events found dispatching network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:24:58 user nova-compute[74776]: WARNING nova.compute.manager [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received unexpected event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 for instance with vm_state active and task_state deleting.
Nov 22 14:24:58 user nova-compute[74776]: DEBUG nova.compute.manager [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG nova.compute.manager [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] No waiting events found dispatching network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:24:58 user nova-compute[74776]: WARNING nova.compute.manager [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received unexpected event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 for instance with vm_state active and task_state deleting.
Nov 22 14:24:58 user nova-compute[74776]: DEBUG nova.compute.manager [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received event network-vif-unplugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG nova.compute.manager [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] No waiting events found dispatching network-vif-unplugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG nova.compute.manager [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received event network-vif-unplugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG nova.compute.manager [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] Acquiring lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:24:58 user nova-compute[74776]: DEBUG nova.compute.manager [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] No waiting events found dispatching network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:24:58 user nova-compute[74776]: WARNING nova.compute.manager [req-5df9b404-e853-4137-ab48-28cfcaf2cca5 req-b2986efb-ba63-4a28-b696-716baebec827 service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received unexpected event network-vif-plugged-5911a175-03ae-4ed9-8c40-fc54c69233b4 for instance with vm_state active and task_state deleting.
Nov 22 14:24:58 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:24:58 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Took 1.13 seconds to deallocate network for instance.
Nov 22 14:24:58 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:24:58 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Took 1.07 seconds to deallocate network for instance.
Nov 22 14:24:59 user nova-compute[74776]: INFO nova.compute.manager [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Took 0.92 seconds to detach 1 volumes for instance.
Nov 22 14:24:59 user nova-compute[74776]: DEBUG nova.compute.manager [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Deleting volume: 9f6f309a-fb40-466e-af42-74fa8649a83f {{(pid=74776) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 22 14:24:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:24:59 user nova-compute[74776]: INFO nova.compute.manager [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Took 0.94 seconds to detach 1 volumes for instance.
Nov 22 14:24:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:24:59 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:24:59 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:25:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.084s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:00 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Deleted allocations for instance 97fa95f1-f856-4b65-917f-9808bac6e576
Nov 22 14:25:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-95878b0f-dc12-40a2-8239-e671e14e0757 tempest-ServerActionsV293TestJSON-1866761054 tempest-ServerActionsV293TestJSON-1866761054-project-member] Lock "97fa95f1-f856-4b65-917f-9808bac6e576" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.429s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-eb745bd8-d49b-4928-83d1-dddd537975dd req-366ad7de-c473-433f-a2a0-771b486b7a2e service nova] [instance: e96ab1bf-6f19-4e5f-b79d-f0266988090b] Received event network-vif-deleted-5911a175-03ae-4ed9-8c40-fc54c69233b4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:25:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-b82c8773-ae5f-4d4e-96ef-73ae96e17d40 req-42150216-518d-4bf9-89d5-8385a717995a service nova] [instance: 97fa95f1-f856-4b65-917f-9808bac6e576] Received event network-vif-deleted-2ce1e50d-19f9-474c-9f47-2dc4eca12fb4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:25:00 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:25:00 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:25:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.541s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:00 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Deleted allocations for instance e96ab1bf-6f19-4e5f-b79d-f0266988090b
Nov 22 14:25:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-56273c1b-7852-4594-8ecc-49c8bb2247bf tempest-ServerActionsTestOtherB-1073417585 tempest-ServerActionsTestOtherB-1073417585-project-member] Lock "e96ab1bf-6f19-4e5f-b79d-f0266988090b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.950s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Acquiring lock "d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Lock "d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:03 user nova-compute[74776]: DEBUG nova.compute.manager [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:25:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:03 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:25:03 user nova-compute[74776]: INFO nova.compute.claims [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Claim successful on node user
Nov 22 14:25:04 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:25:04 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:25:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:04 user nova-compute[74776]: DEBUG nova.compute.manager [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:25:04 user nova-compute[74776]: DEBUG nova.compute.manager [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:25:04 user nova-compute[74776]: DEBUG nova.network.neutron [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:25:04 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:25:04 user nova-compute[74776]: DEBUG nova.compute.manager [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:25:04 user nova-compute[74776]: DEBUG nova.compute.manager [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:25:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:25:04 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Creating image(s)
Nov 22 14:25:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Lock "/opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Lock "/opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:04 user nova-compute[74776]: DEBUG nova.policy [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79a38f963f7d4f1bb03b0b898116d507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea8ba945216849ca92e91d7e4c8c8980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:25:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.240s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:04 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.210s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e/disk 1073741824" returned: 0 in 0.053s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.206s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:05 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:25:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:05 user nova-compute[74776]: DEBUG nova.network.neutron [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Successfully created port: f686ba43-be92-4e45-a575-b0cca1418623 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:25:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:05 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Cannot resize image /opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:25:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:25:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Ensure instance console log exists: /opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:25:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.network.neutron [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Successfully updated port: f686ba43-be92-4e45-a575-b0cca1418623 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Acquiring lock "refresh_cache-d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Acquired lock "refresh_cache-d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.network.neutron [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-b2f8e54c-d5e3-4a1a-b477-66216d620f6b req-fa69ef89-9b9f-4d4d-acf8-3fe73477cede service nova] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Received event network-changed-f686ba43-be92-4e45-a575-b0cca1418623 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-b2f8e54c-d5e3-4a1a-b477-66216d620f6b req-fa69ef89-9b9f-4d4d-acf8-3fe73477cede service nova] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Refreshing instance network info cache due to event network-changed-f686ba43-be92-4e45-a575-b0cca1418623. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b2f8e54c-d5e3-4a1a-b477-66216d620f6b req-fa69ef89-9b9f-4d4d-acf8-3fe73477cede service nova] Acquiring lock "refresh_cache-d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.network.neutron [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.network.neutron [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Updating instance_info_cache with network_info: [{"id": "f686ba43-be92-4e45-a575-b0cca1418623", "address": "fa:16:3e:f7:11:da", "network": {"id": "1a8f7d25-4c19-4546-861b-f7b15f1c12af", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b02a2fa1d01d4cb3b0a21595749534e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686ba43-be", "ovs_interfaceid": "f686ba43-be92-4e45-a575-b0cca1418623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Releasing lock "refresh_cache-d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Instance network_info: |[{"id": "f686ba43-be92-4e45-a575-b0cca1418623", "address": "fa:16:3e:f7:11:da", "network": {"id": "1a8f7d25-4c19-4546-861b-f7b15f1c12af", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b02a2fa1d01d4cb3b0a21595749534e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686ba43-be", "ovs_interfaceid": "f686ba43-be92-4e45-a575-b0cca1418623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b2f8e54c-d5e3-4a1a-b477-66216d620f6b req-fa69ef89-9b9f-4d4d-acf8-3fe73477cede service nova] Acquired lock "refresh_cache-d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.network.neutron [req-b2f8e54c-d5e3-4a1a-b477-66216d620f6b req-fa69ef89-9b9f-4d4d-acf8-3fe73477cede service nova] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Refreshing network info cache for port f686ba43-be92-4e45-a575-b0cca1418623 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Start _get_guest_xml network_info=[{"id": "f686ba43-be92-4e45-a575-b0cca1418623", "address": "fa:16:3e:f7:11:da", "network": {"id": "1a8f7d25-4c19-4546-861b-f7b15f1c12af", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b02a2fa1d01d4cb3b0a21595749534e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686ba43-be", "ovs_interfaceid": "f686ba43-be92-4e45-a575-b0cca1418623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:25:06 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:25:06 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1711661015',display_name='tempest-VolumesNegativeTest-instance-1711661015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1711661015',id=23,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea8ba945216849ca92e91d7e4c8c8980',ramdisk_id='',reservation_id='r-6oc00qv2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1359841222',owner_user_name='tempest-VolumesNegativeTest-1359841222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:25:04Z,user_data=None,user_id='79a38f963f7d4f1bb03b0b898116d507',uuid=d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f686ba43-be92-4e45-a575-b0cca1418623", "address": "fa:16:3e:f7:11:da", "network": {"id": "1a8f7d25-4c19-4546-861b-f7b15f1c12af", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b02a2fa1d01d4cb3b0a21595749534e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686ba43-be", "ovs_interfaceid": "f686ba43-be92-4e45-a575-b0cca1418623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Converting VIF {"id": "f686ba43-be92-4e45-a575-b0cca1418623", "address": "fa:16:3e:f7:11:da", "network": {"id": "1a8f7d25-4c19-4546-861b-f7b15f1c12af", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b02a2fa1d01d4cb3b0a21595749534e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686ba43-be", "ovs_interfaceid": "f686ba43-be92-4e45-a575-b0cca1418623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:11:da,bridge_name='br-int',has_traffic_filtering=True,id=f686ba43-be92-4e45-a575-b0cca1418623,network=Network(1a8f7d25-4c19-4546-861b-f7b15f1c12af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf686ba43-be') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.objects.instance [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Lazy-loading 'pci_devices' on Instance uuid d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:25:06 user nova-compute[74776]:   <uuid>d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e</uuid>
Nov 22 14:25:06 user nova-compute[74776]:   <name>instance-00000017</name>
Nov 22 14:25:06 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:25:06 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:25:06 user nova-compute[74776]:   <metadata>
Nov 22 14:25:06 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:25:06 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:25:06 user nova-compute[74776]:       <nova:name>tempest-VolumesNegativeTest-instance-1711661015</nova:name>
Nov 22 14:25:06 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:25:06</nova:creationTime>
Nov 22 14:25:06 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:25:06 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:25:06 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:25:06 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:25:06 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:25:06 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:25:06 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:25:06 user nova-compute[74776]:       <nova:owner>
Nov 22 14:25:06 user nova-compute[74776]:         <nova:user uuid="79a38f963f7d4f1bb03b0b898116d507">tempest-VolumesNegativeTest-1359841222-project-member</nova:user>
Nov 22 14:25:06 user nova-compute[74776]:         <nova:project uuid="ea8ba945216849ca92e91d7e4c8c8980">tempest-VolumesNegativeTest-1359841222</nova:project>
Nov 22 14:25:06 user nova-compute[74776]:       </nova:owner>
Nov 22 14:25:06 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:25:06 user nova-compute[74776]:       <nova:ports>
Nov 22 14:25:06 user nova-compute[74776]:         <nova:port uuid="f686ba43-be92-4e45-a575-b0cca1418623">
Nov 22 14:25:06 user nova-compute[74776]:           <nova:ip type="fixed" address="192.168.233.174" ipVersion="4"/>
Nov 22 14:25:06 user nova-compute[74776]:         </nova:port>
Nov 22 14:25:06 user nova-compute[74776]:       </nova:ports>
Nov 22 14:25:06 user nova-compute[74776]:     </nova:instance>
Nov 22 14:25:06 user nova-compute[74776]:   </metadata>
Nov 22 14:25:06 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:25:06 user nova-compute[74776]:     <system>
Nov 22 14:25:06 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:25:06 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:25:06 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:25:06 user nova-compute[74776]:       <entry name="serial">d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e</entry>
Nov 22 14:25:06 user nova-compute[74776]:       <entry name="uuid">d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e</entry>
Nov 22 14:25:06 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:25:06 user nova-compute[74776]:     </system>
Nov 22 14:25:06 user nova-compute[74776]:   </sysinfo>
Nov 22 14:25:06 user nova-compute[74776]:   <os>
Nov 22 14:25:06 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:25:06 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:25:06 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:25:06 user nova-compute[74776]:   </os>
Nov 22 14:25:06 user nova-compute[74776]:   <features>
Nov 22 14:25:06 user nova-compute[74776]:     <acpi/>
Nov 22 14:25:06 user nova-compute[74776]:     <apic/>
Nov 22 14:25:06 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:25:06 user nova-compute[74776]:   </features>
Nov 22 14:25:06 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:25:06 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:25:06 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:25:06 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:25:06 user nova-compute[74776]:   </clock>
Nov 22 14:25:06 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:25:06 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:25:06 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:25:06 user nova-compute[74776]:   </cpu>
Nov 22 14:25:06 user nova-compute[74776]:   <devices>
Nov 22 14:25:06 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:25:06 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:25:06 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e/disk"/>
Nov 22 14:25:06 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:25:06 user nova-compute[74776]:     </disk>
Nov 22 14:25:06 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:25:06 user nova-compute[74776]:       <mac address="fa:16:3e:f7:11:da"/>
Nov 22 14:25:06 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:25:06 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:25:06 user nova-compute[74776]:       <target dev="tapf686ba43-be"/>
Nov 22 14:25:06 user nova-compute[74776]:     </interface>
Nov 22 14:25:06 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:25:06 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e/console.log" append="off"/>
Nov 22 14:25:06 user nova-compute[74776]:     </serial>
Nov 22 14:25:06 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:25:06 user nova-compute[74776]:     <video>
Nov 22 14:25:06 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:25:06 user nova-compute[74776]:     </video>
Nov 22 14:25:06 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:25:06 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:25:06 user nova-compute[74776]:     </rng>
Nov 22 14:25:06 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:25:06 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:25:06 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:25:06 user nova-compute[74776]:     </memballoon>
Nov 22 14:25:06 user nova-compute[74776]:   </devices>
Nov 22 14:25:06 user nova-compute[74776]: </domain>
Nov 22 14:25:06 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1711661015',display_name='tempest-VolumesNegativeTest-instance-1711661015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1711661015',id=23,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea8ba945216849ca92e91d7e4c8c8980',ramdisk_id='',reservation_id='r-6oc00qv2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1359841222',owner_user_name='tempest-VolumesNegativeTest-1359841222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:25:04Z,user_data=None,user_id='79a38f963f7d4f1bb03b0b898116d507',uuid=d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f686ba43-be92-4e45-a575-b0cca1418623", "address": "fa:16:3e:f7:11:da", "network": {"id": "1a8f7d25-4c19-4546-861b-f7b15f1c12af", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b02a2fa1d01d4cb3b0a21595749534e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686ba43-be", "ovs_interfaceid": "f686ba43-be92-4e45-a575-b0cca1418623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Converting VIF {"id": "f686ba43-be92-4e45-a575-b0cca1418623", "address": "fa:16:3e:f7:11:da", "network": {"id": "1a8f7d25-4c19-4546-861b-f7b15f1c12af", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b02a2fa1d01d4cb3b0a21595749534e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686ba43-be", "ovs_interfaceid": "f686ba43-be92-4e45-a575-b0cca1418623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:11:da,bridge_name='br-int',has_traffic_filtering=True,id=f686ba43-be92-4e45-a575-b0cca1418623,network=Network(1a8f7d25-4c19-4546-861b-f7b15f1c12af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf686ba43-be') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG os_vif [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:11:da,bridge_name='br-int',has_traffic_filtering=True,id=f686ba43-be92-4e45-a575-b0cca1418623,network=Network(1a8f7d25-4c19-4546-861b-f7b15f1c12af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf686ba43-be') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9d05937-7ae0-500b-950f-01c0f3d00d1e', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf686ba43-be, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf686ba43-be, col_values=(('qos', UUID('dc3d113d-142b-406d-949c-fb9342bdc8f4')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf686ba43-be, col_values=(('external_ids', {'iface-id': 'f686ba43-be92-4e45-a575-b0cca1418623', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:11:da', 'vm-uuid': 'd2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:06 user nova-compute[74776]: INFO os_vif [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:11:da,bridge_name='br-int',has_traffic_filtering=True,id=f686ba43-be92-4e45-a575-b0cca1418623,network=Network(1a8f7d25-4c19-4546-861b-f7b15f1c12af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf686ba43-be')
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] No VIF found with MAC fa:16:3e:f7:11:da, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:25:06 user nova-compute[74776]: INFO nova.compute.manager [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Rescuing
Nov 22 14:25:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "refresh_cache-525baf66-82cc-4e8d-a37a-c92c51d4673d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquired lock "refresh_cache-525baf66-82cc-4e8d-a37a-c92c51d4673d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.network.neutron [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.network.neutron [req-b2f8e54c-d5e3-4a1a-b477-66216d620f6b req-fa69ef89-9b9f-4d4d-acf8-3fe73477cede service nova] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Updated VIF entry in instance network info cache for port f686ba43-be92-4e45-a575-b0cca1418623. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG nova.network.neutron [req-b2f8e54c-d5e3-4a1a-b477-66216d620f6b req-fa69ef89-9b9f-4d4d-acf8-3fe73477cede service nova] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Updating instance_info_cache with network_info: [{"id": "f686ba43-be92-4e45-a575-b0cca1418623", "address": "fa:16:3e:f7:11:da", "network": {"id": "1a8f7d25-4c19-4546-861b-f7b15f1c12af", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b02a2fa1d01d4cb3b0a21595749534e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686ba43-be", "ovs_interfaceid": "f686ba43-be92-4e45-a575-b0cca1418623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:25:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b2f8e54c-d5e3-4a1a-b477-66216d620f6b req-fa69ef89-9b9f-4d4d-acf8-3fe73477cede service nova] Releasing lock "refresh_cache-d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:25:07 user nova-compute[74776]: DEBUG nova.network.neutron [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Updating instance_info_cache with network_info: [{"id": "ac898a82-d482-4299-b86b-db6aacf8175a", "address": "fa:16:3e:38:af:39", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac898a82-d4", "ovs_interfaceid": "ac898a82-d482-4299-b86b-db6aacf8175a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:25:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Releasing lock "refresh_cache-525baf66-82cc-4e8d-a37a-c92c51d4673d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:25:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:07 user nova-compute[74776]: DEBUG nova.compute.manager [req-c948c1b3-60c6-4fe2-860a-cecd46f1e331 req-5a4cd73d-b6ec-4616-b6da-8b008fafefb6 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received event network-vif-unplugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:25:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c948c1b3-60c6-4fe2-860a-cecd46f1e331 req-5a4cd73d-b6ec-4616-b6da-8b008fafefb6 service nova] Acquiring lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c948c1b3-60c6-4fe2-860a-cecd46f1e331 req-5a4cd73d-b6ec-4616-b6da-8b008fafefb6 service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c948c1b3-60c6-4fe2-860a-cecd46f1e331 req-5a4cd73d-b6ec-4616-b6da-8b008fafefb6 service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:07 user nova-compute[74776]: DEBUG nova.compute.manager [req-c948c1b3-60c6-4fe2-860a-cecd46f1e331 req-5a4cd73d-b6ec-4616-b6da-8b008fafefb6 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] No waiting events found dispatching network-vif-unplugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:25:07 user nova-compute[74776]: WARNING nova.compute.manager [req-c948c1b3-60c6-4fe2-860a-cecd46f1e331 req-5a4cd73d-b6ec-4616-b6da-8b008fafefb6 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received unexpected event network-vif-unplugged-ac898a82-d482-4299-b86b-db6aacf8175a for instance with vm_state active and task_state rescuing.
Nov 22 14:25:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:08 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Instance destroyed successfully.
Nov 22 14:25:08 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Attempting rescue
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74776) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Instance directory exists: not creating {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 14:25:08 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Creating image(s)
Nov 22 14:25:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "/opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "/opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "/opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.objects.instance [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'trusted_certs' on Instance uuid 525baf66-82cc-4e8d-a37a-c92c51d4673d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk.rescue {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk.rescue" returned: 0 in 0.048s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.objects.instance [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'migration_context' on Instance uuid 525baf66-82cc-4e8d-a37a-c92c51d4673d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.objects.base [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Object Instance<525baf66-82cc-4e8d-a37a-c92c51d4673d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Start _get_guest_xml network_info=[{"id": "ac898a82-d482-4299-b86b-db6aacf8175a", "address": "fa:16:3e:38:af:39", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "vif_mac": "fa:16:3e:38:af:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac898a82-d4", "ovs_interfaceid": "ac898a82-d482-4299-b86b-db6aacf8175a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.objects.instance [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'resources' on Instance uuid 525baf66-82cc-4e8d-a37a-c92c51d4673d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.objects.base [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Object Instance<525baf66-82cc-4e8d-a37a-c92c51d4673d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.objects.instance [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'numa_topology' on Instance uuid 525baf66-82cc-4e8d-a37a-c92c51d4673d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.objects.base [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Object Instance<525baf66-82cc-4e8d-a37a-c92c51d4673d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:25:08 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:25:08 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.objects.instance [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'vcpu_model' on Instance uuid 525baf66-82cc-4e8d-a37a-c92c51d4673d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.objects.base [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Object Instance<525baf66-82cc-4e8d-a37a-c92c51d4673d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:20:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-248863747',display_name='tempest-ServerRescueNegativeTestJSON-server-248863747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-248863747',id=14,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:20:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36f36a88fd7b403d9c2dd29bcd64aac6',ramdisk_id='',reservation_id='r-qlinlrt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1360515217',owner_user_name='tempest-ServerRescueNegativeTestJSON-1360515217-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:20:32Z,user_data=None,user_id='d686d08dc36a49fa80192546c4f68940',uuid=525baf66-82cc-4e8d-a37a-c92c51d4673d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac898a82-d482-4299-b86b-db6aacf8175a", "address": "fa:16:3e:38:af:39", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "vif_mac": "fa:16:3e:38:af:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac898a82-d4", "ovs_interfaceid": "ac898a82-d482-4299-b86b-db6aacf8175a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converting VIF {"id": "ac898a82-d482-4299-b86b-db6aacf8175a", "address": "fa:16:3e:38:af:39", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "vif_mac": "fa:16:3e:38:af:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac898a82-d4", "ovs_interfaceid": "ac898a82-d482-4299-b86b-db6aacf8175a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:af:39,bridge_name='br-int',has_traffic_filtering=True,id=ac898a82-d482-4299-b86b-db6aacf8175a,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac898a82-d4') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.objects.instance [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'pci_devices' on Instance uuid 525baf66-82cc-4e8d-a37a-c92c51d4673d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.objects.base [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Object Instance<525baf66-82cc-4e8d-a37a-c92c51d4673d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:25:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:25:08 user nova-compute[74776]:   <uuid>525baf66-82cc-4e8d-a37a-c92c51d4673d</uuid>
Nov 22 14:25:08 user nova-compute[74776]:   <name>instance-0000000e</name>
Nov 22 14:25:08 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:25:08 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:25:08 user nova-compute[74776]:   <metadata>
Nov 22 14:25:08 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:25:08 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:25:08 user nova-compute[74776]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-248863747</nova:name>
Nov 22 14:25:08 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:25:08</nova:creationTime>
Nov 22 14:25:08 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:25:08 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:25:08 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:25:08 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:25:08 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:25:08 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:25:08 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:25:08 user nova-compute[74776]:       <nova:owner>
Nov 22 14:25:08 user nova-compute[74776]:         <nova:user uuid="d686d08dc36a49fa80192546c4f68940">tempest-ServerRescueNegativeTestJSON-1360515217-project-member</nova:user>
Nov 22 14:25:08 user nova-compute[74776]:         <nova:project uuid="36f36a88fd7b403d9c2dd29bcd64aac6">tempest-ServerRescueNegativeTestJSON-1360515217</nova:project>
Nov 22 14:25:08 user nova-compute[74776]:       </nova:owner>
Nov 22 14:25:08 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:25:08 user nova-compute[74776]:       <nova:ports>
Nov 22 14:25:08 user nova-compute[74776]:         <nova:port uuid="ac898a82-d482-4299-b86b-db6aacf8175a">
Nov 22 14:25:08 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 14:25:08 user nova-compute[74776]:         </nova:port>
Nov 22 14:25:08 user nova-compute[74776]:       </nova:ports>
Nov 22 14:25:08 user nova-compute[74776]:     </nova:instance>
Nov 22 14:25:08 user nova-compute[74776]:   </metadata>
Nov 22 14:25:08 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:25:08 user nova-compute[74776]:     <system>
Nov 22 14:25:08 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:25:08 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:25:08 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:25:08 user nova-compute[74776]:       <entry name="serial">525baf66-82cc-4e8d-a37a-c92c51d4673d</entry>
Nov 22 14:25:08 user nova-compute[74776]:       <entry name="uuid">525baf66-82cc-4e8d-a37a-c92c51d4673d</entry>
Nov 22 14:25:08 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:25:08 user nova-compute[74776]:     </system>
Nov 22 14:25:08 user nova-compute[74776]:   </sysinfo>
Nov 22 14:25:08 user nova-compute[74776]:   <os>
Nov 22 14:25:08 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:25:08 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:25:08 user nova-compute[74776]:   </os>
Nov 22 14:25:08 user nova-compute[74776]:   <features>
Nov 22 14:25:08 user nova-compute[74776]:     <acpi/>
Nov 22 14:25:08 user nova-compute[74776]:     <apic/>
Nov 22 14:25:08 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:25:08 user nova-compute[74776]:   </features>
Nov 22 14:25:08 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:25:08 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:25:08 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:25:08 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:25:08 user nova-compute[74776]:   </clock>
Nov 22 14:25:08 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:25:08 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:25:08 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:25:08 user nova-compute[74776]:   </cpu>
Nov 22 14:25:08 user nova-compute[74776]:   <devices>
Nov 22 14:25:08 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:25:08 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:25:08 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk.rescue"/>
Nov 22 14:25:08 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:25:08 user nova-compute[74776]:     </disk>
Nov 22 14:25:08 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:25:08 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:25:08 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk"/>
Nov 22 14:25:08 user nova-compute[74776]:       <target dev="vdb" bus="virtio"/>
Nov 22 14:25:08 user nova-compute[74776]:     </disk>
Nov 22 14:25:08 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:25:08 user nova-compute[74776]:       <mac address="fa:16:3e:38:af:39"/>
Nov 22 14:25:08 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:25:08 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:25:08 user nova-compute[74776]:       <target dev="tapac898a82-d4"/>
Nov 22 14:25:08 user nova-compute[74776]:     </interface>
Nov 22 14:25:08 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:25:08 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/console.log" append="off"/>
Nov 22 14:25:08 user nova-compute[74776]:     </serial>
Nov 22 14:25:08 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:25:08 user nova-compute[74776]:     <video>
Nov 22 14:25:08 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:25:08 user nova-compute[74776]:     </video>
Nov 22 14:25:08 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:25:08 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:25:08 user nova-compute[74776]:     </rng>
Nov 22 14:25:08 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:25:08 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:25:08 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:25:08 user nova-compute[74776]:     </memballoon>
Nov 22 14:25:08 user nova-compute[74776]:   </devices>
Nov 22 14:25:08 user nova-compute[74776]: </domain>
Nov 22 14:25:08 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:25:08 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Instance destroyed successfully.
Nov 22 14:25:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:25:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:25:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] No VIF found with MAC fa:16:3e:38:af:39, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:25:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-468145c9-a343-447c-b2ee-31dfd2c318a9 req-5e37bfee-a9af-4ca8-8501-bd89722cfec2 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received event network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:25:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-468145c9-a343-447c-b2ee-31dfd2c318a9 req-5e37bfee-a9af-4ca8-8501-bd89722cfec2 service nova] Acquiring lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-468145c9-a343-447c-b2ee-31dfd2c318a9 req-5e37bfee-a9af-4ca8-8501-bd89722cfec2 service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-468145c9-a343-447c-b2ee-31dfd2c318a9 req-5e37bfee-a9af-4ca8-8501-bd89722cfec2 service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-468145c9-a343-447c-b2ee-31dfd2c318a9 req-5e37bfee-a9af-4ca8-8501-bd89722cfec2 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] No waiting events found dispatching network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:25:09 user nova-compute[74776]: WARNING nova.compute.manager [req-468145c9-a343-447c-b2ee-31dfd2c318a9 req-5e37bfee-a9af-4ca8-8501-bd89722cfec2 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received unexpected event network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a for instance with vm_state active and task_state rescuing.
Nov 22 14:25:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-468145c9-a343-447c-b2ee-31dfd2c318a9 req-5e37bfee-a9af-4ca8-8501-bd89722cfec2 service nova] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Received event network-vif-plugged-f686ba43-be92-4e45-a575-b0cca1418623 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:25:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-468145c9-a343-447c-b2ee-31dfd2c318a9 req-5e37bfee-a9af-4ca8-8501-bd89722cfec2 service nova] Acquiring lock "d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-468145c9-a343-447c-b2ee-31dfd2c318a9 req-5e37bfee-a9af-4ca8-8501-bd89722cfec2 service nova] Lock "d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-468145c9-a343-447c-b2ee-31dfd2c318a9 req-5e37bfee-a9af-4ca8-8501-bd89722cfec2 service nova] Lock "d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-468145c9-a343-447c-b2ee-31dfd2c318a9 req-5e37bfee-a9af-4ca8-8501-bd89722cfec2 service nova] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] No waiting events found dispatching network-vif-plugged-f686ba43-be92-4e45-a575-b0cca1418623 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:25:09 user nova-compute[74776]: WARNING nova.compute.manager [req-468145c9-a343-447c-b2ee-31dfd2c318a9 req-5e37bfee-a9af-4ca8-8501-bd89722cfec2 service nova] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Received unexpected event network-vif-plugged-f686ba43-be92-4e45-a575-b0cca1418623 for instance with vm_state building and task_state spawning.
Nov 22 14:25:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-468145c9-a343-447c-b2ee-31dfd2c318a9 req-5e37bfee-a9af-4ca8-8501-bd89722cfec2 service nova] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Received event network-vif-plugged-f686ba43-be92-4e45-a575-b0cca1418623 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:25:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-468145c9-a343-447c-b2ee-31dfd2c318a9 req-5e37bfee-a9af-4ca8-8501-bd89722cfec2 service nova] Acquiring lock "d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-468145c9-a343-447c-b2ee-31dfd2c318a9 req-5e37bfee-a9af-4ca8-8501-bd89722cfec2 service nova] Lock "d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-468145c9-a343-447c-b2ee-31dfd2c318a9 req-5e37bfee-a9af-4ca8-8501-bd89722cfec2 service nova] Lock "d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-468145c9-a343-447c-b2ee-31dfd2c318a9 req-5e37bfee-a9af-4ca8-8501-bd89722cfec2 service nova] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] No waiting events found dispatching network-vif-plugged-f686ba43-be92-4e45-a575-b0cca1418623 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:25:09 user nova-compute[74776]: WARNING nova.compute.manager [req-468145c9-a343-447c-b2ee-31dfd2c318a9 req-5e37bfee-a9af-4ca8-8501-bd89722cfec2 service nova] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Received unexpected event network-vif-plugged-f686ba43-be92-4e45-a575-b0cca1418623 for instance with vm_state building and task_state spawning.
Nov 22 14:25:09 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:25:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:10 user nova-compute[74776]: DEBUG nova.compute.manager [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:25:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:25:10 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Instance spawned successfully.
Nov 22 14:25:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:25:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:25:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:25:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:25:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:25:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:25:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:25:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:10 user nova-compute[74776]: INFO nova.compute.manager [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 22 14:25:10 user nova-compute[74776]: DEBUG nova.compute.manager [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:25:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:10 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:25:10 user nova-compute[74776]: INFO nova.compute.manager [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Took 6.83 seconds to build instance.
Nov 22 14:25:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5efc2695-aaff-481a-a44b-29bd4f405f84 tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Lock "d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.015s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:11 user nova-compute[74776]: DEBUG nova.compute.manager [req-aa2307d0-c300-451a-8bb0-1c9d20de96c3 req-accb0c4d-b008-42ad-bd2d-4ba846aef2b1 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received event network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:25:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-aa2307d0-c300-451a-8bb0-1c9d20de96c3 req-accb0c4d-b008-42ad-bd2d-4ba846aef2b1 service nova] Acquiring lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-aa2307d0-c300-451a-8bb0-1c9d20de96c3 req-accb0c4d-b008-42ad-bd2d-4ba846aef2b1 service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-aa2307d0-c300-451a-8bb0-1c9d20de96c3 req-accb0c4d-b008-42ad-bd2d-4ba846aef2b1 service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:11 user nova-compute[74776]: DEBUG nova.compute.manager [req-aa2307d0-c300-451a-8bb0-1c9d20de96c3 req-accb0c4d-b008-42ad-bd2d-4ba846aef2b1 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] No waiting events found dispatching network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:25:11 user nova-compute[74776]: WARNING nova.compute.manager [req-aa2307d0-c300-451a-8bb0-1c9d20de96c3 req-accb0c4d-b008-42ad-bd2d-4ba846aef2b1 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received unexpected event network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a for instance with vm_state active and task_state rescuing.
Nov 22 14:25:11 user nova-compute[74776]: DEBUG nova.compute.manager [req-aa2307d0-c300-451a-8bb0-1c9d20de96c3 req-accb0c4d-b008-42ad-bd2d-4ba846aef2b1 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received event network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:25:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-aa2307d0-c300-451a-8bb0-1c9d20de96c3 req-accb0c4d-b008-42ad-bd2d-4ba846aef2b1 service nova] Acquiring lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-aa2307d0-c300-451a-8bb0-1c9d20de96c3 req-accb0c4d-b008-42ad-bd2d-4ba846aef2b1 service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-aa2307d0-c300-451a-8bb0-1c9d20de96c3 req-accb0c4d-b008-42ad-bd2d-4ba846aef2b1 service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:11 user nova-compute[74776]: DEBUG nova.compute.manager [req-aa2307d0-c300-451a-8bb0-1c9d20de96c3 req-accb0c4d-b008-42ad-bd2d-4ba846aef2b1 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] No waiting events found dispatching network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:25:11 user nova-compute[74776]: WARNING nova.compute.manager [req-aa2307d0-c300-451a-8bb0-1c9d20de96c3 req-accb0c4d-b008-42ad-bd2d-4ba846aef2b1 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received unexpected event network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a for instance with vm_state active and task_state rescuing.
Nov 22 14:25:11 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:25:11 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:25:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-525baf66-82cc-4e8d-a37a-c92c51d4673d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:25:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-525baf66-82cc-4e8d-a37a-c92c51d4673d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:25:11 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:25:12 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Updating instance_info_cache with network_info: [{"id": "ac898a82-d482-4299-b86b-db6aacf8175a", "address": "fa:16:3e:38:af:39", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac898a82-d4", "ovs_interfaceid": "ac898a82-d482-4299-b86b-db6aacf8175a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:25:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-525baf66-82cc-4e8d-a37a-c92c51d4673d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:25:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:25:12 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:25:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:25:12 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:25:12 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:25:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:12 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:25:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-184e6220-dc4a-4369-b6be-851bda2063b6 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:25:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:25:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:15 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d7f3ff5e-292d-4e81-af58-b9a45adfbda1 is timed out.
Nov 22 14:25:15 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Successfully detached device vdb from instance d7f3ff5e-292d-4e81-af58-b9a45adfbda1 from the live domain config.
Nov 22 14:25:15 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:25:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJHwfbLd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:25:15 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:25:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:25:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:25:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66bf182-ad80-4248-b45c-0057016fdd42]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:25:15 user nova-compute[74776]: No targets found.
Nov 22 14:25:15 user nova-compute[74776]: iSNS:
Nov 22 14:25:15 user nova-compute[74776]: No targets found.
Nov 22 14:25:15 user nova-compute[74776]: STATIC:
Nov 22 14:25:15 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c
Nov 22 14:25:15 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:25:15 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:25:15 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3
Nov 22 14:25:15 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:25:15 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:25:15 user nova-compute[74776]: FIRMWARE:
Nov 22 14:25:15 user nova-compute[74776]: No targets found.
Nov 22 14:25:15 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:25:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:25:15 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:25:15 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:25:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:25:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6906ce07-3528-4b30-a9bd-9fde864dd579]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85a451a-a9d2-471f-a3b4-fec498fdaf05]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:25:16 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:25:16 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 (non-flash)
Nov 22 14:25:16 user nova-compute[74776]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:25:16 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c782405e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3'): ({'sdh'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Removing single pathed devices sdh {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22c8d50-9556-4646-a3ba-ff698b137f83]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee96660a-96e0-4f7d-9008-bdb8f96a2721]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Flushing IO for device /dev/sdh {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[662f48a7-7a18-456a-8303-2645eb32546d]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[68da59eb-10f6-48db-abe0-d5337dca28af]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] SCSI volumes sdh have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f17487-8070-41b1-8c74-6c445faa2766]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9264cc-7c8a-4384-a658-27d17574fcfd]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3, portal: 172.16.0.220,3260]
Nov 22 14:25:16 user nova-compute[74776]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3, portal: 172.16.0.220,3260] successful.
Nov 22 14:25:16 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4f9db8e-6078-4602-be9a-f6e8b1e727b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[05039f74-2997-496f-9ae1-3f26df54cab6]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] <== disconnect_volume: return (439ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:17 user nova-compute[74776]: DEBUG nova.objects.instance [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lazy-loading 'flavor' on Instance uuid d7f3ff5e-292d-4e81-af58-b9a45adfbda1 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:25:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f8a9782d-62b7-4605-8959-b69b593c4195 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.066s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:17 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:25:17 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:25:17 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=7827MB free_disk=25.36071014404297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:25:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.013s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4629d82d-fd02-4a58-a535-b362b493e7c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:25:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance d7f3ff5e-292d-4e81-af58-b9a45adfbda1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:25:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 525baf66-82cc-4e8d-a37a-c92c51d4673d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:25:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6f2ce4b2-660c-431f-b951-c6ec5090ef7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:25:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 370f25d8-d6f4-4de8-b356-d23e6d599f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:25:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f4f30fe7-b234-4f81-b081-3214f5ebe789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:25:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 016bf051-9034-4124-948d-995aacf77caf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:25:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:25:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:25:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:25:18 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:25:18 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:25:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:25:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.610s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:19 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:25:19 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:25:19 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:25:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:22 user nova-compute[74776]: DEBUG nova.compute.manager [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:25:22 user nova-compute[74776]: INFO nova.compute.manager [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] instance snapshotting
Nov 22 14:25:22 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Beginning live snapshot process
Nov 22 14:25:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json -f qcow2 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json -f qcow2" returned: 0 in 0.223s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json -f qcow2 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.191s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp1z2k0m6/12af9fe1644c4ac7871e3770c8e6199c.delta 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp1z2k0m6/12af9fe1644c4ac7871e3770c8e6199c.delta 1073741824" returned: 0 in 0.130s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:23 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 22 14:25:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:25:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] COPY block job progress, current cursor: 19005440 final cursor: 75497472 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:25:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:25:25 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 22 14:25:25 user nova-compute[74776]: DEBUG nova.privsep.utils [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74776) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 14:25:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp1z2k0m6/12af9fe1644c4ac7871e3770c8e6199c.delta /opt/stack/data/nova/instances/snapshots/tmpp1z2k0m6/12af9fe1644c4ac7871e3770c8e6199c {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp1z2k0m6/12af9fe1644c4ac7871e3770c8e6199c.delta /opt/stack/data/nova/instances/snapshots/tmpp1z2k0m6/12af9fe1644c4ac7871e3770c8e6199c" returned: 0 in 0.601s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:26 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Snapshot extracted, beginning image upload
Nov 22 14:25:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:29 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Snapshot image upload complete
Nov 22 14:25:29 user nova-compute[74776]: INFO nova.compute.manager [None req-30a39d4b-bad3-4941-99b3-3457518c4df1 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Took 6.39 seconds to snapshot the instance on the hypervisor.
Nov 22 14:25:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "370f25d8-d6f4-4de8-b356-d23e6d599f82" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:34 user nova-compute[74776]: INFO nova.compute.manager [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Detaching volume bb7fc68f-a55a-4023-9c33-e1e828447e8c
Nov 22 14:25:34 user nova-compute[74776]: INFO nova.virt.block_device [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Attempting to driver detach volume bb7fc68f-a55a-4023-9c33-e1e828447e8c from mountpoint /dev/vdb
Nov 22 14:25:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Attempting to detach device vdb from instance 370f25d8-d6f4-4de8-b356-d23e6d599f82 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:25:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:25:34 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:25:34 user nova-compute[74776]:   <source dev="/dev/sdj"/>
Nov 22 14:25:34 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:25:34 user nova-compute[74776]:   <serial>bb7fc68f-a55a-4023-9c33-e1e828447e8c</serial>
Nov 22 14:25:34 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:25:34 user nova-compute[74776]: </disk>
Nov 22 14:25:34 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:25:34 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Successfully detached device vdb from instance 370f25d8-d6f4-4de8-b356-d23e6d599f82 from the persistent domain config.
Nov 22 14:25:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 370f25d8-d6f4-4de8-b356-d23e6d599f82 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:25:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:25:34 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:25:34 user nova-compute[74776]:   <source dev="/dev/sdj"/>
Nov 22 14:25:34 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:25:34 user nova-compute[74776]:   <serial>bb7fc68f-a55a-4023-9c33-e1e828447e8c</serial>
Nov 22 14:25:34 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:25:34 user nova-compute[74776]: </disk>
Nov 22 14:25:34 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:25:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 370f25d8-d6f4-4de8-b356-d23e6d599f82 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:25:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquiring lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:25:45 user nova-compute[74776]: INFO nova.compute.claims [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Claim successful on node user
Nov 22 14:25:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:45 user nova-compute[74776]: INFO nova.compute.manager [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Terminating instance
Nov 22 14:25:45 user nova-compute[74776]: DEBUG nova.compute.manager [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:25:45 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:25:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG nova.policy [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d42ed53e03c4b6b8989293a3737d2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529b6ffebfe549278c4462796677a969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:25:45 user nova-compute[74776]: INFO nova.virt.block_device [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Booting with volume 4916cee9-8763-4a88-a0d4-2555e772ec71 at /dev/vda
Nov 22 14:25:45 user nova-compute[74776]: DEBUG os_brick.utils [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a7f52c-981c-4cf1-ae4c-d47972157720]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[548ecb83-1acb-44ca-9a8b-5e76a4c115a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee578254-a796-4eb6-a7c9-2c68866434b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0739d1f-2f0d-4da7-ac48-f451d42e9aff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:25:46 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:25:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e55f007-0eae-494d-b676-ae4d0c89fa60]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG os_brick.utils [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Updating existing volume attachment record: da0b7deb-c505-43db-a6c8-38a4aabecbfd {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG nova.compute.manager [req-ee6e6f54-7e82-466b-8506-d3c870969e95 req-1b37f635-fa60-4cfb-aea7-1986edb4fbe9 service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Received event network-vif-unplugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ee6e6f54-7e82-466b-8506-d3c870969e95 req-1b37f635-fa60-4cfb-aea7-1986edb4fbe9 service nova] Acquiring lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ee6e6f54-7e82-466b-8506-d3c870969e95 req-1b37f635-fa60-4cfb-aea7-1986edb4fbe9 service nova] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ee6e6f54-7e82-466b-8506-d3c870969e95 req-1b37f635-fa60-4cfb-aea7-1986edb4fbe9 service nova] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG nova.compute.manager [req-ee6e6f54-7e82-466b-8506-d3c870969e95 req-1b37f635-fa60-4cfb-aea7-1986edb4fbe9 service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] No waiting events found dispatching network-vif-unplugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG nova.compute.manager [req-ee6e6f54-7e82-466b-8506-d3c870969e95 req-1b37f635-fa60-4cfb-aea7-1986edb4fbe9 service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Received event network-vif-unplugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Successfully created port: 5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:46 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Instance destroyed successfully.
Nov 22 14:25:46 user nova-compute[74776]: DEBUG nova.objects.instance [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lazy-loading 'resources' on Instance uuid d7f3ff5e-292d-4e81-af58-b9a45adfbda1 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T14:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1556564197',display_name='tempest-ServerActionsTestOtherA-server-676961491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1556564197',id=13,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAC9v0i+pER3cZ0Jjqv3cqTkz1HXyHfnSqpokTPMCo4Rsk1FySmrASTuu3c9HUsU6AsfF7+7FSXMyaBmojZ6N9tkTFvl0ozPbgI/kAIfW0Flf0H56UyV24UUsrzbg38lsw==',key_name='tempest-keypair-32107482',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:22:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3958d7be91b4bb1b9e314d8867cd8f5',ramdisk_id='',reservation_id='r-o0y8arto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-109524404',owner_user_name='tempest-ServerActionsTestOtherA-109524404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f703bfbe762447778429bda22b74505c',uuid=d7f3ff5e-292d-4e81-af58-b9a45adfbda1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "address": "fa:16:3e:22:fe:77", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81372b6e-81", "ovs_interfaceid": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converting VIF {"id": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "address": "fa:16:3e:22:fe:77", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81372b6e-81", "ovs_interfaceid": "81372b6e-8162-4b1f-ac94-dcaf1c8c2473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:fe:77,bridge_name='br-int',has_traffic_filtering=True,id=81372b6e-8162-4b1f-ac94-dcaf1c8c2473,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81372b6e-81') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG os_vif [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:fe:77,bridge_name='br-int',has_traffic_filtering=True,id=81372b6e-8162-4b1f-ac94-dcaf1c8c2473,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81372b6e-81') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81372b6e-81, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c46a7b2c-efda-40cc-b7ae-d5de9f0fbe09) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:25:46 user nova-compute[74776]: INFO os_vif [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:fe:77,bridge_name='br-int',has_traffic_filtering=True,id=81372b6e-8162-4b1f-ac94-dcaf1c8c2473,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81372b6e-81')
Nov 22 14:25:46 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Deleting instance files /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1_del
Nov 22 14:25:46 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Deletion of /opt/stack/data/nova/instances/d7f3ff5e-292d-4e81-af58-b9a45adfbda1_del complete
Nov 22 14:25:46 user nova-compute[74776]: INFO nova.compute.manager [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 22 14:25:46 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:25:46 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:25:47 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Successfully updated port: 5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:25:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquiring lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:25:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquired lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:25:47 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:25:47 user nova-compute[74776]: DEBUG nova.compute.manager [req-daf3f356-2430-40c8-8a43-33aeb03b984b req-bc58c85f-e893-4b42-861f-700334a37f9d service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received event network-changed-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:25:47 user nova-compute[74776]: DEBUG nova.compute.manager [req-daf3f356-2430-40c8-8a43-33aeb03b984b req-bc58c85f-e893-4b42-861f-700334a37f9d service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Refreshing instance network info cache due to event network-changed-5b603149-0a4f-4aac-890c-fade34245023. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:25:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-daf3f356-2430-40c8-8a43-33aeb03b984b req-bc58c85f-e893-4b42-861f-700334a37f9d service nova] Acquiring lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:25:47 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:25:47 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Updating instance_info_cache with network_info: [{"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:25:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Releasing lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:25:47 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Instance network_info: |[{"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:25:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-daf3f356-2430-40c8-8a43-33aeb03b984b req-bc58c85f-e893-4b42-861f-700334a37f9d service nova] Acquired lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:25:47 user nova-compute[74776]: DEBUG nova.network.neutron [req-daf3f356-2430-40c8-8a43-33aeb03b984b req-bc58c85f-e893-4b42-861f-700334a37f9d service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Refreshing network info cache for port 5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:25:47 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:25:47 user nova-compute[74776]: DEBUG nova.compute.manager [req-cd47ee62-d0fb-4586-812d-1f772064b3ad req-76f60482-a524-49c0-ad24-2275b88a731d service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Received event network-vif-deleted-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:25:47 user nova-compute[74776]: INFO nova.compute.manager [req-cd47ee62-d0fb-4586-812d-1f772064b3ad req-76f60482-a524-49c0-ad24-2275b88a731d service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Neutron deleted interface 81372b6e-8162-4b1f-ac94-dcaf1c8c2473; detaching it from the instance and deleting it from the info cache
Nov 22 14:25:47 user nova-compute[74776]: DEBUG nova.network.neutron [req-cd47ee62-d0fb-4586-812d-1f772064b3ad req-76f60482-a524-49c0-ad24-2275b88a731d service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:25:47 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Took 0.89 seconds to deallocate network for instance.
Nov 22 14:25:47 user nova-compute[74776]: DEBUG nova.compute.manager [req-cd47ee62-d0fb-4586-812d-1f772064b3ad req-76f60482-a524-49c0-ad24-2275b88a731d service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Detach interface failed, port_id=81372b6e-8162-4b1f-ac94-dcaf1c8c2473, reason: Instance d7f3ff5e-292d-4e81-af58-b9a45adfbda1 could not be found. {{(pid=74776) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 14:25:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:47 user nova-compute[74776]: DEBUG nova.network.neutron [req-daf3f356-2430-40c8-8a43-33aeb03b984b req-bc58c85f-e893-4b42-861f-700334a37f9d service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Updated VIF entry in instance network info cache for port 5b603149-0a4f-4aac-890c-fade34245023. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:25:47 user nova-compute[74776]: DEBUG nova.network.neutron [req-daf3f356-2430-40c8-8a43-33aeb03b984b req-bc58c85f-e893-4b42-861f-700334a37f9d service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Updating instance_info_cache with network_info: [{"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:25:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-daf3f356-2430-40c8-8a43-33aeb03b984b req-bc58c85f-e893-4b42-861f-700334a37f9d service nova] Releasing lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:25:48 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:25:48 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:25:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:48 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Deleted allocations for instance d7f3ff5e-292d-4e81-af58-b9a45adfbda1
Nov 22 14:25:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bb6bcdef-7ff5-42c9-ad4c-36afb829d12c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.543s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:48 user nova-compute[74776]: DEBUG nova.compute.manager [req-b1c4454f-bfe3-4601-add9-e444a9b81ea3 req-b6259fc2-2f7d-4cc1-906d-bc8bea08cc9e service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Received event network-vif-plugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:25:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b1c4454f-bfe3-4601-add9-e444a9b81ea3 req-b6259fc2-2f7d-4cc1-906d-bc8bea08cc9e service nova] Acquiring lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b1c4454f-bfe3-4601-add9-e444a9b81ea3 req-b6259fc2-2f7d-4cc1-906d-bc8bea08cc9e service nova] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b1c4454f-bfe3-4601-add9-e444a9b81ea3 req-b6259fc2-2f7d-4cc1-906d-bc8bea08cc9e service nova] Lock "d7f3ff5e-292d-4e81-af58-b9a45adfbda1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:48 user nova-compute[74776]: DEBUG nova.compute.manager [req-b1c4454f-bfe3-4601-add9-e444a9b81ea3 req-b6259fc2-2f7d-4cc1-906d-bc8bea08cc9e service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] No waiting events found dispatching network-vif-plugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:25:48 user nova-compute[74776]: WARNING nova.compute.manager [req-b1c4454f-bfe3-4601-add9-e444a9b81ea3 req-b6259fc2-2f7d-4cc1-906d-bc8bea08cc9e service nova] [instance: d7f3ff5e-292d-4e81-af58-b9a45adfbda1] Received unexpected event network-vif-plugged-81372b6e-8162-4b1f-ac94-dcaf1c8c2473 for instance with vm_state deleted and task_state None.
Nov 22 14:25:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:55 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 370f25d8-d6f4-4de8-b356-d23e6d599f82 is timed out.
Nov 22 14:25:55 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Successfully detached device vdb from instance 370f25d8-d6f4-4de8-b356-d23e6d599f82 from the live domain config.
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJtBOyPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:25:55 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa87d6f-e066-4638-87a3-f9dbbe8d2e79]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0a9af17a-e0c2-42c5-bd6b-689e43bfc9fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb6c7d37-fee0-4eaa-ace3-2f77c8fec66f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:25:55 user nova-compute[74776]: No targets found.
Nov 22 14:25:55 user nova-compute[74776]: iSNS:
Nov 22 14:25:55 user nova-compute[74776]: No targets found.
Nov 22 14:25:55 user nova-compute[74776]: STATIC:
Nov 22 14:25:55 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:0a9af17a-e0c2-42c5-bd6b-689e43bfc9fb
Nov 22 14:25:55 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:25:55 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:25:55 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c
Nov 22 14:25:55 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:25:55 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:25:55 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:fb6c7d37-fee0-4eaa-ace3-2f77c8fec66f
Nov 22 14:25:55 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:25:55 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:25:55 user nova-compute[74776]: FIRMWARE:
Nov 22 14:25:55 user nova-compute[74776]: No targets found.
Nov 22 14:25:55 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:25:55 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:25:55 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3f581a-43ec-4aa4-a40f-cef6ccdd9b87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a9af17a-e0c2-42c5-bd6b-689e43bfc9fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb6c7d37-fee0-4eaa-ace3-2f77c8fec66f\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9bcb19-c744-46cc-a8bd-8acf4fefb6ae]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb6c7d37-fee0-4eaa-ace3-2f77c8fec66f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9af17a-e0c2-42c5-bd6b-689e43bfc9fb (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:25:55 user nova-compute[74776]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb6c7d37-fee0-4eaa-ace3-2f77c8fec66f (non-flash)
Nov 22 14:25:55 user nova-compute[74776]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9af17a-e0c2-42c5-bd6b-689e43bfc9fb (non-flash)
Nov 22 14:25:55 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c (non-flash)
Nov 22 14:25:55 user nova-compute[74776]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb6c7d37-fee0-4eaa-ace3-2f77c8fec66f (non-flash)
Nov 22 14:25:55 user nova-compute[74776]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9af17a-e0c2-42c5-bd6b-689e43bfc9fb (non-flash)
Nov 22 14:25:55 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c387b8ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c'): ({'sdj'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Removing single pathed devices sdj {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36c8c54-7f67-44da-889c-f0b26b29b68c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.029s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c60b02-da7d-4f5a-867a-144ed49cc6e4]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Flushing IO for device /dev/sdj {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bfae89-3a6e-49f7-b655-50b8407b468f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.052s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2d5b1d-2498-44e8-9d71-5aaef151aa5b]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] SCSI volumes sdj have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a9c88a-43af-4bd6-936b-81b19c055334]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:25:55 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Creating image(s)
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Did not create local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Ensure instance console log exists: /opt/stack/data/nova/instances/b30a5c6b-ea71-4a06-ad03-a02ebd584a80/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Start _get_guest_xml network_info=[{"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'da0b7deb-c505-43db-a6c8-38a4aabecbfd', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeMqQUCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b30a5c6b-ea71-4a06-ad03-a02ebd584a80', 'attached_at': '', 'detached_at': '', 'volume_id': '4916cee9-8763-4a88-a0d4-2555e772ec71', 'serial': '4916cee9-8763-4a88-a0d4-2555e772ec71'}, 'boot_index': 0, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a61b98-ac5c-4725-9148-4056438c1c1b]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c, portal: 172.16.0.220,3260]
Nov 22 14:25:55 user nova-compute[74776]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c, portal: 172.16.0.220,3260] successful.
Nov 22 14:25:55 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:55 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:25:55 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeMqQUCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:25:55 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7fc68f-a55a-4023-9c33-e1e828447e8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da7565f-231f-457d-bc81-c1a47fa80994]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] <== disconnect_volume: return (406ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.007s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:25:55 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:25:55 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b533d2b-b334-4aef-9084-dbcfce4b8f25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:25:55 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.040s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ec6e44-7648-45a2-a4ed-ee7a1bc311e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71] added
Nov 22 14:25:55 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fce083c-01a8-46e4-8d7a-2e0dede3e25b]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9c27c5-9dfa-4c3e-8bc8-27a6f78eacd0]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KeMqQUCF {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KeMqQUCF" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[19717a22-94f0-48d9-ba60-905bf3e3050b]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KeMqQUCF'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[352dec73-3c04-4b69-919c-0f9a4cde442a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f419ad2-4a59-46e3-a724-dd151173e503]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb6c7d37-fee0-4eaa-ace3-2f77c8fec66f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9af17a-e0c2-42c5-bd6b-689e43bfc9fb (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb6c7d37-fee0-4eaa-ace3-2f77c8fec66f (non-flash)
Nov 22 14:25:55 user nova-compute[74776]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9af17a-e0c2-42c5-bd6b-689e43bfc9fb (non-flash)
Nov 22 14:25:55 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb6c7d37-fee0-4eaa-ace3-2f77c8fec66f (non-flash)
Nov 22 14:25:55 user nova-compute[74776]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9af17a-e0c2-42c5-bd6b-689e43bfc9fb (non-flash)
Nov 22 14:25:55 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e849cfb-518e-4ca2-ad57-f9eaa0272fba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71, portal: 172.16.0.220,3260]
Nov 22 14:25:55 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71, portal: 172.16.0.220,3260] successful.
Nov 22 14:25:55 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[950f6adb-ec35-4e7e-83a0-a24b034c1369]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:25:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:56 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ef269e-1782-4482-832d-ab8b3fd4f558]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb6c7d37-fee0-4eaa-ace3-2f77c8fec66f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9af17a-e0c2-42c5-bd6b-689e43bfc9fb (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb6c7d37-fee0-4eaa-ace3-2f77c8fec66f (non-flash)
Nov 22 14:25:56 user nova-compute[74776]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9af17a-e0c2-42c5-bd6b-689e43bfc9fb (non-flash)
Nov 22 14:25:56 user nova-compute[74776]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:25:56 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:25:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb6c7d37-fee0-4eaa-ace3-2f77c8fec66f (non-flash)
Nov 22 14:25:56 user nova-compute[74776]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a9af17a-e0c2-42c5-bd6b-689e43bfc9fb (non-flash)
Nov 22 14:25:56 user nova-compute[74776]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:25:56 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:25:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.445s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:25:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:25:56 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:25:56 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:25:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:25:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:25:56 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1bb917-4171-4fe2-b53e-e32f7856e65a]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:25:56 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:25:56 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeMqQUCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:25:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:56 user nova-compute[74776]: DEBUG nova.objects.instance [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lazy-loading 'flavor' on Instance uuid 370f25d8-d6f4-4de8-b356-d23e6d599f82 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:25:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-fc650ded-a263-4c9d-8fd6-f9c6ce15b915 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.393s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.491s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] <== connect_volume: return (1499ms) {'type': 'block', 'scsi_wwn': '26330316233623737', 'path': '/dev/sdd'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330316233623737', 'path': '/dev/sdd'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:25:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-119206767',display_name='tempest-TestShelveInstance-server-119206767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-119206767',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAY6ASuS5HQb0Xhyk8b/r17lDnLrYyVvejz9OGw9Kf2fl3G9OMz9U29Vip6hne9mXyZRC73c3UMqFhEVUf4qdE4RGUmgaMzQe1KU1y7kuHHYBb8TVv/cp8qnXOvkKgma9g==',key_name='tempest-TestShelveInstance-457038765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='529b6ffebfe549278c4462796677a969',ramdisk_id='',reservation_id='r-lsktxgb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-853764329',owner_user_name='tempest-TestShelveInstance-853764329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:25:46Z,user_data=None,user_id='1d42ed53e03c4b6b8989293a3737d2f2',uuid=b30a5c6b-ea71-4a06-ad03-a02ebd584a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Converting VIF {"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:cc:9b,bridge_name='br-int',has_traffic_filtering=True,id=5b603149-0a4f-4aac-890c-fade34245023,network=Network(bac4cf3b-8492-4d07-859d-266e1cddf6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b603149-0a') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG nova.objects.instance [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lazy-loading 'pci_devices' on Instance uuid b30a5c6b-ea71-4a06-ad03-a02ebd584a80 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:25:57 user nova-compute[74776]:   <uuid>b30a5c6b-ea71-4a06-ad03-a02ebd584a80</uuid>
Nov 22 14:25:57 user nova-compute[74776]:   <name>instance-00000018</name>
Nov 22 14:25:57 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:25:57 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:25:57 user nova-compute[74776]:   <metadata>
Nov 22 14:25:57 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:25:57 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:25:57 user nova-compute[74776]:       <nova:name>tempest-TestShelveInstance-server-119206767</nova:name>
Nov 22 14:25:57 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:25:55</nova:creationTime>
Nov 22 14:25:57 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:25:57 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:25:57 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:25:57 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:25:57 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:25:57 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:25:57 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:25:57 user nova-compute[74776]:       <nova:owner>
Nov 22 14:25:57 user nova-compute[74776]:         <nova:user uuid="1d42ed53e03c4b6b8989293a3737d2f2">tempest-TestShelveInstance-853764329-project-member</nova:user>
Nov 22 14:25:57 user nova-compute[74776]:         <nova:project uuid="529b6ffebfe549278c4462796677a969">tempest-TestShelveInstance-853764329</nova:project>
Nov 22 14:25:57 user nova-compute[74776]:       </nova:owner>
Nov 22 14:25:57 user nova-compute[74776]:       <nova:ports>
Nov 22 14:25:57 user nova-compute[74776]:         <nova:port uuid="5b603149-0a4f-4aac-890c-fade34245023">
Nov 22 14:25:57 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 14:25:57 user nova-compute[74776]:         </nova:port>
Nov 22 14:25:57 user nova-compute[74776]:       </nova:ports>
Nov 22 14:25:57 user nova-compute[74776]:     </nova:instance>
Nov 22 14:25:57 user nova-compute[74776]:   </metadata>
Nov 22 14:25:57 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:25:57 user nova-compute[74776]:     <system>
Nov 22 14:25:57 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:25:57 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:25:57 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:25:57 user nova-compute[74776]:       <entry name="serial">b30a5c6b-ea71-4a06-ad03-a02ebd584a80</entry>
Nov 22 14:25:57 user nova-compute[74776]:       <entry name="uuid">b30a5c6b-ea71-4a06-ad03-a02ebd584a80</entry>
Nov 22 14:25:57 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:25:57 user nova-compute[74776]:     </system>
Nov 22 14:25:57 user nova-compute[74776]:   </sysinfo>
Nov 22 14:25:57 user nova-compute[74776]:   <os>
Nov 22 14:25:57 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:25:57 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:25:57 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:25:57 user nova-compute[74776]:   </os>
Nov 22 14:25:57 user nova-compute[74776]:   <features>
Nov 22 14:25:57 user nova-compute[74776]:     <acpi/>
Nov 22 14:25:57 user nova-compute[74776]:     <apic/>
Nov 22 14:25:57 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:25:57 user nova-compute[74776]:   </features>
Nov 22 14:25:57 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:25:57 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:25:57 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:25:57 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:25:57 user nova-compute[74776]:   </clock>
Nov 22 14:25:57 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:25:57 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:25:57 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:25:57 user nova-compute[74776]:   </cpu>
Nov 22 14:25:57 user nova-compute[74776]:   <devices>
Nov 22 14:25:57 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:25:57 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:25:57 user nova-compute[74776]:       <source dev="/dev/sdd"/>
Nov 22 14:25:57 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:25:57 user nova-compute[74776]:       <serial>4916cee9-8763-4a88-a0d4-2555e772ec71</serial>
Nov 22 14:25:57 user nova-compute[74776]:     </disk>
Nov 22 14:25:57 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:25:57 user nova-compute[74776]:       <mac address="fa:16:3e:c6:cc:9b"/>
Nov 22 14:25:57 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:25:57 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:25:57 user nova-compute[74776]:       <target dev="tap5b603149-0a"/>
Nov 22 14:25:57 user nova-compute[74776]:     </interface>
Nov 22 14:25:57 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:25:57 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/b30a5c6b-ea71-4a06-ad03-a02ebd584a80/console.log" append="off"/>
Nov 22 14:25:57 user nova-compute[74776]:     </serial>
Nov 22 14:25:57 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:25:57 user nova-compute[74776]:     <video>
Nov 22 14:25:57 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:25:57 user nova-compute[74776]:     </video>
Nov 22 14:25:57 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:25:57 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:25:57 user nova-compute[74776]:     </rng>
Nov 22 14:25:57 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:25:57 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:25:57 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:25:57 user nova-compute[74776]:     </memballoon>
Nov 22 14:25:57 user nova-compute[74776]:   </devices>
Nov 22 14:25:57 user nova-compute[74776]: </domain>
Nov 22 14:25:57 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:25:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-119206767',display_name='tempest-TestShelveInstance-server-119206767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-119206767',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAY6ASuS5HQb0Xhyk8b/r17lDnLrYyVvejz9OGw9Kf2fl3G9OMz9U29Vip6hne9mXyZRC73c3UMqFhEVUf4qdE4RGUmgaMzQe1KU1y7kuHHYBb8TVv/cp8qnXOvkKgma9g==',key_name='tempest-TestShelveInstance-457038765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='529b6ffebfe549278c4462796677a969',ramdisk_id='',reservation_id='r-lsktxgb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-853764329',owner_user_name='tempest-TestShelveInstance-853764329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:25:46Z,user_data=None,user_id='1d42ed53e03c4b6b8989293a3737d2f2',uuid=b30a5c6b-ea71-4a06-ad03-a02ebd584a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Converting VIF {"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:cc:9b,bridge_name='br-int',has_traffic_filtering=True,id=5b603149-0a4f-4aac-890c-fade34245023,network=Network(bac4cf3b-8492-4d07-859d-266e1cddf6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b603149-0a') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG os_vif [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:cc:9b,bridge_name='br-int',has_traffic_filtering=True,id=5b603149-0a4f-4aac-890c-fade34245023,network=Network(bac4cf3b-8492-4d07-859d-266e1cddf6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b603149-0a') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a98b0142-4370-5722-b742-9775ff54e7c7', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b603149-0a, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b603149-0a, col_values=(('qos', UUID('1bc1e511-b069-4aa5-96b0-273ca6976f59')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b603149-0a, col_values=(('external_ids', {'iface-id': '5b603149-0a4f-4aac-890c-fade34245023', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:cc:9b', 'vm-uuid': 'b30a5c6b-ea71-4a06-ad03-a02ebd584a80'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:57 user nova-compute[74776]: INFO os_vif [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:cc:9b,bridge_name='br-int',has_traffic_filtering=True,id=5b603149-0a4f-4aac-890c-fade34245023,network=Network(bac4cf3b-8492-4d07-859d-266e1cddf6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b603149-0a')
Nov 22 14:25:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:25:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] No VIF found with MAC fa:16:3e:c6:cc:9b, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:25:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:59 user nova-compute[74776]: DEBUG nova.compute.manager [req-b8db2b06-ea9e-48c3-9107-520903a6ae08 req-c8791144-216a-41f5-8a66-c429e15f158a service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received event network-vif-plugged-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:25:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b8db2b06-ea9e-48c3-9107-520903a6ae08 req-c8791144-216a-41f5-8a66-c429e15f158a service nova] Acquiring lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:25:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b8db2b06-ea9e-48c3-9107-520903a6ae08 req-c8791144-216a-41f5-8a66-c429e15f158a service nova] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:25:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b8db2b06-ea9e-48c3-9107-520903a6ae08 req-c8791144-216a-41f5-8a66-c429e15f158a service nova] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:25:59 user nova-compute[74776]: DEBUG nova.compute.manager [req-b8db2b06-ea9e-48c3-9107-520903a6ae08 req-c8791144-216a-41f5-8a66-c429e15f158a service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] No waiting events found dispatching network-vif-plugged-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:25:59 user nova-compute[74776]: WARNING nova.compute.manager [req-b8db2b06-ea9e-48c3-9107-520903a6ae08 req-c8791144-216a-41f5-8a66-c429e15f158a service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received unexpected event network-vif-plugged-5b603149-0a4f-4aac-890c-fade34245023 for instance with vm_state building and task_state spawning.
Nov 22 14:25:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:25:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:01 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:26:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:26:01 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Instance spawned successfully.
Nov 22 14:26:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:26:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:26:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:26:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:26:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:26:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:26:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:26:01 user nova-compute[74776]: INFO nova.compute.manager [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 22 14:26:01 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:26:01 user nova-compute[74776]: DEBUG nova.compute.manager [req-e2200c2f-a0a1-49a6-a6aa-fd67f46d0c1e req-0744139f-63bf-4d26-844d-4d48514b13e5 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received event network-vif-plugged-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:26:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e2200c2f-a0a1-49a6-a6aa-fd67f46d0c1e req-0744139f-63bf-4d26-844d-4d48514b13e5 service nova] Acquiring lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e2200c2f-a0a1-49a6-a6aa-fd67f46d0c1e req-0744139f-63bf-4d26-844d-4d48514b13e5 service nova] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e2200c2f-a0a1-49a6-a6aa-fd67f46d0c1e req-0744139f-63bf-4d26-844d-4d48514b13e5 service nova] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:01 user nova-compute[74776]: DEBUG nova.compute.manager [req-e2200c2f-a0a1-49a6-a6aa-fd67f46d0c1e req-0744139f-63bf-4d26-844d-4d48514b13e5 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] No waiting events found dispatching network-vif-plugged-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:26:01 user nova-compute[74776]: WARNING nova.compute.manager [req-e2200c2f-a0a1-49a6-a6aa-fd67f46d0c1e req-0744139f-63bf-4d26-844d-4d48514b13e5 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received unexpected event network-vif-plugged-5b603149-0a4f-4aac-890c-fade34245023 for instance with vm_state building and task_state spawning.
Nov 22 14:26:01 user nova-compute[74776]: INFO nova.compute.manager [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Took 16.14 seconds to build instance.
Nov 22 14:26:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3133570-c49d-4ce0-a5cd-ac2e05c227b9 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.239s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:11 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:26:11 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:26:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:12 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:26:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:26:13 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:26:13 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:26:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-6f2ce4b2-660c-431f-b951-c6ec5090ef7e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:26:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-6f2ce4b2-660c-431f-b951-c6ec5090ef7e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:26:14 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:26:14 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Updating instance_info_cache with network_info: [{"id": "c83b6599-820f-462a-bd26-af48014d7d7d", "address": "fa:16:3e:18:32:09", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b6599-82", "ovs_interfaceid": "c83b6599-820f-462a-bd26-af48014d7d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:26:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-6f2ce4b2-660c-431f-b951-c6ec5090ef7e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:26:14 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:26:14 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:26:14 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:26:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:14 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:26:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:26:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:19 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:26:19 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:26:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=7621MB free_disk=25.28862762451172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:26:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4629d82d-fd02-4a58-a535-b362b493e7c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:26:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 525baf66-82cc-4e8d-a37a-c92c51d4673d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:26:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6f2ce4b2-660c-431f-b951-c6ec5090ef7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:26:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 370f25d8-d6f4-4de8-b356-d23e6d599f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:26:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f4f30fe7-b234-4f81-b081-3214f5ebe789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:26:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 016bf051-9034-4124-948d-995aacf77caf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:26:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:26:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance b30a5c6b-ea71-4a06-ad03-a02ebd584a80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:26:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:26:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:26:19 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:26:19 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:26:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:26:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.408s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:20 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:26:20 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:26:20 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:26:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:22 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:26:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "370f25d8-d6f4-4de8-b356-d23e6d599f82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "370f25d8-d6f4-4de8-b356-d23e6d599f82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:24 user nova-compute[74776]: INFO nova.compute.manager [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Terminating instance
Nov 22 14:26:24 user nova-compute[74776]: DEBUG nova.compute.manager [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:26:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-cd53ca3e-f669-47ff-83c6-02bdf79b7c29 req-abae58a0-c03b-4b25-9bab-2e8660679ed1 service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Received event network-vif-unplugged-f8b7835a-016f-47b2-beee-46b3cb6f3391 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cd53ca3e-f669-47ff-83c6-02bdf79b7c29 req-abae58a0-c03b-4b25-9bab-2e8660679ed1 service nova] Acquiring lock "370f25d8-d6f4-4de8-b356-d23e6d599f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cd53ca3e-f669-47ff-83c6-02bdf79b7c29 req-abae58a0-c03b-4b25-9bab-2e8660679ed1 service nova] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cd53ca3e-f669-47ff-83c6-02bdf79b7c29 req-abae58a0-c03b-4b25-9bab-2e8660679ed1 service nova] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-cd53ca3e-f669-47ff-83c6-02bdf79b7c29 req-abae58a0-c03b-4b25-9bab-2e8660679ed1 service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] No waiting events found dispatching network-vif-unplugged-f8b7835a-016f-47b2-beee-46b3cb6f3391 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-cd53ca3e-f669-47ff-83c6-02bdf79b7c29 req-abae58a0-c03b-4b25-9bab-2e8660679ed1 service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Received event network-vif-unplugged-f8b7835a-016f-47b2-beee-46b3cb6f3391 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:25 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Instance destroyed successfully.
Nov 22 14:26:25 user nova-compute[74776]: DEBUG nova.objects.instance [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lazy-loading 'resources' on Instance uuid 370f25d8-d6f4-4de8-b356-d23e6d599f82 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1238762216',display_name='tempest-AttachVolumeNegativeTest-server-1238762216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1238762216',id=17,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjoRiEHaLOhNdxtIZ/d/tQ/DxPGxUEGZHPirmUVpCWjg2IoFMzlolqY3pLtCnZx1/h8VHGx4MxVWrsFandyObmXjC1QfG5Zx6tBd7ecWQXl5J52jFD5G/cx8Pm2b7HSHA==',key_name='tempest-keypair-143503295',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:20:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dee58d331979425eb9d48d2a52fc1f68',ramdisk_id='',reservation_id='r-j04gnq22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-577275639',owner_user_name='tempest-AttachVolumeNegativeTest-577275639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:20:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1807bb240de749499809fd3dfb520d78',uuid=370f25d8-d6f4-4de8-b356-d23e6d599f82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "address": "fa:16:3e:81:7b:fe", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b7835a-01", "ovs_interfaceid": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converting VIF {"id": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "address": "fa:16:3e:81:7b:fe", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8b7835a-01", "ovs_interfaceid": "f8b7835a-016f-47b2-beee-46b3cb6f3391", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:7b:fe,bridge_name='br-int',has_traffic_filtering=True,id=f8b7835a-016f-47b2-beee-46b3cb6f3391,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8b7835a-01') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG os_vif [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:7b:fe,bridge_name='br-int',has_traffic_filtering=True,id=f8b7835a-016f-47b2-beee-46b3cb6f3391,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8b7835a-01') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8b7835a-01, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b70c55f-585d-4409-91de-cd20a5b25f67) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:25 user nova-compute[74776]: INFO os_vif [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:7b:fe,bridge_name='br-int',has_traffic_filtering=True,id=f8b7835a-016f-47b2-beee-46b3cb6f3391,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8b7835a-01')
Nov 22 14:26:25 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Deleting instance files /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82_del
Nov 22 14:26:25 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Deletion of /opt/stack/data/nova/instances/370f25d8-d6f4-4de8-b356-d23e6d599f82_del complete
Nov 22 14:26:25 user nova-compute[74776]: INFO nova.compute.manager [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 22 14:26:25 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:26:25 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:26:26 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:26:26 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Took 0.76 seconds to deallocate network for instance.
Nov 22 14:26:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-f4bafe68-376f-4a13-b0b6-2d7b13a3034c req-dbdc2c0d-671b-4908-98fa-df9b4daa7f14 service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Received event network-vif-deleted-f8b7835a-016f-47b2-beee-46b3cb6f3391 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:26:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:27 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:26:27 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:26:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:27 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Deleted allocations for instance 370f25d8-d6f4-4de8-b356-d23e6d599f82
Nov 22 14:26:27 user nova-compute[74776]: DEBUG nova.compute.manager [req-2f8ca1e3-cc47-4eee-8350-8048d4d32998 req-84454414-9754-44f9-a157-e28e6de8f9db service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Received event network-vif-plugged-f8b7835a-016f-47b2-beee-46b3cb6f3391 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:26:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2f8ca1e3-cc47-4eee-8350-8048d4d32998 req-84454414-9754-44f9-a157-e28e6de8f9db service nova] Acquiring lock "370f25d8-d6f4-4de8-b356-d23e6d599f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2f8ca1e3-cc47-4eee-8350-8048d4d32998 req-84454414-9754-44f9-a157-e28e6de8f9db service nova] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2f8ca1e3-cc47-4eee-8350-8048d4d32998 req-84454414-9754-44f9-a157-e28e6de8f9db service nova] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:27 user nova-compute[74776]: DEBUG nova.compute.manager [req-2f8ca1e3-cc47-4eee-8350-8048d4d32998 req-84454414-9754-44f9-a157-e28e6de8f9db service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] No waiting events found dispatching network-vif-plugged-f8b7835a-016f-47b2-beee-46b3cb6f3391 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:26:27 user nova-compute[74776]: WARNING nova.compute.manager [req-2f8ca1e3-cc47-4eee-8350-8048d4d32998 req-84454414-9754-44f9-a157-e28e6de8f9db service nova] [instance: 370f25d8-d6f4-4de8-b356-d23e6d599f82] Received unexpected event network-vif-plugged-f8b7835a-016f-47b2-beee-46b3cb6f3391 for instance with vm_state deleted and task_state None.
Nov 22 14:26:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-937ac920-f689-404b-8071-4bd40a519f91 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "370f25d8-d6f4-4de8-b356-d23e6d599f82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.494s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:27 user nova-compute[74776]: DEBUG nova.compute.manager [req-15d49ef0-0657-426d-a8a1-3a14879abd7b req-d94a82e7-0693-43cf-8894-3b41757eded0 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Received event network-changed-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:26:27 user nova-compute[74776]: DEBUG nova.compute.manager [req-15d49ef0-0657-426d-a8a1-3a14879abd7b req-d94a82e7-0693-43cf-8894-3b41757eded0 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Refreshing instance network info cache due to event network-changed-19e9bf95-eee7-41e4-95ab-4f18f612d2c5. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:26:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-15d49ef0-0657-426d-a8a1-3a14879abd7b req-d94a82e7-0693-43cf-8894-3b41757eded0 service nova] Acquiring lock "refresh_cache-016bf051-9034-4124-948d-995aacf77caf" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:26:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-15d49ef0-0657-426d-a8a1-3a14879abd7b req-d94a82e7-0693-43cf-8894-3b41757eded0 service nova] Acquired lock "refresh_cache-016bf051-9034-4124-948d-995aacf77caf" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:26:27 user nova-compute[74776]: DEBUG nova.network.neutron [req-15d49ef0-0657-426d-a8a1-3a14879abd7b req-d94a82e7-0693-43cf-8894-3b41757eded0 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Refreshing network info cache for port 19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:26:28 user nova-compute[74776]: DEBUG nova.network.neutron [req-15d49ef0-0657-426d-a8a1-3a14879abd7b req-d94a82e7-0693-43cf-8894-3b41757eded0 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Updated VIF entry in instance network info cache for port 19e9bf95-eee7-41e4-95ab-4f18f612d2c5. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:26:28 user nova-compute[74776]: DEBUG nova.network.neutron [req-15d49ef0-0657-426d-a8a1-3a14879abd7b req-d94a82e7-0693-43cf-8894-3b41757eded0 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Updating instance_info_cache with network_info: [{"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:26:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-15d49ef0-0657-426d-a8a1-3a14879abd7b req-d94a82e7-0693-43cf-8894-3b41757eded0 service nova] Releasing lock "refresh_cache-016bf051-9034-4124-948d-995aacf77caf" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:26:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:32 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:26:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:32 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:26:32 user nova-compute[74776]: INFO nova.compute.claims [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Claim successful on node user
Nov 22 14:26:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "016bf051-9034-4124-948d-995aacf77caf" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "016bf051-9034-4124-948d-995aacf77caf" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:32 user nova-compute[74776]: INFO nova.compute.manager [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Shelving
Nov 22 14:26:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:26:33 user nova-compute[74776]: DEBUG nova.compute.manager [req-7c0006a0-b948-4b34-a35b-c3b6a476eecc req-6bf706ec-e331-41a1-b2aa-f0e8f7c7a216 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Received event network-vif-unplugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:26:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7c0006a0-b948-4b34-a35b-c3b6a476eecc req-6bf706ec-e331-41a1-b2aa-f0e8f7c7a216 service nova] Acquiring lock "016bf051-9034-4124-948d-995aacf77caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7c0006a0-b948-4b34-a35b-c3b6a476eecc req-6bf706ec-e331-41a1-b2aa-f0e8f7c7a216 service nova] Lock "016bf051-9034-4124-948d-995aacf77caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7c0006a0-b948-4b34-a35b-c3b6a476eecc req-6bf706ec-e331-41a1-b2aa-f0e8f7c7a216 service nova] Lock "016bf051-9034-4124-948d-995aacf77caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:33 user nova-compute[74776]: DEBUG nova.compute.manager [req-7c0006a0-b948-4b34-a35b-c3b6a476eecc req-6bf706ec-e331-41a1-b2aa-f0e8f7c7a216 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] No waiting events found dispatching network-vif-unplugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:26:33 user nova-compute[74776]: WARNING nova.compute.manager [req-7c0006a0-b948-4b34-a35b-c3b6a476eecc req-6bf706ec-e331-41a1-b2aa-f0e8f7c7a216 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Received unexpected event network-vif-unplugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 for instance with vm_state active and task_state shelving.
Nov 22 14:26:33 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:26:33 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:26:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.739s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:26:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.084s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:33 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:26:33 user nova-compute[74776]: INFO nova.compute.claims [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Claim successful on node user
Nov 22 14:26:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:26:33 user nova-compute[74776]: DEBUG nova.network.neutron [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:26:33 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:26:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:26:33 user nova-compute[74776]: DEBUG nova.policy [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dea876275c70471d9cba1c3158bd63e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359aba8e95e4090a02fb0a46012f20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:26:33 user nova-compute[74776]: INFO nova.virt.block_device [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Booting with blank volume at /dev/vda
Nov 22 14:26:33 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 016bf051-9034-4124-948d-995aacf77caf] Instance destroyed successfully.
Nov 22 14:26:33 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:26:33 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Beginning cold snapshot process
Nov 22 14:26:33 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:26:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:26:34 user nova-compute[74776]: DEBUG nova.compute.manager [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:26:34 user nova-compute[74776]: DEBUG nova.network.neutron [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:26:34 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:26:34 user nova-compute[74776]: DEBUG nova.compute.manager [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:26:34 user nova-compute[74776]: DEBUG nova.privsep.utils [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74776) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 14:26:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk /opt/stack/data/nova/instances/snapshots/tmppli1il_w/9a9b091c39704f51a043ebde0984d575 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:34 user nova-compute[74776]: DEBUG nova.policy [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd5bd7dac415438898e5773c1722f633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae8f6ccdd1d4762945614272ca75a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:26:34 user nova-compute[74776]: DEBUG nova.compute.manager [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:26:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:26:34 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Creating image(s)
Nov 22 14:26:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "/opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "/opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "/opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:34 user nova-compute[74776]: DEBUG nova.network.neutron [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Successfully created port: 5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:26:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.312s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.253s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk 1073741824" returned: 0 in 0.138s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.398s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG nova.network.neutron [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Successfully created port: 600b1da5-d75f-48ff-a470-b92c141a5a8f {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG nova.compute.manager [req-7222e92b-027e-4d54-8514-581a1f5301e2 req-97066939-7296-4dfa-9cc2-68378f2edab2 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Received event network-vif-plugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7222e92b-027e-4d54-8514-581a1f5301e2 req-97066939-7296-4dfa-9cc2-68378f2edab2 service nova] Acquiring lock "016bf051-9034-4124-948d-995aacf77caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7222e92b-027e-4d54-8514-581a1f5301e2 req-97066939-7296-4dfa-9cc2-68378f2edab2 service nova] Lock "016bf051-9034-4124-948d-995aacf77caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7222e92b-027e-4d54-8514-581a1f5301e2 req-97066939-7296-4dfa-9cc2-68378f2edab2 service nova] Lock "016bf051-9034-4124-948d-995aacf77caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG nova.compute.manager [req-7222e92b-027e-4d54-8514-581a1f5301e2 req-97066939-7296-4dfa-9cc2-68378f2edab2 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] No waiting events found dispatching network-vif-plugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:26:35 user nova-compute[74776]: WARNING nova.compute.manager [req-7222e92b-027e-4d54-8514-581a1f5301e2 req-97066939-7296-4dfa-9cc2-68378f2edab2 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Received unexpected event network-vif-plugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 22 14:26:35 user nova-compute[74776]: DEBUG nova.network.neutron [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Successfully updated port: 5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.227s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk /opt/stack/data/nova/instances/snapshots/tmppli1il_w/9a9b091c39704f51a043ebde0984d575" returned: 0 in 1.146s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:35 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Snapshot extracted, beginning image upload
Nov 22 14:26:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "refresh_cache-bc98341b-ca28-4097-9887-16c8e8d7f9f7" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquired lock "refresh_cache-bc98341b-ca28-4097-9887-16c8e8d7f9f7" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG nova.network.neutron [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG nova.network.neutron [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG nova.compute.manager [req-9206e7cf-6d67-445a-a3e7-0dfe4e22ecc9 req-99f5b8b7-23ab-4806-a7c8-99a10a239afc service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received event network-changed-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG nova.compute.manager [req-9206e7cf-6d67-445a-a3e7-0dfe4e22ecc9 req-99f5b8b7-23ab-4806-a7c8-99a10a239afc service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Refreshing instance network info cache due to event network-changed-5cec0cf0-892c-4c30-ae08-7e127098bccf. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9206e7cf-6d67-445a-a3e7-0dfe4e22ecc9 req-99f5b8b7-23ab-4806-a7c8-99a10a239afc service nova] Acquiring lock "refresh_cache-bc98341b-ca28-4097-9887-16c8e8d7f9f7" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Cannot resize image /opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Ensure instance console log exists: /opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG nova.network.neutron [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Updating instance_info_cache with network_info: [{"id": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "address": "fa:16:3e:5f:fc:12", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cec0cf0-89", "ovs_interfaceid": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Releasing lock "refresh_cache-bc98341b-ca28-4097-9887-16c8e8d7f9f7" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Instance network_info: |[{"id": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "address": "fa:16:3e:5f:fc:12", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cec0cf0-89", "ovs_interfaceid": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9206e7cf-6d67-445a-a3e7-0dfe4e22ecc9 req-99f5b8b7-23ab-4806-a7c8-99a10a239afc service nova] Acquired lock "refresh_cache-bc98341b-ca28-4097-9887-16c8e8d7f9f7" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:26:35 user nova-compute[74776]: DEBUG nova.network.neutron [req-9206e7cf-6d67-445a-a3e7-0dfe4e22ecc9 req-99f5b8b7-23ab-4806-a7c8-99a10a239afc service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Refreshing network info cache for port 5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.network.neutron [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Successfully updated port: 600b1da5-d75f-48ff-a470-b92c141a5a8f {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "refresh_cache-96a7c6ec-0cb9-481b-8ec5-4337130bc000" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquired lock "refresh_cache-96a7c6ec-0cb9-481b-8ec5-4337130bc000" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.network.neutron [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.network.neutron [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.network.neutron [req-9206e7cf-6d67-445a-a3e7-0dfe4e22ecc9 req-99f5b8b7-23ab-4806-a7c8-99a10a239afc service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Updated VIF entry in instance network info cache for port 5cec0cf0-892c-4c30-ae08-7e127098bccf. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.network.neutron [req-9206e7cf-6d67-445a-a3e7-0dfe4e22ecc9 req-99f5b8b7-23ab-4806-a7c8-99a10a239afc service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Updating instance_info_cache with network_info: [{"id": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "address": "fa:16:3e:5f:fc:12", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cec0cf0-89", "ovs_interfaceid": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9206e7cf-6d67-445a-a3e7-0dfe4e22ecc9 req-99f5b8b7-23ab-4806-a7c8-99a10a239afc service nova] Releasing lock "refresh_cache-bc98341b-ca28-4097-9887-16c8e8d7f9f7" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.network.neutron [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Updating instance_info_cache with network_info: [{"id": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "address": "fa:16:3e:9e:bf:17", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap600b1da5-d7", "ovs_interfaceid": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Releasing lock "refresh_cache-96a7c6ec-0cb9-481b-8ec5-4337130bc000" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Instance network_info: |[{"id": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "address": "fa:16:3e:9e:bf:17", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap600b1da5-d7", "ovs_interfaceid": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Start _get_guest_xml network_info=[{"id": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "address": "fa:16:3e:9e:bf:17", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap600b1da5-d7", "ovs_interfaceid": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:26:36 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:26:36 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:26:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-102260688',display_name='tempest-VolumesSnapshotTestJSON-instance-102260688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-102260688',id=26,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL+eoX2rggHYJ9Zd6+4KubyUbllnA4QRQoDHqoMPUoSgIjzSqJ+Jb8jAeS+/8lsFvIdPoWyF/nhbpo/uBrjvDzBnqIgyk0cX25ChqHmeLUyQfR2gmspcTphwWfLgO6Cyw==',key_name='tempest-keypair-1130718677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ae8f6ccdd1d4762945614272ca75a1c',ramdisk_id='',reservation_id='r-kr9fcrnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1416311759',owner_user_name='tempest-VolumesSnapshotTestJSON-1416311759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:26:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd5bd7dac415438898e5773c1722f633',uuid=96a7c6ec-0cb9-481b-8ec5-4337130bc000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "address": "fa:16:3e:9e:bf:17", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap600b1da5-d7", "ovs_interfaceid": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Converting VIF {"id": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "address": "fa:16:3e:9e:bf:17", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap600b1da5-d7", "ovs_interfaceid": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:bf:17,bridge_name='br-int',has_traffic_filtering=True,id=600b1da5-d75f-48ff-a470-b92c141a5a8f,network=Network(e38b6baa-4dea-488c-ad93-634cb26fdb5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap600b1da5-d7') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.objects.instance [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lazy-loading 'pci_devices' on Instance uuid 96a7c6ec-0cb9-481b-8ec5-4337130bc000 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:26:36 user nova-compute[74776]:   <uuid>96a7c6ec-0cb9-481b-8ec5-4337130bc000</uuid>
Nov 22 14:26:36 user nova-compute[74776]:   <name>instance-0000001a</name>
Nov 22 14:26:36 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:26:36 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:26:36 user nova-compute[74776]:   <metadata>
Nov 22 14:26:36 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:26:36 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:26:36 user nova-compute[74776]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-102260688</nova:name>
Nov 22 14:26:36 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:26:36</nova:creationTime>
Nov 22 14:26:36 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:26:36 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:26:36 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:26:36 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:26:36 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:26:36 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:26:36 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:26:36 user nova-compute[74776]:       <nova:owner>
Nov 22 14:26:36 user nova-compute[74776]:         <nova:user uuid="bd5bd7dac415438898e5773c1722f633">tempest-VolumesSnapshotTestJSON-1416311759-project-member</nova:user>
Nov 22 14:26:36 user nova-compute[74776]:         <nova:project uuid="1ae8f6ccdd1d4762945614272ca75a1c">tempest-VolumesSnapshotTestJSON-1416311759</nova:project>
Nov 22 14:26:36 user nova-compute[74776]:       </nova:owner>
Nov 22 14:26:36 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:26:36 user nova-compute[74776]:       <nova:ports>
Nov 22 14:26:36 user nova-compute[74776]:         <nova:port uuid="600b1da5-d75f-48ff-a470-b92c141a5a8f">
Nov 22 14:26:36 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 22 14:26:36 user nova-compute[74776]:         </nova:port>
Nov 22 14:26:36 user nova-compute[74776]:       </nova:ports>
Nov 22 14:26:36 user nova-compute[74776]:     </nova:instance>
Nov 22 14:26:36 user nova-compute[74776]:   </metadata>
Nov 22 14:26:36 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:26:36 user nova-compute[74776]:     <system>
Nov 22 14:26:36 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:26:36 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:26:36 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:26:36 user nova-compute[74776]:       <entry name="serial">96a7c6ec-0cb9-481b-8ec5-4337130bc000</entry>
Nov 22 14:26:36 user nova-compute[74776]:       <entry name="uuid">96a7c6ec-0cb9-481b-8ec5-4337130bc000</entry>
Nov 22 14:26:36 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:26:36 user nova-compute[74776]:     </system>
Nov 22 14:26:36 user nova-compute[74776]:   </sysinfo>
Nov 22 14:26:36 user nova-compute[74776]:   <os>
Nov 22 14:26:36 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:26:36 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:26:36 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:26:36 user nova-compute[74776]:   </os>
Nov 22 14:26:36 user nova-compute[74776]:   <features>
Nov 22 14:26:36 user nova-compute[74776]:     <acpi/>
Nov 22 14:26:36 user nova-compute[74776]:     <apic/>
Nov 22 14:26:36 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:26:36 user nova-compute[74776]:   </features>
Nov 22 14:26:36 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:26:36 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:26:36 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:26:36 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:26:36 user nova-compute[74776]:   </clock>
Nov 22 14:26:36 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:26:36 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:26:36 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:26:36 user nova-compute[74776]:   </cpu>
Nov 22 14:26:36 user nova-compute[74776]:   <devices>
Nov 22 14:26:36 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:26:36 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:26:36 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk"/>
Nov 22 14:26:36 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:26:36 user nova-compute[74776]:     </disk>
Nov 22 14:26:36 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:26:36 user nova-compute[74776]:       <mac address="fa:16:3e:9e:bf:17"/>
Nov 22 14:26:36 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:26:36 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:26:36 user nova-compute[74776]:       <target dev="tap600b1da5-d7"/>
Nov 22 14:26:36 user nova-compute[74776]:     </interface>
Nov 22 14:26:36 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:26:36 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/console.log" append="off"/>
Nov 22 14:26:36 user nova-compute[74776]:     </serial>
Nov 22 14:26:36 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:26:36 user nova-compute[74776]:     <video>
Nov 22 14:26:36 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:26:36 user nova-compute[74776]:     </video>
Nov 22 14:26:36 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:26:36 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:26:36 user nova-compute[74776]:     </rng>
Nov 22 14:26:36 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:26:36 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:26:36 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:26:36 user nova-compute[74776]:     </memballoon>
Nov 22 14:26:36 user nova-compute[74776]:   </devices>
Nov 22 14:26:36 user nova-compute[74776]: </domain>
Nov 22 14:26:36 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:26:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-102260688',display_name='tempest-VolumesSnapshotTestJSON-instance-102260688',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-102260688',id=26,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL+eoX2rggHYJ9Zd6+4KubyUbllnA4QRQoDHqoMPUoSgIjzSqJ+Jb8jAeS+/8lsFvIdPoWyF/nhbpo/uBrjvDzBnqIgyk0cX25ChqHmeLUyQfR2gmspcTphwWfLgO6Cyw==',key_name='tempest-keypair-1130718677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ae8f6ccdd1d4762945614272ca75a1c',ramdisk_id='',reservation_id='r-kr9fcrnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1416311759',owner_user_name='tempest-VolumesSnapshotTestJSON-1416311759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:26:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd5bd7dac415438898e5773c1722f633',uuid=96a7c6ec-0cb9-481b-8ec5-4337130bc000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "address": "fa:16:3e:9e:bf:17", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap600b1da5-d7", "ovs_interfaceid": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Converting VIF {"id": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "address": "fa:16:3e:9e:bf:17", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap600b1da5-d7", "ovs_interfaceid": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:bf:17,bridge_name='br-int',has_traffic_filtering=True,id=600b1da5-d75f-48ff-a470-b92c141a5a8f,network=Network(e38b6baa-4dea-488c-ad93-634cb26fdb5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap600b1da5-d7') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG os_vif [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:bf:17,bridge_name='br-int',has_traffic_filtering=True,id=600b1da5-d75f-48ff-a470-b92c141a5a8f,network=Network(e38b6baa-4dea-488c-ad93-634cb26fdb5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap600b1da5-d7') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac04be38-0c6b-54b5-ba49-119462e293ea', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap600b1da5-d7, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap600b1da5-d7, col_values=(('qos', UUID('630bbd26-6f53-4171-b476-54c1d09ef82a')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap600b1da5-d7, col_values=(('external_ids', {'iface-id': '600b1da5-d75f-48ff-a470-b92c141a5a8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:bf:17', 'vm-uuid': '96a7c6ec-0cb9-481b-8ec5-4337130bc000'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:36 user nova-compute[74776]: INFO os_vif [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:bf:17,bridge_name='br-int',has_traffic_filtering=True,id=600b1da5-d75f-48ff-a470-b92c141a5a8f,network=Network(e38b6baa-4dea-488c-ad93-634cb26fdb5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap600b1da5-d7')
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:26:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] No VIF found with MAC fa:16:3e:9e:bf:17, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:26:37 user nova-compute[74776]: DEBUG nova.compute.manager [req-ecfcca81-0ef8-4bb9-9b55-239a04adea01 req-abf14807-00c6-4900-aa87-7a8205476dc0 service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Received event network-changed-600b1da5-d75f-48ff-a470-b92c141a5a8f {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:26:37 user nova-compute[74776]: DEBUG nova.compute.manager [req-ecfcca81-0ef8-4bb9-9b55-239a04adea01 req-abf14807-00c6-4900-aa87-7a8205476dc0 service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Refreshing instance network info cache due to event network-changed-600b1da5-d75f-48ff-a470-b92c141a5a8f. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:26:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ecfcca81-0ef8-4bb9-9b55-239a04adea01 req-abf14807-00c6-4900-aa87-7a8205476dc0 service nova] Acquiring lock "refresh_cache-96a7c6ec-0cb9-481b-8ec5-4337130bc000" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:26:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ecfcca81-0ef8-4bb9-9b55-239a04adea01 req-abf14807-00c6-4900-aa87-7a8205476dc0 service nova] Acquired lock "refresh_cache-96a7c6ec-0cb9-481b-8ec5-4337130bc000" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:26:37 user nova-compute[74776]: DEBUG nova.network.neutron [req-ecfcca81-0ef8-4bb9-9b55-239a04adea01 req-abf14807-00c6-4900-aa87-7a8205476dc0 service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Refreshing network info cache for port 600b1da5-d75f-48ff-a470-b92c141a5a8f {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:26:37 user nova-compute[74776]: DEBUG nova.network.neutron [req-ecfcca81-0ef8-4bb9-9b55-239a04adea01 req-abf14807-00c6-4900-aa87-7a8205476dc0 service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Updated VIF entry in instance network info cache for port 600b1da5-d75f-48ff-a470-b92c141a5a8f. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:26:37 user nova-compute[74776]: DEBUG nova.network.neutron [req-ecfcca81-0ef8-4bb9-9b55-239a04adea01 req-abf14807-00c6-4900-aa87-7a8205476dc0 service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Updating instance_info_cache with network_info: [{"id": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "address": "fa:16:3e:9e:bf:17", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap600b1da5-d7", "ovs_interfaceid": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:26:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ecfcca81-0ef8-4bb9-9b55-239a04adea01 req-abf14807-00c6-4900-aa87-7a8205476dc0 service nova] Releasing lock "refresh_cache-96a7c6ec-0cb9-481b-8ec5-4337130bc000" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:26:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:38 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Snapshot image upload complete
Nov 22 14:26:38 user nova-compute[74776]: DEBUG nova.compute.manager [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:26:38 user nova-compute[74776]: INFO nova.compute.manager [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Shelve offloading
Nov 22 14:26:38 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 016bf051-9034-4124-948d-995aacf77caf] Instance destroyed successfully.
Nov 22 14:26:38 user nova-compute[74776]: DEBUG nova.compute.manager [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:26:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "refresh_cache-016bf051-9034-4124-948d-995aacf77caf" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:26:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquired lock "refresh_cache-016bf051-9034-4124-948d-995aacf77caf" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:26:38 user nova-compute[74776]: DEBUG nova.network.neutron [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:26:38 user nova-compute[74776]: DEBUG nova.compute.manager [req-e8c0c2e3-451e-439b-bb02-2bd97f50eb29 req-bb402278-b6bc-4ccc-ae2c-ba3ad0c7c45a service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Received event network-vif-plugged-600b1da5-d75f-48ff-a470-b92c141a5a8f {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:26:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e8c0c2e3-451e-439b-bb02-2bd97f50eb29 req-bb402278-b6bc-4ccc-ae2c-ba3ad0c7c45a service nova] Acquiring lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e8c0c2e3-451e-439b-bb02-2bd97f50eb29 req-bb402278-b6bc-4ccc-ae2c-ba3ad0c7c45a service nova] Lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e8c0c2e3-451e-439b-bb02-2bd97f50eb29 req-bb402278-b6bc-4ccc-ae2c-ba3ad0c7c45a service nova] Lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:38 user nova-compute[74776]: DEBUG nova.compute.manager [req-e8c0c2e3-451e-439b-bb02-2bd97f50eb29 req-bb402278-b6bc-4ccc-ae2c-ba3ad0c7c45a service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] No waiting events found dispatching network-vif-plugged-600b1da5-d75f-48ff-a470-b92c141a5a8f {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:26:38 user nova-compute[74776]: WARNING nova.compute.manager [req-e8c0c2e3-451e-439b-bb02-2bd97f50eb29 req-bb402278-b6bc-4ccc-ae2c-ba3ad0c7c45a service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Received unexpected event network-vif-plugged-600b1da5-d75f-48ff-a470-b92c141a5a8f for instance with vm_state building and task_state spawning.
Nov 22 14:26:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:38 user nova-compute[74776]: DEBUG nova.network.neutron [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Updating instance_info_cache with network_info: [{"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:26:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Releasing lock "refresh_cache-016bf051-9034-4124-948d-995aacf77caf" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG os_brick.utils [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dffdb2-0af8-4953-bcad-d81dd95ef0b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2d38d9-1647-4421-9b47-891aaa9ec122]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47d583f-f696-4b56-a3b5-a8a4962ca0bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[af00d5b9-2ed5-4707-813e-2a2786c68344]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:26:39 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:26:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd89886-e44b-41be-9628-f211d2bdd1ca]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG os_brick.utils [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Updating existing volume attachment record: d47af82d-5937-4e3d-aa92-206de3451b2c {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-7ee58032-e960-4dae-a75c-6c0a4278cc17 req-55b8d182-a2c6-419f-b956-e9d9aaa5ab19 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Received event network-changed-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-7ee58032-e960-4dae-a75c-6c0a4278cc17 req-55b8d182-a2c6-419f-b956-e9d9aaa5ab19 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Refreshing instance network info cache due to event network-changed-19e9bf95-eee7-41e4-95ab-4f18f612d2c5. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7ee58032-e960-4dae-a75c-6c0a4278cc17 req-55b8d182-a2c6-419f-b956-e9d9aaa5ab19 service nova] Acquiring lock "refresh_cache-016bf051-9034-4124-948d-995aacf77caf" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7ee58032-e960-4dae-a75c-6c0a4278cc17 req-55b8d182-a2c6-419f-b956-e9d9aaa5ab19 service nova] Acquired lock "refresh_cache-016bf051-9034-4124-948d-995aacf77caf" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG nova.network.neutron [req-7ee58032-e960-4dae-a75c-6c0a4278cc17 req-55b8d182-a2c6-419f-b956-e9d9aaa5ab19 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Refreshing network info cache for port 19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:26:39 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 016bf051-9034-4124-948d-995aacf77caf] Instance destroyed successfully.
Nov 22 14:26:39 user nova-compute[74776]: DEBUG nova.objects.instance [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lazy-loading 'resources' on Instance uuid 016bf051-9034-4124-948d-995aacf77caf {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-23240802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-23240802',id=22,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKduD23N0jjd+/3aswFbVaCynWvn+B/yMtXKe3RKoy1nzyj4V1/dApS8ji97SS0HNw9OqdGuyusGE/CV8+iyxp5s4Ox44gq/tz45m/A8mDHXREpPgLCGWwIAVtzjkC4U5g==',key_name='tempest-keypair-1418035038',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:24:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b1d6da4f9f4149479a779475a69c9110',ramdisk_id='',reservation_id='r-7q3t55ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1293931160',owner_user_name='tempest-AttachVolumeShelveTestJSON-1293931160-project-member',shelved_at='2023-11-22T14:26:38.263111',shelved_host='user',shelved_image_id='970afec0-dc26-4c8b-8223-88a9e9f7b233'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:26:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c63eae228f99474899ce0620a4affe75',uuid=016bf051-9034-4124-948d-995aacf77caf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converting VIF {"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1f:4f,bridge_name='br-int',has_traffic_filtering=True,id=19e9bf95-eee7-41e4-95ab-4f18f612d2c5,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e9bf95-ee') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG os_vif [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1f:4f,bridge_name='br-int',has_traffic_filtering=True,id=19e9bf95-eee7-41e4-95ab-4f18f612d2c5,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e9bf95-ee') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19e9bf95-ee, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad47ffd7-605f-4f9d-abbd-38f26db498f3) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:39 user nova-compute[74776]: INFO os_vif [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1f:4f,bridge_name='br-int',has_traffic_filtering=True,id=19e9bf95-eee7-41e4-95ab-4f18f612d2c5,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e9bf95-ee')
Nov 22 14:26:39 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Deleting instance files /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf_del
Nov 22 14:26:39 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Deletion of /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf_del complete
Nov 22 14:26:39 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Deleted allocations for instance 016bf051-9034-4124-948d-995aacf77caf
Nov 22 14:26:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG nova.objects.instance [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lazy-loading 'numa_topology' on Instance uuid 016bf051-9034-4124-948d-995aacf77caf {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG nova.objects.base [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Object Instance<016bf051-9034-4124-948d-995aacf77caf> lazy-loaded attributes: resources,numa_topology {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG nova.network.neutron [req-7ee58032-e960-4dae-a75c-6c0a4278cc17 req-55b8d182-a2c6-419f-b956-e9d9aaa5ab19 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Updated VIF entry in instance network info cache for port 19e9bf95-eee7-41e4-95ab-4f18f612d2c5. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG nova.network.neutron [req-7ee58032-e960-4dae-a75c-6c0a4278cc17 req-55b8d182-a2c6-419f-b956-e9d9aaa5ab19 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Updating instance_info_cache with network_info: [{"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7ee58032-e960-4dae-a75c-6c0a4278cc17 req-55b8d182-a2c6-419f-b956-e9d9aaa5ab19 service nova] Releasing lock "refresh_cache-016bf051-9034-4124-948d-995aacf77caf" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:26:39 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:26:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-616537a7-7049-4ec8-881b-3adc89653345 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "016bf051-9034-4124-948d-995aacf77caf" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.278s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:40 user nova-compute[74776]: DEBUG nova.compute.manager [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:26:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:26:40 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Instance spawned successfully.
Nov 22 14:26:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:26:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:26:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:26:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:26:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:26:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:26:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:26:40 user nova-compute[74776]: DEBUG nova.compute.manager [req-5835e0b5-8b6d-41b2-8e13-16a6dba27358 req-293f9106-a874-41ac-9a06-bf3a5a2941d4 service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Received event network-vif-plugged-600b1da5-d75f-48ff-a470-b92c141a5a8f {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:26:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5835e0b5-8b6d-41b2-8e13-16a6dba27358 req-293f9106-a874-41ac-9a06-bf3a5a2941d4 service nova] Acquiring lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5835e0b5-8b6d-41b2-8e13-16a6dba27358 req-293f9106-a874-41ac-9a06-bf3a5a2941d4 service nova] Lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5835e0b5-8b6d-41b2-8e13-16a6dba27358 req-293f9106-a874-41ac-9a06-bf3a5a2941d4 service nova] Lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:40 user nova-compute[74776]: DEBUG nova.compute.manager [req-5835e0b5-8b6d-41b2-8e13-16a6dba27358 req-293f9106-a874-41ac-9a06-bf3a5a2941d4 service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] No waiting events found dispatching network-vif-plugged-600b1da5-d75f-48ff-a470-b92c141a5a8f {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:26:40 user nova-compute[74776]: WARNING nova.compute.manager [req-5835e0b5-8b6d-41b2-8e13-16a6dba27358 req-293f9106-a874-41ac-9a06-bf3a5a2941d4 service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Received unexpected event network-vif-plugged-600b1da5-d75f-48ff-a470-b92c141a5a8f for instance with vm_state building and task_state spawning.
Nov 22 14:26:40 user nova-compute[74776]: INFO nova.compute.manager [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Took 6.26 seconds to spawn the instance on the hypervisor.
Nov 22 14:26:40 user nova-compute[74776]: DEBUG nova.compute.manager [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:26:40 user nova-compute[74776]: INFO nova.compute.manager [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Took 7.44 seconds to build instance.
Nov 22 14:26:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-94f98a18-8d18-4ac2-8d1a-2b407f40eae6 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.604s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:26:45 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Creating image(s)
Nov 22 14:26:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Did not create local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Ensure instance console log exists: /opt/stack/data/nova/instances/bc98341b-ca28-4097-9887-16c8e8d7f9f7/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Start _get_guest_xml network_info=[{"id": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "address": "fa:16:3e:5f:fc:12", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cec0cf0-89", "ovs_interfaceid": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd47af82d-5937-4e3d-aa92-206de3451b2c', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'goChikQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bc98341b-ca28-4097-9887-16c8e8d7f9f7', 'attached_at': '', 'detached_at': '', 'volume_id': '22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a', 'serial': '22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a'}, 'boot_index': 0, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:26:45 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:26:45 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:26:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:26:45 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'goChikQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:26:46 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:26:46 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:26:46 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f580250-42eb-472b-8d59-3e28da49c031]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:26:46 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0abb33-5e29-4a0a-9b0f-44bb79119e39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a] added
Nov 22 14:26:46 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a65bc1-d258-4024-93a8-41d826f12fac]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[73343efc-65aa-4e86-944b-92c1070fb314]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v goChikQA {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v goChikQA" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf45f86-5403-424a-b55a-804d06cd0a90]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'goChikQA'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07bc693-e773-4fda-a460-2d2eca15c16c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ede8125-f931-4bbe-9b33-7e4530d49abb]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:26:46 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:26:46 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a3d0cb-8062-4a27-ad3c-6811780ba17b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a, portal: 172.16.0.220,3260]
Nov 22 14:26:46 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a, portal: 172.16.0.220,3260] successful.
Nov 22 14:26:46 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[67494cdb-d217-416f-a45f-cc10ac7c7821]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cb54a3-ff5c-42ee-b85f-d387f86f9d98]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:26:46 user nova-compute[74776]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:26:46 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:26:46 user nova-compute[74776]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:26:46 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0b4be7-b87a-45b2-87c4-e96bd1fad215]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:26:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'goChikQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26161303863633665', 'path': '/dev/sdb'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161303863633665', 'path': '/dev/sdb'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:26:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-727985580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-727985580',id=25,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d359aba8e95e4090a02fb0a46012f20b',ramdisk_id='',reservation_id='r-vo0i4er5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-202976361',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:26:34Z,user_data=None,user_id='dea876275c70471d9cba1c3158bd63e2',uuid=bc98341b-ca28-4097-9887-16c8e8d7f9f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "address": "fa:16:3e:5f:fc:12", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cec0cf0-89", "ovs_interfaceid": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converting VIF {"id": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "address": "fa:16:3e:5f:fc:12", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cec0cf0-89", "ovs_interfaceid": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:fc:12,bridge_name='br-int',has_traffic_filtering=True,id=5cec0cf0-892c-4c30-ae08-7e127098bccf,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cec0cf0-89') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG nova.objects.instance [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'pci_devices' on Instance uuid bc98341b-ca28-4097-9887-16c8e8d7f9f7 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:26:47 user nova-compute[74776]:   <uuid>bc98341b-ca28-4097-9887-16c8e8d7f9f7</uuid>
Nov 22 14:26:47 user nova-compute[74776]:   <name>instance-00000019</name>
Nov 22 14:26:47 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:26:47 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:26:47 user nova-compute[74776]:   <metadata>
Nov 22 14:26:47 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:26:47 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:26:47 user nova-compute[74776]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-727985580</nova:name>
Nov 22 14:26:47 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:26:45</nova:creationTime>
Nov 22 14:26:47 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:26:47 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:26:47 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:26:47 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:26:47 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:26:47 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:26:47 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:26:47 user nova-compute[74776]:       <nova:owner>
Nov 22 14:26:47 user nova-compute[74776]:         <nova:user uuid="dea876275c70471d9cba1c3158bd63e2">tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member</nova:user>
Nov 22 14:26:47 user nova-compute[74776]:         <nova:project uuid="d359aba8e95e4090a02fb0a46012f20b">tempest-ServerBootFromVolumeStableRescueTest-202976361</nova:project>
Nov 22 14:26:47 user nova-compute[74776]:       </nova:owner>
Nov 22 14:26:47 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:26:47 user nova-compute[74776]:       <nova:ports>
Nov 22 14:26:47 user nova-compute[74776]:         <nova:port uuid="5cec0cf0-892c-4c30-ae08-7e127098bccf">
Nov 22 14:26:47 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 14:26:47 user nova-compute[74776]:         </nova:port>
Nov 22 14:26:47 user nova-compute[74776]:       </nova:ports>
Nov 22 14:26:47 user nova-compute[74776]:     </nova:instance>
Nov 22 14:26:47 user nova-compute[74776]:   </metadata>
Nov 22 14:26:47 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:26:47 user nova-compute[74776]:     <system>
Nov 22 14:26:47 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:26:47 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:26:47 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:26:47 user nova-compute[74776]:       <entry name="serial">bc98341b-ca28-4097-9887-16c8e8d7f9f7</entry>
Nov 22 14:26:47 user nova-compute[74776]:       <entry name="uuid">bc98341b-ca28-4097-9887-16c8e8d7f9f7</entry>
Nov 22 14:26:47 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:26:47 user nova-compute[74776]:     </system>
Nov 22 14:26:47 user nova-compute[74776]:   </sysinfo>
Nov 22 14:26:47 user nova-compute[74776]:   <os>
Nov 22 14:26:47 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:26:47 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:26:47 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:26:47 user nova-compute[74776]:   </os>
Nov 22 14:26:47 user nova-compute[74776]:   <features>
Nov 22 14:26:47 user nova-compute[74776]:     <acpi/>
Nov 22 14:26:47 user nova-compute[74776]:     <apic/>
Nov 22 14:26:47 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:26:47 user nova-compute[74776]:   </features>
Nov 22 14:26:47 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:26:47 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:26:47 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:26:47 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:26:47 user nova-compute[74776]:   </clock>
Nov 22 14:26:47 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:26:47 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:26:47 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:26:47 user nova-compute[74776]:   </cpu>
Nov 22 14:26:47 user nova-compute[74776]:   <devices>
Nov 22 14:26:47 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:26:47 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:26:47 user nova-compute[74776]:       <source dev="/dev/sdb"/>
Nov 22 14:26:47 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:26:47 user nova-compute[74776]:       <serial>22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a</serial>
Nov 22 14:26:47 user nova-compute[74776]:     </disk>
Nov 22 14:26:47 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:26:47 user nova-compute[74776]:       <mac address="fa:16:3e:5f:fc:12"/>
Nov 22 14:26:47 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:26:47 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:26:47 user nova-compute[74776]:       <target dev="tap5cec0cf0-89"/>
Nov 22 14:26:47 user nova-compute[74776]:     </interface>
Nov 22 14:26:47 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:26:47 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/bc98341b-ca28-4097-9887-16c8e8d7f9f7/console.log" append="off"/>
Nov 22 14:26:47 user nova-compute[74776]:     </serial>
Nov 22 14:26:47 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:26:47 user nova-compute[74776]:     <video>
Nov 22 14:26:47 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:26:47 user nova-compute[74776]:     </video>
Nov 22 14:26:47 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:26:47 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:26:47 user nova-compute[74776]:     </rng>
Nov 22 14:26:47 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:26:47 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:26:47 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:26:47 user nova-compute[74776]:     </memballoon>
Nov 22 14:26:47 user nova-compute[74776]:   </devices>
Nov 22 14:26:47 user nova-compute[74776]: </domain>
Nov 22 14:26:47 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:26:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-727985580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-727985580',id=25,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d359aba8e95e4090a02fb0a46012f20b',ramdisk_id='',reservation_id='r-vo0i4er5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-202976361',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:26:34Z,user_data=None,user_id='dea876275c70471d9cba1c3158bd63e2',uuid=bc98341b-ca28-4097-9887-16c8e8d7f9f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "address": "fa:16:3e:5f:fc:12", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cec0cf0-89", "ovs_interfaceid": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converting VIF {"id": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "address": "fa:16:3e:5f:fc:12", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cec0cf0-89", "ovs_interfaceid": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:fc:12,bridge_name='br-int',has_traffic_filtering=True,id=5cec0cf0-892c-4c30-ae08-7e127098bccf,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cec0cf0-89') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG os_vif [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:fc:12,bridge_name='br-int',has_traffic_filtering=True,id=5cec0cf0-892c-4c30-ae08-7e127098bccf,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cec0cf0-89') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59a4103a-d7d1-5625-a19a-6ce9d2e78285', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cec0cf0-89, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5cec0cf0-89, col_values=(('qos', UUID('25904b8f-d1b1-4756-991f-0a8ed25896a2')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5cec0cf0-89, col_values=(('external_ids', {'iface-id': '5cec0cf0-892c-4c30-ae08-7e127098bccf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:fc:12', 'vm-uuid': 'bc98341b-ca28-4097-9887-16c8e8d7f9f7'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:47 user nova-compute[74776]: INFO os_vif [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:fc:12,bridge_name='br-int',has_traffic_filtering=True,id=5cec0cf0-892c-4c30-ae08-7e127098bccf,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cec0cf0-89')
Nov 22 14:26:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:26:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] No VIF found with MAC fa:16:3e:5f:fc:12, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:26:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:49 user nova-compute[74776]: DEBUG nova.compute.manager [req-e7e40e68-f4df-4705-b634-c53c7df52da4 req-0fa76081-08dc-4958-aa3e-d99b64d00398 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received event network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:26:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e7e40e68-f4df-4705-b634-c53c7df52da4 req-0fa76081-08dc-4958-aa3e-d99b64d00398 service nova] Acquiring lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e7e40e68-f4df-4705-b634-c53c7df52da4 req-0fa76081-08dc-4958-aa3e-d99b64d00398 service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e7e40e68-f4df-4705-b634-c53c7df52da4 req-0fa76081-08dc-4958-aa3e-d99b64d00398 service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:49 user nova-compute[74776]: DEBUG nova.compute.manager [req-e7e40e68-f4df-4705-b634-c53c7df52da4 req-0fa76081-08dc-4958-aa3e-d99b64d00398 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] No waiting events found dispatching network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:26:49 user nova-compute[74776]: WARNING nova.compute.manager [req-e7e40e68-f4df-4705-b634-c53c7df52da4 req-0fa76081-08dc-4958-aa3e-d99b64d00398 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received unexpected event network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf for instance with vm_state building and task_state spawning.
Nov 22 14:26:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:51 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:26:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:26:51 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Instance spawned successfully.
Nov 22 14:26:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:26:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:26:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:26:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:26:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:26:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:26:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:26:51 user nova-compute[74776]: INFO nova.compute.manager [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 22 14:26:51 user nova-compute[74776]: DEBUG nova.compute.manager [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:26:51 user nova-compute[74776]: DEBUG nova.compute.manager [req-3f0e73ad-8a37-4dca-b3eb-8fcccd7b3179 req-853bd6d4-bd8e-408f-baca-2947d7a40233 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received event network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:26:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3f0e73ad-8a37-4dca-b3eb-8fcccd7b3179 req-853bd6d4-bd8e-408f-baca-2947d7a40233 service nova] Acquiring lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3f0e73ad-8a37-4dca-b3eb-8fcccd7b3179 req-853bd6d4-bd8e-408f-baca-2947d7a40233 service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3f0e73ad-8a37-4dca-b3eb-8fcccd7b3179 req-853bd6d4-bd8e-408f-baca-2947d7a40233 service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:51 user nova-compute[74776]: DEBUG nova.compute.manager [req-3f0e73ad-8a37-4dca-b3eb-8fcccd7b3179 req-853bd6d4-bd8e-408f-baca-2947d7a40233 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] No waiting events found dispatching network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:26:51 user nova-compute[74776]: WARNING nova.compute.manager [req-3f0e73ad-8a37-4dca-b3eb-8fcccd7b3179 req-853bd6d4-bd8e-408f-baca-2947d7a40233 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received unexpected event network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf for instance with vm_state building and task_state spawning.
Nov 22 14:26:51 user nova-compute[74776]: INFO nova.compute.manager [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Took 18.75 seconds to build instance.
Nov 22 14:26:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3af01974-0216-4177-9e01-74f5e7b3b536 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.849s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Acquiring lock "d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Lock "d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Acquiring lock "d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Lock "d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Lock "d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:53 user nova-compute[74776]: INFO nova.compute.manager [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Terminating instance
Nov 22 14:26:53 user nova-compute[74776]: DEBUG nova.compute.manager [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:26:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG nova.compute.manager [req-c2357648-2a41-4294-b563-2a189095263a req-bb98fc55-78f2-44d6-ab5e-7e0b0cfa93c7 service nova] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Received event network-vif-unplugged-f686ba43-be92-4e45-a575-b0cca1418623 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c2357648-2a41-4294-b563-2a189095263a req-bb98fc55-78f2-44d6-ab5e-7e0b0cfa93c7 service nova] Acquiring lock "d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c2357648-2a41-4294-b563-2a189095263a req-bb98fc55-78f2-44d6-ab5e-7e0b0cfa93c7 service nova] Lock "d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c2357648-2a41-4294-b563-2a189095263a req-bb98fc55-78f2-44d6-ab5e-7e0b0cfa93c7 service nova] Lock "d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG nova.compute.manager [req-c2357648-2a41-4294-b563-2a189095263a req-bb98fc55-78f2-44d6-ab5e-7e0b0cfa93c7 service nova] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] No waiting events found dispatching network-vif-unplugged-f686ba43-be92-4e45-a575-b0cca1418623 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG nova.compute.manager [req-c2357648-2a41-4294-b563-2a189095263a req-bb98fc55-78f2-44d6-ab5e-7e0b0cfa93c7 service nova] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Received event network-vif-unplugged-f686ba43-be92-4e45-a575-b0cca1418623 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:54 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Instance destroyed successfully.
Nov 22 14:26:54 user nova-compute[74776]: DEBUG nova.objects.instance [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Lazy-loading 'resources' on Instance uuid d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1711661015',display_name='tempest-VolumesNegativeTest-instance-1711661015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1711661015',id=23,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:25:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea8ba945216849ca92e91d7e4c8c8980',ramdisk_id='',reservation_id='r-6oc00qv2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1359841222',owner_user_name='tempest-VolumesNegativeTest-1359841222-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:25:11Z,user_data=None,user_id='79a38f963f7d4f1bb03b0b898116d507',uuid=d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f686ba43-be92-4e45-a575-b0cca1418623", "address": "fa:16:3e:f7:11:da", "network": {"id": "1a8f7d25-4c19-4546-861b-f7b15f1c12af", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b02a2fa1d01d4cb3b0a21595749534e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686ba43-be", "ovs_interfaceid": "f686ba43-be92-4e45-a575-b0cca1418623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Converting VIF {"id": "f686ba43-be92-4e45-a575-b0cca1418623", "address": "fa:16:3e:f7:11:da", "network": {"id": "1a8f7d25-4c19-4546-861b-f7b15f1c12af", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b02a2fa1d01d4cb3b0a21595749534e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf686ba43-be", "ovs_interfaceid": "f686ba43-be92-4e45-a575-b0cca1418623", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:11:da,bridge_name='br-int',has_traffic_filtering=True,id=f686ba43-be92-4e45-a575-b0cca1418623,network=Network(1a8f7d25-4c19-4546-861b-f7b15f1c12af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf686ba43-be') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG os_vif [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:11:da,bridge_name='br-int',has_traffic_filtering=True,id=f686ba43-be92-4e45-a575-b0cca1418623,network=Network(1a8f7d25-4c19-4546-861b-f7b15f1c12af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf686ba43-be') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf686ba43-be, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc3d113d-142b-406d-949c-fb9342bdc8f4) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:26:54 user nova-compute[74776]: INFO os_vif [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:11:da,bridge_name='br-int',has_traffic_filtering=True,id=f686ba43-be92-4e45-a575-b0cca1418623,network=Network(1a8f7d25-4c19-4546-861b-f7b15f1c12af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf686ba43-be')
Nov 22 14:26:54 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Deleting instance files /opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e_del
Nov 22 14:26:54 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Deletion of /opt/stack/data/nova/instances/d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e_del complete
Nov 22 14:26:54 user nova-compute[74776]: INFO nova.compute.manager [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 22 14:26:54 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:26:54 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:26:55 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:26:55 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Took 0.56 seconds to deallocate network for instance.
Nov 22 14:26:55 user nova-compute[74776]: DEBUG nova.compute.manager [req-514b67aa-6c6c-4c9a-b628-9f6f2592a352 req-e085426f-1821-44ca-b307-aeda3239d47e service nova] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Received event network-vif-deleted-f686ba43-be92-4e45-a575-b0cca1418623 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:26:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:55 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:26:55 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:26:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:55 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Deleted allocations for instance d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e
Nov 22 14:26:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e875324-0631-47f7-a815-6263b0ad4a7d tempest-VolumesNegativeTest-1359841222 tempest-VolumesNegativeTest-1359841222-project-member] Lock "d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.729s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-ee19cad6-6203-4bf4-b7f0-f49c10fc4e2c req-b78cf1be-2b64-42f1-b28d-f5f202eef1f1 service nova] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Received event network-vif-plugged-f686ba43-be92-4e45-a575-b0cca1418623 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:26:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ee19cad6-6203-4bf4-b7f0-f49c10fc4e2c req-b78cf1be-2b64-42f1-b28d-f5f202eef1f1 service nova] Acquiring lock "d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ee19cad6-6203-4bf4-b7f0-f49c10fc4e2c req-b78cf1be-2b64-42f1-b28d-f5f202eef1f1 service nova] Lock "d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ee19cad6-6203-4bf4-b7f0-f49c10fc4e2c req-b78cf1be-2b64-42f1-b28d-f5f202eef1f1 service nova] Lock "d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-ee19cad6-6203-4bf4-b7f0-f49c10fc4e2c req-b78cf1be-2b64-42f1-b28d-f5f202eef1f1 service nova] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] No waiting events found dispatching network-vif-plugged-f686ba43-be92-4e45-a575-b0cca1418623 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:26:56 user nova-compute[74776]: WARNING nova.compute.manager [req-ee19cad6-6203-4bf4-b7f0-f49c10fc4e2c req-b78cf1be-2b64-42f1-b28d-f5f202eef1f1 service nova] [instance: d2b6bfc0-13ac-4ca4-aaa6-8e4d1f53e01e] Received unexpected event network-vif-plugged-f686ba43-be92-4e45-a575-b0cca1418623 for instance with vm_state deleted and task_state None.
Nov 22 14:26:57 user nova-compute[74776]: INFO nova.compute.manager [None req-6d908a79-ad60-4996-bbe8-7608e86152cc tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Unrescuing
Nov 22 14:26:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6d908a79-ad60-4996-bbe8-7608e86152cc tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "refresh_cache-525baf66-82cc-4e8d-a37a-c92c51d4673d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:26:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6d908a79-ad60-4996-bbe8-7608e86152cc tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquired lock "refresh_cache-525baf66-82cc-4e8d-a37a-c92c51d4673d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:26:57 user nova-compute[74776]: DEBUG nova.network.neutron [None req-6d908a79-ad60-4996-bbe8-7608e86152cc tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:26:58 user nova-compute[74776]: DEBUG nova.network.neutron [None req-6d908a79-ad60-4996-bbe8-7608e86152cc tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Updating instance_info_cache with network_info: [{"id": "ac898a82-d482-4299-b86b-db6aacf8175a", "address": "fa:16:3e:38:af:39", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac898a82-d4", "ovs_interfaceid": "ac898a82-d482-4299-b86b-db6aacf8175a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:26:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6d908a79-ad60-4996-bbe8-7608e86152cc tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Releasing lock "refresh_cache-525baf66-82cc-4e8d-a37a-c92c51d4673d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:26:58 user nova-compute[74776]: DEBUG nova.objects.instance [None req-6d908a79-ad60-4996-bbe8-7608e86152cc tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'flavor' on Instance uuid 525baf66-82cc-4e8d-a37a-c92c51d4673d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:26:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:58 user nova-compute[74776]: DEBUG nova.compute.manager [req-425d8eda-06d5-4a6f-a05b-ab1432ce3889 req-0ad3cd28-893f-4b98-84bf-b5ce45ef09dc service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received event network-vif-unplugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:26:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-425d8eda-06d5-4a6f-a05b-ab1432ce3889 req-0ad3cd28-893f-4b98-84bf-b5ce45ef09dc service nova] Acquiring lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:26:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-425d8eda-06d5-4a6f-a05b-ab1432ce3889 req-0ad3cd28-893f-4b98-84bf-b5ce45ef09dc service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:26:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-425d8eda-06d5-4a6f-a05b-ab1432ce3889 req-0ad3cd28-893f-4b98-84bf-b5ce45ef09dc service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:26:58 user nova-compute[74776]: DEBUG nova.compute.manager [req-425d8eda-06d5-4a6f-a05b-ab1432ce3889 req-0ad3cd28-893f-4b98-84bf-b5ce45ef09dc service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] No waiting events found dispatching network-vif-unplugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:26:58 user nova-compute[74776]: WARNING nova.compute.manager [req-425d8eda-06d5-4a6f-a05b-ab1432ce3889 req-0ad3cd28-893f-4b98-84bf-b5ce45ef09dc service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received unexpected event network-vif-unplugged-ac898a82-d482-4299-b86b-db6aacf8175a for instance with vm_state rescued and task_state unrescuing.
Nov 22 14:26:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:26:59 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Instance destroyed successfully.
Nov 22 14:26:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-71814122-7254-4dba-8a80-acd0b7f1d06f req-25950a83-5fc5-4f6f-91e2-622719325c83 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received event network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:27:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-71814122-7254-4dba-8a80-acd0b7f1d06f req-25950a83-5fc5-4f6f-91e2-622719325c83 service nova] Acquiring lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:27:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-71814122-7254-4dba-8a80-acd0b7f1d06f req-25950a83-5fc5-4f6f-91e2-622719325c83 service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:27:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-71814122-7254-4dba-8a80-acd0b7f1d06f req-25950a83-5fc5-4f6f-91e2-622719325c83 service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:27:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-71814122-7254-4dba-8a80-acd0b7f1d06f req-25950a83-5fc5-4f6f-91e2-622719325c83 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] No waiting events found dispatching network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:27:00 user nova-compute[74776]: WARNING nova.compute.manager [req-71814122-7254-4dba-8a80-acd0b7f1d06f req-25950a83-5fc5-4f6f-91e2-622719325c83 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received unexpected event network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a for instance with vm_state rescued and task_state unrescuing.
Nov 22 14:27:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-71814122-7254-4dba-8a80-acd0b7f1d06f req-25950a83-5fc5-4f6f-91e2-622719325c83 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received event network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:27:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-71814122-7254-4dba-8a80-acd0b7f1d06f req-25950a83-5fc5-4f6f-91e2-622719325c83 service nova] Acquiring lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:27:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-71814122-7254-4dba-8a80-acd0b7f1d06f req-25950a83-5fc5-4f6f-91e2-622719325c83 service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:27:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-71814122-7254-4dba-8a80-acd0b7f1d06f req-25950a83-5fc5-4f6f-91e2-622719325c83 service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:27:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-71814122-7254-4dba-8a80-acd0b7f1d06f req-25950a83-5fc5-4f6f-91e2-622719325c83 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] No waiting events found dispatching network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:27:00 user nova-compute[74776]: WARNING nova.compute.manager [req-71814122-7254-4dba-8a80-acd0b7f1d06f req-25950a83-5fc5-4f6f-91e2-622719325c83 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received unexpected event network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a for instance with vm_state rescued and task_state unrescuing.
Nov 22 14:27:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-53afd477-f708-4679-8749-673ef3bdd11f req-4a585345-dc5a-4217-b895-378e3d9f052c service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received event network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:27:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-53afd477-f708-4679-8749-673ef3bdd11f req-4a585345-dc5a-4217-b895-378e3d9f052c service nova] Acquiring lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:27:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-53afd477-f708-4679-8749-673ef3bdd11f req-4a585345-dc5a-4217-b895-378e3d9f052c service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:27:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-53afd477-f708-4679-8749-673ef3bdd11f req-4a585345-dc5a-4217-b895-378e3d9f052c service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:27:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-53afd477-f708-4679-8749-673ef3bdd11f req-4a585345-dc5a-4217-b895-378e3d9f052c service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] No waiting events found dispatching network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:27:02 user nova-compute[74776]: WARNING nova.compute.manager [req-53afd477-f708-4679-8749-673ef3bdd11f req-4a585345-dc5a-4217-b895-378e3d9f052c service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received unexpected event network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a for instance with vm_state rescued and task_state unrescuing.
Nov 22 14:27:03 user nova-compute[74776]: DEBUG nova.compute.manager [None req-6d908a79-ad60-4996-bbe8-7608e86152cc tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:27:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:10 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:27:10 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74776) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 14:27:11 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:27:13 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:27:13 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:27:13 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Didn't find any instances for network info cache update. {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 14:27:13 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:27:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:14 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:27:14 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:27:14 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:27:15 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:27:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:27:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:27:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:27:15 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:27:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:27:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:27:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:18 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:27:18 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:27:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8002MB free_disk=25.280776977539062GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:27:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:27:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:27:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4629d82d-fd02-4a58-a535-b362b493e7c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:27:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 525baf66-82cc-4e8d-a37a-c92c51d4673d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:27:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6f2ce4b2-660c-431f-b951-c6ec5090ef7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:27:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f4f30fe7-b234-4f81-b081-3214f5ebe789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:27:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance b30a5c6b-ea71-4a06-ad03-a02ebd584a80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:27:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance bc98341b-ca28-4097-9887-16c8e8d7f9f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:27:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 96a7c6ec-0cb9-481b-8ec5-4337130bc000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:27:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:27:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:27:18 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing inventories for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating ProviderTree inventory for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating inventory in ProviderTree for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing aggregate associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, aggregates: None {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing trait associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "771e2959-789e-4ef0-a4c9-052cdfa13b00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "771e2959-789e-4ef0-a4c9-052cdfa13b00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.700s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.012s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:27:19 user nova-compute[74776]: INFO nova.compute.claims [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Claim successful on node user
Nov 22 14:27:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG nova.network.neutron [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:27:19 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:27:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:27:19 user nova-compute[74776]: DEBUG nova.policy [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1807bb240de749499809fd3dfb520d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee58d331979425eb9d48d2a52fc1f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG nova.compute.manager [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:27:20 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Creating image(s)
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "/opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "/opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "/opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.199s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.192s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00/disk 1073741824" returned: 0 in 0.057s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG nova.network.neutron [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Successfully created port: 6117aba3-000f-40a8-9444-33c3d9b7ae6b {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Checking if we can resize image /opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] There are 0 instances to clean {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Cannot resize image /opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Ensure instance console log exists: /opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:27:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.network.neutron [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Successfully updated port: 6117aba3-000f-40a8-9444-33c3d9b7ae6b {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "refresh_cache-771e2959-789e-4ef0-a4c9-052cdfa13b00" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquired lock "refresh_cache-771e2959-789e-4ef0-a4c9-052cdfa13b00" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.network.neutron [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-2b275d18-a470-46cb-aba4-c304e9d370dd req-4b7f7d14-b61d-41ed-9b3f-091e4f9befaf service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Received event network-changed-6117aba3-000f-40a8-9444-33c3d9b7ae6b {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-2b275d18-a470-46cb-aba4-c304e9d370dd req-4b7f7d14-b61d-41ed-9b3f-091e4f9befaf service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Refreshing instance network info cache due to event network-changed-6117aba3-000f-40a8-9444-33c3d9b7ae6b. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2b275d18-a470-46cb-aba4-c304e9d370dd req-4b7f7d14-b61d-41ed-9b3f-091e4f9befaf service nova] Acquiring lock "refresh_cache-771e2959-789e-4ef0-a4c9-052cdfa13b00" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.network.neutron [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.network.neutron [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Updating instance_info_cache with network_info: [{"id": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "address": "fa:16:3e:c4:a7:2b", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6117aba3-00", "ovs_interfaceid": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Releasing lock "refresh_cache-771e2959-789e-4ef0-a4c9-052cdfa13b00" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.compute.manager [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Instance network_info: |[{"id": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "address": "fa:16:3e:c4:a7:2b", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6117aba3-00", "ovs_interfaceid": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2b275d18-a470-46cb-aba4-c304e9d370dd req-4b7f7d14-b61d-41ed-9b3f-091e4f9befaf service nova] Acquired lock "refresh_cache-771e2959-789e-4ef0-a4c9-052cdfa13b00" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.network.neutron [req-2b275d18-a470-46cb-aba4-c304e9d370dd req-4b7f7d14-b61d-41ed-9b3f-091e4f9befaf service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Refreshing network info cache for port 6117aba3-000f-40a8-9444-33c3d9b7ae6b {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Start _get_guest_xml network_info=[{"id": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "address": "fa:16:3e:c4:a7:2b", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6117aba3-00", "ovs_interfaceid": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:27:21 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:27:21 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:27:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-460436496',display_name='tempest-AttachVolumeNegativeTest-server-460436496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-460436496',id=27,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGR1XvhjLp+f1KBHcU/oRHYRwppeeHyiYluMEHCr0oXoYvt15OWoFAHe71w3l5NSm+uvZHOVJK5ejlil7r3J86GuZT7EAuYFk49i74psTUJyzG0ofssZpOhv/x+uTSAEA==',key_name='tempest-keypair-2035396926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dee58d331979425eb9d48d2a52fc1f68',ramdisk_id='',reservation_id='r-t7b13571',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-577275639',owner_user_name='tempest-AttachVolumeNegativeTest-577275639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:27:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1807bb240de749499809fd3dfb520d78',uuid=771e2959-789e-4ef0-a4c9-052cdfa13b00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "address": "fa:16:3e:c4:a7:2b", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6117aba3-00", "ovs_interfaceid": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converting VIF {"id": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "address": "fa:16:3e:c4:a7:2b", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6117aba3-00", "ovs_interfaceid": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a7:2b,bridge_name='br-int',has_traffic_filtering=True,id=6117aba3-000f-40a8-9444-33c3d9b7ae6b,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6117aba3-00') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.objects.instance [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lazy-loading 'pci_devices' on Instance uuid 771e2959-789e-4ef0-a4c9-052cdfa13b00 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:27:21 user nova-compute[74776]:   <uuid>771e2959-789e-4ef0-a4c9-052cdfa13b00</uuid>
Nov 22 14:27:21 user nova-compute[74776]:   <name>instance-0000001b</name>
Nov 22 14:27:21 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:27:21 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:27:21 user nova-compute[74776]:   <metadata>
Nov 22 14:27:21 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:27:21 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:27:21 user nova-compute[74776]:       <nova:name>tempest-AttachVolumeNegativeTest-server-460436496</nova:name>
Nov 22 14:27:21 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:27:21</nova:creationTime>
Nov 22 14:27:21 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:27:21 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:27:21 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:27:21 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:27:21 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:27:21 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:27:21 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:27:21 user nova-compute[74776]:       <nova:owner>
Nov 22 14:27:21 user nova-compute[74776]:         <nova:user uuid="1807bb240de749499809fd3dfb520d78">tempest-AttachVolumeNegativeTest-577275639-project-member</nova:user>
Nov 22 14:27:21 user nova-compute[74776]:         <nova:project uuid="dee58d331979425eb9d48d2a52fc1f68">tempest-AttachVolumeNegativeTest-577275639</nova:project>
Nov 22 14:27:21 user nova-compute[74776]:       </nova:owner>
Nov 22 14:27:21 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:27:21 user nova-compute[74776]:       <nova:ports>
Nov 22 14:27:21 user nova-compute[74776]:         <nova:port uuid="6117aba3-000f-40a8-9444-33c3d9b7ae6b">
Nov 22 14:27:21 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 22 14:27:21 user nova-compute[74776]:         </nova:port>
Nov 22 14:27:21 user nova-compute[74776]:       </nova:ports>
Nov 22 14:27:21 user nova-compute[74776]:     </nova:instance>
Nov 22 14:27:21 user nova-compute[74776]:   </metadata>
Nov 22 14:27:21 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:27:21 user nova-compute[74776]:     <system>
Nov 22 14:27:21 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:27:21 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:27:21 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:27:21 user nova-compute[74776]:       <entry name="serial">771e2959-789e-4ef0-a4c9-052cdfa13b00</entry>
Nov 22 14:27:21 user nova-compute[74776]:       <entry name="uuid">771e2959-789e-4ef0-a4c9-052cdfa13b00</entry>
Nov 22 14:27:21 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:27:21 user nova-compute[74776]:     </system>
Nov 22 14:27:21 user nova-compute[74776]:   </sysinfo>
Nov 22 14:27:21 user nova-compute[74776]:   <os>
Nov 22 14:27:21 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:27:21 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:27:21 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:27:21 user nova-compute[74776]:   </os>
Nov 22 14:27:21 user nova-compute[74776]:   <features>
Nov 22 14:27:21 user nova-compute[74776]:     <acpi/>
Nov 22 14:27:21 user nova-compute[74776]:     <apic/>
Nov 22 14:27:21 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:27:21 user nova-compute[74776]:   </features>
Nov 22 14:27:21 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:27:21 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:27:21 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:27:21 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:27:21 user nova-compute[74776]:   </clock>
Nov 22 14:27:21 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:27:21 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:27:21 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:27:21 user nova-compute[74776]:   </cpu>
Nov 22 14:27:21 user nova-compute[74776]:   <devices>
Nov 22 14:27:21 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:27:21 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:27:21 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00/disk"/>
Nov 22 14:27:21 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:27:21 user nova-compute[74776]:     </disk>
Nov 22 14:27:21 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:27:21 user nova-compute[74776]:       <mac address="fa:16:3e:c4:a7:2b"/>
Nov 22 14:27:21 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:27:21 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:27:21 user nova-compute[74776]:       <target dev="tap6117aba3-00"/>
Nov 22 14:27:21 user nova-compute[74776]:     </interface>
Nov 22 14:27:21 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:27:21 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00/console.log" append="off"/>
Nov 22 14:27:21 user nova-compute[74776]:     </serial>
Nov 22 14:27:21 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:27:21 user nova-compute[74776]:     <video>
Nov 22 14:27:21 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:27:21 user nova-compute[74776]:     </video>
Nov 22 14:27:21 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:27:21 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:27:21 user nova-compute[74776]:     </rng>
Nov 22 14:27:21 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:27:21 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:27:21 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:27:21 user nova-compute[74776]:     </memballoon>
Nov 22 14:27:21 user nova-compute[74776]:   </devices>
Nov 22 14:27:21 user nova-compute[74776]: </domain>
Nov 22 14:27:21 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:27:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-460436496',display_name='tempest-AttachVolumeNegativeTest-server-460436496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-460436496',id=27,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGR1XvhjLp+f1KBHcU/oRHYRwppeeHyiYluMEHCr0oXoYvt15OWoFAHe71w3l5NSm+uvZHOVJK5ejlil7r3J86GuZT7EAuYFk49i74psTUJyzG0ofssZpOhv/x+uTSAEA==',key_name='tempest-keypair-2035396926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dee58d331979425eb9d48d2a52fc1f68',ramdisk_id='',reservation_id='r-t7b13571',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-577275639',owner_user_name='tempest-AttachVolumeNegativeTest-577275639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:27:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1807bb240de749499809fd3dfb520d78',uuid=771e2959-789e-4ef0-a4c9-052cdfa13b00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "address": "fa:16:3e:c4:a7:2b", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6117aba3-00", "ovs_interfaceid": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converting VIF {"id": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "address": "fa:16:3e:c4:a7:2b", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6117aba3-00", "ovs_interfaceid": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a7:2b,bridge_name='br-int',has_traffic_filtering=True,id=6117aba3-000f-40a8-9444-33c3d9b7ae6b,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6117aba3-00') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG os_vif [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a7:2b,bridge_name='br-int',has_traffic_filtering=True,id=6117aba3-000f-40a8-9444-33c3d9b7ae6b,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6117aba3-00') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '662e1893-e21e-5a95-90e6-9604a70d8837', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6117aba3-00, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6117aba3-00, col_values=(('qos', UUID('9f9a560c-d96b-461c-b3c0-75372afd3c9b')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6117aba3-00, col_values=(('external_ids', {'iface-id': '6117aba3-000f-40a8-9444-33c3d9b7ae6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:a7:2b', 'vm-uuid': '771e2959-789e-4ef0-a4c9-052cdfa13b00'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:21 user nova-compute[74776]: INFO os_vif [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a7:2b,bridge_name='br-int',has_traffic_filtering=True,id=6117aba3-000f-40a8-9444-33c3d9b7ae6b,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6117aba3-00')
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:27:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] No VIF found with MAC fa:16:3e:c4:a7:2b, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:27:22 user nova-compute[74776]: DEBUG nova.network.neutron [req-2b275d18-a470-46cb-aba4-c304e9d370dd req-4b7f7d14-b61d-41ed-9b3f-091e4f9befaf service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Updated VIF entry in instance network info cache for port 6117aba3-000f-40a8-9444-33c3d9b7ae6b. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:27:22 user nova-compute[74776]: DEBUG nova.network.neutron [req-2b275d18-a470-46cb-aba4-c304e9d370dd req-4b7f7d14-b61d-41ed-9b3f-091e4f9befaf service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Updating instance_info_cache with network_info: [{"id": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "address": "fa:16:3e:c4:a7:2b", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6117aba3-00", "ovs_interfaceid": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:27:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2b275d18-a470-46cb-aba4-c304e9d370dd req-4b7f7d14-b61d-41ed-9b3f-091e4f9befaf service nova] Releasing lock "refresh_cache-771e2959-789e-4ef0-a4c9-052cdfa13b00" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:27:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-dfef40dd-2752-4bc5-8ca5-6dbe4f79f807 req-ff8edc10-f7bb-41db-a867-8c6fe436b249 service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Received event network-vif-plugged-6117aba3-000f-40a8-9444-33c3d9b7ae6b {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:27:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dfef40dd-2752-4bc5-8ca5-6dbe4f79f807 req-ff8edc10-f7bb-41db-a867-8c6fe436b249 service nova] Acquiring lock "771e2959-789e-4ef0-a4c9-052cdfa13b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:27:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dfef40dd-2752-4bc5-8ca5-6dbe4f79f807 req-ff8edc10-f7bb-41db-a867-8c6fe436b249 service nova] Lock "771e2959-789e-4ef0-a4c9-052cdfa13b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:27:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dfef40dd-2752-4bc5-8ca5-6dbe4f79f807 req-ff8edc10-f7bb-41db-a867-8c6fe436b249 service nova] Lock "771e2959-789e-4ef0-a4c9-052cdfa13b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:27:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-dfef40dd-2752-4bc5-8ca5-6dbe4f79f807 req-ff8edc10-f7bb-41db-a867-8c6fe436b249 service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] No waiting events found dispatching network-vif-plugged-6117aba3-000f-40a8-9444-33c3d9b7ae6b {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:27:23 user nova-compute[74776]: WARNING nova.compute.manager [req-dfef40dd-2752-4bc5-8ca5-6dbe4f79f807 req-ff8edc10-f7bb-41db-a867-8c6fe436b249 service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Received unexpected event network-vif-plugged-6117aba3-000f-40a8-9444-33c3d9b7ae6b for instance with vm_state building and task_state spawning.
Nov 22 14:27:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:25 user nova-compute[74776]: DEBUG nova.compute.manager [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:27:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:27:25 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Instance spawned successfully.
Nov 22 14:27:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-d0876602-912d-4d38-b62e-cabcc35d4da3 req-fe5bb3e2-c964-44ff-b398-8d8c459f85b4 service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Received event network-vif-plugged-6117aba3-000f-40a8-9444-33c3d9b7ae6b {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:27:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d0876602-912d-4d38-b62e-cabcc35d4da3 req-fe5bb3e2-c964-44ff-b398-8d8c459f85b4 service nova] Acquiring lock "771e2959-789e-4ef0-a4c9-052cdfa13b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:27:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d0876602-912d-4d38-b62e-cabcc35d4da3 req-fe5bb3e2-c964-44ff-b398-8d8c459f85b4 service nova] Lock "771e2959-789e-4ef0-a4c9-052cdfa13b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:27:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d0876602-912d-4d38-b62e-cabcc35d4da3 req-fe5bb3e2-c964-44ff-b398-8d8c459f85b4 service nova] Lock "771e2959-789e-4ef0-a4c9-052cdfa13b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:27:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-d0876602-912d-4d38-b62e-cabcc35d4da3 req-fe5bb3e2-c964-44ff-b398-8d8c459f85b4 service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] No waiting events found dispatching network-vif-plugged-6117aba3-000f-40a8-9444-33c3d9b7ae6b {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:27:25 user nova-compute[74776]: WARNING nova.compute.manager [req-d0876602-912d-4d38-b62e-cabcc35d4da3 req-fe5bb3e2-c964-44ff-b398-8d8c459f85b4 service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Received unexpected event network-vif-plugged-6117aba3-000f-40a8-9444-33c3d9b7ae6b for instance with vm_state building and task_state spawning.
Nov 22 14:27:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:27:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:27:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:27:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:27:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:27:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:27:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:27:25 user nova-compute[74776]: INFO nova.compute.manager [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 22 14:27:25 user nova-compute[74776]: DEBUG nova.compute.manager [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:27:25 user nova-compute[74776]: INFO nova.compute.manager [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Took 6.36 seconds to build instance.
Nov 22 14:27:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9115d8fc-520c-491e-853c-49550669558d tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "771e2959-789e-4ef0-a4c9-052cdfa13b00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.475s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:27:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:37 user nova-compute[74776]: DEBUG nova.compute.manager [req-56c614a1-0474-4a7f-bc0c-eb7de7981a1b req-f272ed26-a9a8-402a-b4c6-e00356be41f9 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received event network-changed-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:27:37 user nova-compute[74776]: DEBUG nova.compute.manager [req-56c614a1-0474-4a7f-bc0c-eb7de7981a1b req-f272ed26-a9a8-402a-b4c6-e00356be41f9 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Refreshing instance network info cache due to event network-changed-5b603149-0a4f-4aac-890c-fade34245023. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:27:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-56c614a1-0474-4a7f-bc0c-eb7de7981a1b req-f272ed26-a9a8-402a-b4c6-e00356be41f9 service nova] Acquiring lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:27:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-56c614a1-0474-4a7f-bc0c-eb7de7981a1b req-f272ed26-a9a8-402a-b4c6-e00356be41f9 service nova] Acquired lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:27:37 user nova-compute[74776]: DEBUG nova.network.neutron [req-56c614a1-0474-4a7f-bc0c-eb7de7981a1b req-f272ed26-a9a8-402a-b4c6-e00356be41f9 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Refreshing network info cache for port 5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:27:37 user nova-compute[74776]: DEBUG nova.network.neutron [req-56c614a1-0474-4a7f-bc0c-eb7de7981a1b req-f272ed26-a9a8-402a-b4c6-e00356be41f9 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Updated VIF entry in instance network info cache for port 5b603149-0a4f-4aac-890c-fade34245023. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:27:37 user nova-compute[74776]: DEBUG nova.network.neutron [req-56c614a1-0474-4a7f-bc0c-eb7de7981a1b req-f272ed26-a9a8-402a-b4c6-e00356be41f9 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Updating instance_info_cache with network_info: [{"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:27:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-56c614a1-0474-4a7f-bc0c-eb7de7981a1b req-f272ed26-a9a8-402a-b4c6-e00356be41f9 service nova] Releasing lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:27:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquiring lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:27:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:27:37 user nova-compute[74776]: INFO nova.compute.manager [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Shelve offloading
Nov 22 14:27:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:38 user nova-compute[74776]: DEBUG nova.compute.manager [req-b444918a-cd78-49d1-a9ea-cb5c9a23c0f2 req-e6a1b9c6-8fd9-440b-9962-b41b18c4c4e3 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received event network-vif-unplugged-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:27:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b444918a-cd78-49d1-a9ea-cb5c9a23c0f2 req-e6a1b9c6-8fd9-440b-9962-b41b18c4c4e3 service nova] Acquiring lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:27:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b444918a-cd78-49d1-a9ea-cb5c9a23c0f2 req-e6a1b9c6-8fd9-440b-9962-b41b18c4c4e3 service nova] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:27:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b444918a-cd78-49d1-a9ea-cb5c9a23c0f2 req-e6a1b9c6-8fd9-440b-9962-b41b18c4c4e3 service nova] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:27:38 user nova-compute[74776]: DEBUG nova.compute.manager [req-b444918a-cd78-49d1-a9ea-cb5c9a23c0f2 req-e6a1b9c6-8fd9-440b-9962-b41b18c4c4e3 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] No waiting events found dispatching network-vif-unplugged-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:27:38 user nova-compute[74776]: WARNING nova.compute.manager [req-b444918a-cd78-49d1-a9ea-cb5c9a23c0f2 req-e6a1b9c6-8fd9-440b-9962-b41b18c4c4e3 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received unexpected event network-vif-unplugged-5b603149-0a4f-4aac-890c-fade34245023 for instance with vm_state active and task_state shelving.
Nov 22 14:27:38 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Instance destroyed successfully.
Nov 22 14:27:38 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:27:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquiring lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:27:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquired lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:27:38 user nova-compute[74776]: DEBUG nova.network.neutron [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG nova.network.neutron [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Updating instance_info_cache with network_info: [{"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Releasing lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:27:39 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Instance destroyed successfully.
Nov 22 14:27:39 user nova-compute[74776]: DEBUG nova.objects.instance [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lazy-loading 'resources' on Instance uuid b30a5c6b-ea71-4a06-ad03-a02ebd584a80 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:25:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-119206767',display_name='tempest-TestShelveInstance-server-119206767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-119206767',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAY6ASuS5HQb0Xhyk8b/r17lDnLrYyVvejz9OGw9Kf2fl3G9OMz9U29Vip6hne9mXyZRC73c3UMqFhEVUf4qdE4RGUmgaMzQe1KU1y7kuHHYBb8TVv/cp8qnXOvkKgma9g==',key_name='tempest-TestShelveInstance-457038765',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:26:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='529b6ffebfe549278c4462796677a969',ramdisk_id='',reservation_id='r-lsktxgb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-853764329',owner_user_name='tempest-TestShelveInstance-853764329-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:26:01Z,user_data=None,user_id='1d42ed53e03c4b6b8989293a3737d2f2',uuid=b30a5c6b-ea71-4a06-ad03-a02ebd584a80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Converting VIF {"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:cc:9b,bridge_name='br-int',has_traffic_filtering=True,id=5b603149-0a4f-4aac-890c-fade34245023,network=Network(bac4cf3b-8492-4d07-859d-266e1cddf6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b603149-0a') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG os_vif [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:cc:9b,bridge_name='br-int',has_traffic_filtering=True,id=5b603149-0a4f-4aac-890c-fade34245023,network=Network(bac4cf3b-8492-4d07-859d-266e1cddf6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b603149-0a') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b603149-0a, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1bc1e511-b069-4aa5-96b0-273ca6976f59) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:39 user nova-compute[74776]: INFO os_vif [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:cc:9b,bridge_name='br-int',has_traffic_filtering=True,id=5b603149-0a4f-4aac-890c-fade34245023,network=Network(bac4cf3b-8492-4d07-859d-266e1cddf6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b603149-0a')
Nov 22 14:27:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeMqQUCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:27:39 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:27:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a744e4-4a95-4783-93cd-e4c7719eb2fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:27:39 user nova-compute[74776]: No targets found.
Nov 22 14:27:39 user nova-compute[74776]: iSNS:
Nov 22 14:27:39 user nova-compute[74776]: No targets found.
Nov 22 14:27:39 user nova-compute[74776]: STATIC:
Nov 22 14:27:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a
Nov 22 14:27:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:27:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:27:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71
Nov 22 14:27:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:27:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:27:39 user nova-compute[74776]: FIRMWARE:
Nov 22 14:27:39 user nova-compute[74776]: No targets found.
Nov 22 14:27:39 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:27:39 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:27:39 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc64ce5-aa81-4620-bbd5-60e36fe8c07e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[19df35f1-3cf6-4e53-882f-252159da5929]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:27:39 user nova-compute[74776]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:27:39 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:27:39 user nova-compute[74776]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:27:39 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c3861b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71'): ({'sdd'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Removing single pathed devices sdd {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb85224e-45b6-469e-a1e6-470ddba8b910]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d18052b-6fda-4e48-8df6-d991ac90bdaf]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Flushing IO for device /dev/sdd {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fb08a7-a27b-4a84-8379-418388c74fb8]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db369e7-32c9-44e5-a2bb-c8072760f853]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] SCSI volumes sdd have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[48af612a-3489-4c5d-9b15-34f1540d4fa4]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64ed9d1-d1e3-4c02-86ab-77fd159da361]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71, portal: 172.16.0.220,3260]
Nov 22 14:27:39 user nova-compute[74776]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71, portal: 172.16.0.220,3260] successful.
Nov 22 14:27:39 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:27:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce0433d-5426-478b-bddc-9f6b92904c5a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:27:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:27:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] <== disconnect_volume: return (286ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:27:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:27:40 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Deleting instance files /opt/stack/data/nova/instances/b30a5c6b-ea71-4a06-ad03-a02ebd584a80_del
Nov 22 14:27:40 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Deletion of /opt/stack/data/nova/instances/b30a5c6b-ea71-4a06-ad03-a02ebd584a80_del complete
Nov 22 14:27:40 user nova-compute[74776]: DEBUG nova.compute.manager [req-32dc19e3-a58a-4564-b31e-0335b6025559 req-a81d2a87-d95a-4426-8bab-9dc72ec67c57 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received event network-vif-plugged-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:27:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-32dc19e3-a58a-4564-b31e-0335b6025559 req-a81d2a87-d95a-4426-8bab-9dc72ec67c57 service nova] Acquiring lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:27:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-32dc19e3-a58a-4564-b31e-0335b6025559 req-a81d2a87-d95a-4426-8bab-9dc72ec67c57 service nova] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:27:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-32dc19e3-a58a-4564-b31e-0335b6025559 req-a81d2a87-d95a-4426-8bab-9dc72ec67c57 service nova] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:27:40 user nova-compute[74776]: DEBUG nova.compute.manager [req-32dc19e3-a58a-4564-b31e-0335b6025559 req-a81d2a87-d95a-4426-8bab-9dc72ec67c57 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] No waiting events found dispatching network-vif-plugged-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:27:40 user nova-compute[74776]: WARNING nova.compute.manager [req-32dc19e3-a58a-4564-b31e-0335b6025559 req-a81d2a87-d95a-4426-8bab-9dc72ec67c57 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received unexpected event network-vif-plugged-5b603149-0a4f-4aac-890c-fade34245023 for instance with vm_state active and task_state shelving.
Nov 22 14:27:40 user nova-compute[74776]: DEBUG nova.compute.manager [req-32dc19e3-a58a-4564-b31e-0335b6025559 req-a81d2a87-d95a-4426-8bab-9dc72ec67c57 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received event network-changed-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:27:40 user nova-compute[74776]: DEBUG nova.compute.manager [req-32dc19e3-a58a-4564-b31e-0335b6025559 req-a81d2a87-d95a-4426-8bab-9dc72ec67c57 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Refreshing instance network info cache due to event network-changed-5b603149-0a4f-4aac-890c-fade34245023. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:27:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-32dc19e3-a58a-4564-b31e-0335b6025559 req-a81d2a87-d95a-4426-8bab-9dc72ec67c57 service nova] Acquiring lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:27:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-32dc19e3-a58a-4564-b31e-0335b6025559 req-a81d2a87-d95a-4426-8bab-9dc72ec67c57 service nova] Acquired lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:27:40 user nova-compute[74776]: DEBUG nova.network.neutron [req-32dc19e3-a58a-4564-b31e-0335b6025559 req-a81d2a87-d95a-4426-8bab-9dc72ec67c57 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Refreshing network info cache for port 5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:27:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:40 user nova-compute[74776]: DEBUG nova.network.neutron [req-32dc19e3-a58a-4564-b31e-0335b6025559 req-a81d2a87-d95a-4426-8bab-9dc72ec67c57 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Updated VIF entry in instance network info cache for port 5b603149-0a4f-4aac-890c-fade34245023. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:27:40 user nova-compute[74776]: DEBUG nova.network.neutron [req-32dc19e3-a58a-4564-b31e-0335b6025559 req-a81d2a87-d95a-4426-8bab-9dc72ec67c57 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Updating instance_info_cache with network_info: [{"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": null, "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5b603149-0a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:27:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-32dc19e3-a58a-4564-b31e-0335b6025559 req-a81d2a87-d95a-4426-8bab-9dc72ec67c57 service nova] Releasing lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:27:41 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Deleted allocations for instance b30a5c6b-ea71-4a06-ad03-a02ebd584a80
Nov 22 14:27:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:27:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:27:41 user nova-compute[74776]: DEBUG nova.objects.instance [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lazy-loading 'numa_topology' on Instance uuid b30a5c6b-ea71-4a06-ad03-a02ebd584a80 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:27:41 user nova-compute[74776]: DEBUG nova.objects.base [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Object Instance<b30a5c6b-ea71-4a06-ad03-a02ebd584a80> lazy-loaded attributes: resources,numa_topology {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:27:41 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:27:41 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:27:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:27:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c93ba08e-0378-468f-966b-2f2aede83047 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.606s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG nova.compute.manager [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:27:44 user nova-compute[74776]: INFO nova.compute.claims [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Claim successful on node user
Nov 22 14:27:44 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG nova.compute.manager [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG nova.compute.manager [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG nova.network.neutron [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:27:44 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:27:44 user nova-compute[74776]: DEBUG nova.compute.manager [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG nova.policy [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f703bfbe762447778429bda22b74505c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3958d7be91b4bb1b9e314d8867cd8f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:27:44 user nova-compute[74776]: INFO nova.virt.block_device [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Booting with volume 7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 at /dev/vda
Nov 22 14:27:44 user nova-compute[74776]: DEBUG os_brick.utils [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e68dd4-6bcd-4e3d-8c19-392d902b4726]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e235e2-1e12-4f0c-969d-d94c0187a45f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:44 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c69e599-2f2b-413f-9512-08d409ea3ee1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b464946e-5141-4763-8377-afb268ec2b90]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:27:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:27:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:27:45 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:27:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca82035-337a-4205-bc71-b95f3bc99609]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:27:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:27:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:27:45 user nova-compute[74776]: DEBUG os_brick.utils [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:27:45 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Updating existing volume attachment record: 23313326-019f-4865-afe4-8eeec0bc8626 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:27:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:45 user nova-compute[74776]: DEBUG nova.network.neutron [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Successfully created port: 414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:27:46 user nova-compute[74776]: DEBUG nova.network.neutron [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Successfully updated port: 414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:27:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "refresh_cache-245ff2b1-5e87-4756-b4c1-86a2fea089a5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:27:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquired lock "refresh_cache-245ff2b1-5e87-4756-b4c1-86a2fea089a5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:27:46 user nova-compute[74776]: DEBUG nova.network.neutron [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:27:46 user nova-compute[74776]: DEBUG nova.compute.manager [req-60ae4244-f12d-473c-98a8-579692bd437e req-f3035e01-0680-41ed-8243-d606e24dd415 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received event network-changed-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:27:46 user nova-compute[74776]: DEBUG nova.compute.manager [req-60ae4244-f12d-473c-98a8-579692bd437e req-f3035e01-0680-41ed-8243-d606e24dd415 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Refreshing instance network info cache due to event network-changed-414f82bf-343b-4e38-bc14-6af797152ea5. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:27:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-60ae4244-f12d-473c-98a8-579692bd437e req-f3035e01-0680-41ed-8243-d606e24dd415 service nova] Acquiring lock "refresh_cache-245ff2b1-5e87-4756-b4c1-86a2fea089a5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:27:46 user nova-compute[74776]: DEBUG nova.network.neutron [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:27:47 user nova-compute[74776]: DEBUG nova.network.neutron [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Updating instance_info_cache with network_info: [{"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:27:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Releasing lock "refresh_cache-245ff2b1-5e87-4756-b4c1-86a2fea089a5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:27:47 user nova-compute[74776]: DEBUG nova.compute.manager [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Instance network_info: |[{"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:27:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-60ae4244-f12d-473c-98a8-579692bd437e req-f3035e01-0680-41ed-8243-d606e24dd415 service nova] Acquired lock "refresh_cache-245ff2b1-5e87-4756-b4c1-86a2fea089a5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:27:47 user nova-compute[74776]: DEBUG nova.network.neutron [req-60ae4244-f12d-473c-98a8-579692bd437e req-f3035e01-0680-41ed-8243-d606e24dd415 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Refreshing network info cache for port 414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:27:47 user nova-compute[74776]: DEBUG nova.network.neutron [req-60ae4244-f12d-473c-98a8-579692bd437e req-f3035e01-0680-41ed-8243-d606e24dd415 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Updated VIF entry in instance network info cache for port 414f82bf-343b-4e38-bc14-6af797152ea5. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:27:47 user nova-compute[74776]: DEBUG nova.network.neutron [req-60ae4244-f12d-473c-98a8-579692bd437e req-f3035e01-0680-41ed-8243-d606e24dd415 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Updating instance_info_cache with network_info: [{"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:27:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-60ae4244-f12d-473c-98a8-579692bd437e req-f3035e01-0680-41ed-8243-d606e24dd415 service nova] Releasing lock "refresh_cache-245ff2b1-5e87-4756-b4c1-86a2fea089a5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:27:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.compute.manager [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:27:51 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Creating image(s)
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Did not create local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Ensure instance console log exists: /opt/stack/data/nova/instances/245ff2b1-5e87-4756-b4c1-86a2fea089a5/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Start _get_guest_xml network_info=[{"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '23313326-019f-4865-afe4-8eeec0bc8626', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxWHJsVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '245ff2b1-5e87-4756-b4c1-86a2fea089a5', 'attached_at': '', 'detached_at': '', 'volume_id': '7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3', 'serial': '7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3'}, 'boot_index': 0, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:27:51 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:27:51 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxWHJsVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:27:51 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:27:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:27:51 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:27:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:27:51 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:27:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e8b5b8-1c0e-4d73-9beb-be9403678cd8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:27:51 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a05ecbe-e5fc-4f9d-a3b2-9be6e8605cd3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3] added
Nov 22 14:27:51 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:27:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c8cab1-0946-4d81-962b-6922ed16b942]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef382f8a-d799-46eb-9d4f-8f2e9863872a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XxWHJsVr {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XxWHJsVr" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbd72eb-384a-4ae8-aa4c-0eb195852145]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XxWHJsVr'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c28477-c99e-4e5d-9c35-32c5867269bb]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[255443c5-768b-42ff-b514-e8f87b590f57]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:27:52 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:27:52 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5b7e10-10b5-483b-b1b6-89d0c0529667]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3, portal: 172.16.0.220,3260]
Nov 22 14:27:52 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3, portal: 172.16.0.220,3260] successful.
Nov 22 14:27:52 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad20519-5640-4894-b9a9-160cd07c6273]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9731ca5a-59b4-49ad-ac6d-755df836ee46]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:27:52 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:27:52 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:27:52 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:27:52 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[404a540d-19f1-48a2-9fb1-21a85a805561]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:27:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxWHJsVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23831366538313961', 'path': '/dev/sdc'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831366538313961', 'path': '/dev/sdc'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-10125610',display_name='tempest-ServerActionsTestOtherA-server-10125610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-10125610',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+0/ONa93QEWt5XODlWdDhT3U9g8+KkiNeYX5RdCfVnODI9hDpQVCexgtOudugmxzZAzaK3M5HeFwSkQ11sjSni+XdF+kkALoXukp/BrvBbOU8ZVGgWEOMKJnkhO9ZxRw==',key_name='tempest-keypair-1736172995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3958d7be91b4bb1b9e314d8867cd8f5',ramdisk_id='',reservation_id='r-n2u0p23v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-109524404',owner_user_name='tempest-ServerActionsTestOtherA-109524404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:27:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f703bfbe762447778429bda22b74505c',uuid=245ff2b1-5e87-4756-b4c1-86a2fea089a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converting VIF {"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:9f:55,bridge_name='br-int',has_traffic_filtering=True,id=414f82bf-343b-4e38-bc14-6af797152ea5,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap414f82bf-34') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG nova.objects.instance [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lazy-loading 'pci_devices' on Instance uuid 245ff2b1-5e87-4756-b4c1-86a2fea089a5 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:27:53 user nova-compute[74776]:   <uuid>245ff2b1-5e87-4756-b4c1-86a2fea089a5</uuid>
Nov 22 14:27:53 user nova-compute[74776]:   <name>instance-0000001c</name>
Nov 22 14:27:53 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:27:53 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:27:53 user nova-compute[74776]:   <metadata>
Nov 22 14:27:53 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:27:53 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:27:53 user nova-compute[74776]:       <nova:name>tempest-ServerActionsTestOtherA-server-10125610</nova:name>
Nov 22 14:27:53 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:27:51</nova:creationTime>
Nov 22 14:27:53 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:27:53 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:27:53 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:27:53 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:27:53 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:27:53 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:27:53 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:27:53 user nova-compute[74776]:       <nova:owner>
Nov 22 14:27:53 user nova-compute[74776]:         <nova:user uuid="f703bfbe762447778429bda22b74505c">tempest-ServerActionsTestOtherA-109524404-project-member</nova:user>
Nov 22 14:27:53 user nova-compute[74776]:         <nova:project uuid="a3958d7be91b4bb1b9e314d8867cd8f5">tempest-ServerActionsTestOtherA-109524404</nova:project>
Nov 22 14:27:53 user nova-compute[74776]:       </nova:owner>
Nov 22 14:27:53 user nova-compute[74776]:       <nova:ports>
Nov 22 14:27:53 user nova-compute[74776]:         <nova:port uuid="414f82bf-343b-4e38-bc14-6af797152ea5">
Nov 22 14:27:53 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 14:27:53 user nova-compute[74776]:         </nova:port>
Nov 22 14:27:53 user nova-compute[74776]:       </nova:ports>
Nov 22 14:27:53 user nova-compute[74776]:     </nova:instance>
Nov 22 14:27:53 user nova-compute[74776]:   </metadata>
Nov 22 14:27:53 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:27:53 user nova-compute[74776]:     <system>
Nov 22 14:27:53 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:27:53 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:27:53 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:27:53 user nova-compute[74776]:       <entry name="serial">245ff2b1-5e87-4756-b4c1-86a2fea089a5</entry>
Nov 22 14:27:53 user nova-compute[74776]:       <entry name="uuid">245ff2b1-5e87-4756-b4c1-86a2fea089a5</entry>
Nov 22 14:27:53 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:27:53 user nova-compute[74776]:     </system>
Nov 22 14:27:53 user nova-compute[74776]:   </sysinfo>
Nov 22 14:27:53 user nova-compute[74776]:   <os>
Nov 22 14:27:53 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:27:53 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:27:53 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:27:53 user nova-compute[74776]:   </os>
Nov 22 14:27:53 user nova-compute[74776]:   <features>
Nov 22 14:27:53 user nova-compute[74776]:     <acpi/>
Nov 22 14:27:53 user nova-compute[74776]:     <apic/>
Nov 22 14:27:53 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:27:53 user nova-compute[74776]:   </features>
Nov 22 14:27:53 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:27:53 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:27:53 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:27:53 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:27:53 user nova-compute[74776]:   </clock>
Nov 22 14:27:53 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:27:53 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:27:53 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:27:53 user nova-compute[74776]:   </cpu>
Nov 22 14:27:53 user nova-compute[74776]:   <devices>
Nov 22 14:27:53 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:27:53 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:27:53 user nova-compute[74776]:       <source dev="/dev/sdc"/>
Nov 22 14:27:53 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:27:53 user nova-compute[74776]:       <serial>7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3</serial>
Nov 22 14:27:53 user nova-compute[74776]:     </disk>
Nov 22 14:27:53 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:27:53 user nova-compute[74776]:       <mac address="fa:16:3e:c0:9f:55"/>
Nov 22 14:27:53 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:27:53 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:27:53 user nova-compute[74776]:       <target dev="tap414f82bf-34"/>
Nov 22 14:27:53 user nova-compute[74776]:     </interface>
Nov 22 14:27:53 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:27:53 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/245ff2b1-5e87-4756-b4c1-86a2fea089a5/console.log" append="off"/>
Nov 22 14:27:53 user nova-compute[74776]:     </serial>
Nov 22 14:27:53 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:27:53 user nova-compute[74776]:     <video>
Nov 22 14:27:53 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:27:53 user nova-compute[74776]:     </video>
Nov 22 14:27:53 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:27:53 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:27:53 user nova-compute[74776]:     </rng>
Nov 22 14:27:53 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:27:53 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:27:53 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:27:53 user nova-compute[74776]:     </memballoon>
Nov 22 14:27:53 user nova-compute[74776]:   </devices>
Nov 22 14:27:53 user nova-compute[74776]: </domain>
Nov 22 14:27:53 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-10125610',display_name='tempest-ServerActionsTestOtherA-server-10125610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-10125610',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+0/ONa93QEWt5XODlWdDhT3U9g8+KkiNeYX5RdCfVnODI9hDpQVCexgtOudugmxzZAzaK3M5HeFwSkQ11sjSni+XdF+kkALoXukp/BrvBbOU8ZVGgWEOMKJnkhO9ZxRw==',key_name='tempest-keypair-1736172995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3958d7be91b4bb1b9e314d8867cd8f5',ramdisk_id='',reservation_id='r-n2u0p23v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-109524404',owner_user_name='tempest-ServerActionsTestOtherA-109524404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:27:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f703bfbe762447778429bda22b74505c',uuid=245ff2b1-5e87-4756-b4c1-86a2fea089a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converting VIF {"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:9f:55,bridge_name='br-int',has_traffic_filtering=True,id=414f82bf-343b-4e38-bc14-6af797152ea5,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap414f82bf-34') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG os_vif [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:9f:55,bridge_name='br-int',has_traffic_filtering=True,id=414f82bf-343b-4e38-bc14-6af797152ea5,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap414f82bf-34') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9242ce82-37e2-5a2d-890f-828130d45777', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap414f82bf-34, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap414f82bf-34, col_values=(('qos', UUID('280a2d1b-97d5-45e1-8395-062f94345a03')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap414f82bf-34, col_values=(('external_ids', {'iface-id': '414f82bf-343b-4e38-bc14-6af797152ea5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:9f:55', 'vm-uuid': '245ff2b1-5e87-4756-b4c1-86a2fea089a5'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:53 user nova-compute[74776]: INFO os_vif [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:9f:55,bridge_name='br-int',has_traffic_filtering=True,id=414f82bf-343b-4e38-bc14-6af797152ea5,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap414f82bf-34')
Nov 22 14:27:53 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:27:53 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] No VIF found with MAC fa:16:3e:c0:9f:55, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:27:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:54 user nova-compute[74776]: DEBUG nova.compute.manager [req-963536bd-0a9e-4f10-a90b-dc387a3dac2a req-6c22335d-7c1b-4db9-9336-4d82df62be75 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received event network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:27:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-963536bd-0a9e-4f10-a90b-dc387a3dac2a req-6c22335d-7c1b-4db9-9336-4d82df62be75 service nova] Acquiring lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:27:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-963536bd-0a9e-4f10-a90b-dc387a3dac2a req-6c22335d-7c1b-4db9-9336-4d82df62be75 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:27:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-963536bd-0a9e-4f10-a90b-dc387a3dac2a req-6c22335d-7c1b-4db9-9336-4d82df62be75 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:27:54 user nova-compute[74776]: DEBUG nova.compute.manager [req-963536bd-0a9e-4f10-a90b-dc387a3dac2a req-6c22335d-7c1b-4db9-9336-4d82df62be75 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] No waiting events found dispatching network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:27:54 user nova-compute[74776]: WARNING nova.compute.manager [req-963536bd-0a9e-4f10-a90b-dc387a3dac2a req-6c22335d-7c1b-4db9-9336-4d82df62be75 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received unexpected event network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 for instance with vm_state building and task_state spawning.
Nov 22 14:27:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:27:56 user nova-compute[74776]: DEBUG nova.compute.manager [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:27:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:27:56 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Instance spawned successfully.
Nov 22 14:27:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:27:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:27:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:27:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:27:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:27:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:27:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:27:56 user nova-compute[74776]: INFO nova.compute.manager [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Took 5.06 seconds to spawn the instance on the hypervisor.
Nov 22 14:27:56 user nova-compute[74776]: DEBUG nova.compute.manager [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:27:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-ca8e6fcd-d99d-4dcf-8589-df0bf01d67c3 req-f5bd818f-0781-481f-907a-f840f36d4e28 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received event network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:27:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ca8e6fcd-d99d-4dcf-8589-df0bf01d67c3 req-f5bd818f-0781-481f-907a-f840f36d4e28 service nova] Acquiring lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:27:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ca8e6fcd-d99d-4dcf-8589-df0bf01d67c3 req-f5bd818f-0781-481f-907a-f840f36d4e28 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:27:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ca8e6fcd-d99d-4dcf-8589-df0bf01d67c3 req-f5bd818f-0781-481f-907a-f840f36d4e28 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:27:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-ca8e6fcd-d99d-4dcf-8589-df0bf01d67c3 req-f5bd818f-0781-481f-907a-f840f36d4e28 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] No waiting events found dispatching network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:27:56 user nova-compute[74776]: WARNING nova.compute.manager [req-ca8e6fcd-d99d-4dcf-8589-df0bf01d67c3 req-f5bd818f-0781-481f-907a-f840f36d4e28 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received unexpected event network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 for instance with vm_state building and task_state spawning.
Nov 22 14:27:57 user nova-compute[74776]: INFO nova.compute.manager [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Took 12.90 seconds to build instance.
Nov 22 14:27:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e41fd4fc-876b-45b7-a4e2-8a030d848b09 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.025s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:27:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:28:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:28:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:28:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:28:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:11 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:28:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:14 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:28:14 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:28:14 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 14:28:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:28:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:28:14 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:28:14 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid 4629d82d-fd02-4a58-a535-b362b493e7c0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:28:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:15 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Updating instance_info_cache with network_info: [{"id": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "address": "fa:16:3e:a5:87:db", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabaa3c9b-98", "ovs_interfaceid": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:28:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:28:15 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:28:15 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:28:15 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:28:15 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:28:15 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:28:15 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:28:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:15 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:28:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:28:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:28:18 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:28:18 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:28:18 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=7899MB free_disk=25.24692153930664GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:28:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4629d82d-fd02-4a58-a535-b362b493e7c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:28:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 525baf66-82cc-4e8d-a37a-c92c51d4673d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:28:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6f2ce4b2-660c-431f-b951-c6ec5090ef7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:28:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f4f30fe7-b234-4f81-b081-3214f5ebe789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:28:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance bc98341b-ca28-4097-9887-16c8e8d7f9f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:28:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 96a7c6ec-0cb9-481b-8ec5-4337130bc000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:28:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 771e2959-789e-4ef0-a4c9-052cdfa13b00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:28:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 245ff2b1-5e87-4756-b4c1-86a2fea089a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:28:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:28:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:28:19 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:28:19 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:28:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:28:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:21 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:28:21 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:28:21 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:28:23 user nova-compute[74776]: INFO nova.compute.manager [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Rescuing
Nov 22 14:28:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "refresh_cache-bc98341b-ca28-4097-9887-16c8e8d7f9f7" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:28:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquired lock "refresh_cache-bc98341b-ca28-4097-9887-16c8e8d7f9f7" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:28:23 user nova-compute[74776]: DEBUG nova.network.neutron [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:28:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-18162666-e3b5-47ee-9613-fb05e0ea54de req-96367987-e20a-459b-b3a0-a5604b42b27a service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Received event network-changed-600b1da5-d75f-48ff-a470-b92c141a5a8f {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:28:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-18162666-e3b5-47ee-9613-fb05e0ea54de req-96367987-e20a-459b-b3a0-a5604b42b27a service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Refreshing instance network info cache due to event network-changed-600b1da5-d75f-48ff-a470-b92c141a5a8f. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:28:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-18162666-e3b5-47ee-9613-fb05e0ea54de req-96367987-e20a-459b-b3a0-a5604b42b27a service nova] Acquiring lock "refresh_cache-96a7c6ec-0cb9-481b-8ec5-4337130bc000" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:28:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-18162666-e3b5-47ee-9613-fb05e0ea54de req-96367987-e20a-459b-b3a0-a5604b42b27a service nova] Acquired lock "refresh_cache-96a7c6ec-0cb9-481b-8ec5-4337130bc000" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:28:23 user nova-compute[74776]: DEBUG nova.network.neutron [req-18162666-e3b5-47ee-9613-fb05e0ea54de req-96367987-e20a-459b-b3a0-a5604b42b27a service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Refreshing network info cache for port 600b1da5-d75f-48ff-a470-b92c141a5a8f {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:28:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lazy-loading 'flavor' on Instance uuid 96a7c6ec-0cb9-481b-8ec5-4337130bc000 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG nova.network.neutron [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Updating instance_info_cache with network_info: [{"id": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "address": "fa:16:3e:5f:fc:12", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cec0cf0-89", "ovs_interfaceid": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:28:24 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Ignoring supplied device name: /dev/vdb
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Releasing lock "refresh_cache-bc98341b-ca28-4097-9887-16c8e8d7f9f7" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:24 user nova-compute[74776]: INFO nova.compute.manager [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Attaching volume 2fb64953-06fe-49f0-a3d7-157f54e81a47 to /dev/vdb
Nov 22 14:28:24 user nova-compute[74776]: DEBUG os_brick.utils [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90b04cb-5091-480c-a156-9457a73fb269]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-c319b56e-fa1e-4984-9322-59d7230a6c4c req-8d3cac04-2b62-4fe0-80f7-41b912d76151 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received event network-vif-unplugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c319b56e-fa1e-4984-9322-59d7230a6c4c req-8d3cac04-2b62-4fe0-80f7-41b912d76151 service nova] Acquiring lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c319b56e-fa1e-4984-9322-59d7230a6c4c req-8d3cac04-2b62-4fe0-80f7-41b912d76151 service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c319b56e-fa1e-4984-9322-59d7230a6c4c req-8d3cac04-2b62-4fe0-80f7-41b912d76151 service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-c319b56e-fa1e-4984-9322-59d7230a6c4c req-8d3cac04-2b62-4fe0-80f7-41b912d76151 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] No waiting events found dispatching network-vif-unplugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:28:24 user nova-compute[74776]: WARNING nova.compute.manager [req-c319b56e-fa1e-4984-9322-59d7230a6c4c req-8d3cac04-2b62-4fe0-80f7-41b912d76151 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received unexpected event network-vif-unplugged-5cec0cf0-892c-4c30-ae08-7e127098bccf for instance with vm_state active and task_state rescuing.
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5eaed5-5700-43dc-be4a-64bcb9d96200]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0ec93c-5fe2-4c42-abaa-37cc1f89b9f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a90fc2-073e-4653-8dd9-de69a6841f82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:28:24 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdabc57-5d0b-4f36-b3a2-9f909f7a510c]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG os_brick.utils [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Updating existing volume attachment record: 45ce7664-659d-4b74-95da-ed6250345084 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG nova.network.neutron [req-18162666-e3b5-47ee-9613-fb05e0ea54de req-96367987-e20a-459b-b3a0-a5604b42b27a service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Updated VIF entry in instance network info cache for port 600b1da5-d75f-48ff-a470-b92c141a5a8f. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG nova.network.neutron [req-18162666-e3b5-47ee-9613-fb05e0ea54de req-96367987-e20a-459b-b3a0-a5604b42b27a service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Updating instance_info_cache with network_info: [{"id": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "address": "fa:16:3e:9e:bf:17", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap600b1da5-d7", "ovs_interfaceid": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-18162666-e3b5-47ee-9613-fb05e0ea54de req-96367987-e20a-459b-b3a0-a5604b42b27a service nova] Releasing lock "refresh_cache-96a7c6ec-0cb9-481b-8ec5-4337130bc000" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:28:24 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Instance destroyed successfully.
Nov 22 14:28:24 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Attempting a stable device rescue
Nov 22 14:28:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74776) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Instance directory exists: not creating {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 14:28:24 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Creating image(s)
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc98341b-ca28-4097-9887-16c8e8d7f9f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "/opt/stack/data/nova/instances/bc98341b-ca28-4097-9887-16c8e8d7f9f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "/opt/stack/data/nova/instances/bc98341b-ca28-4097-9887-16c8e8d7f9f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG nova.objects.instance [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'trusted_certs' on Instance uuid bc98341b-ca28-4097-9887-16c8e8d7f9f7 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "eb78f9c50bb2fec08d30a802f663f276a46ef011" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "eb78f9c50bb2fec08d30a802f663f276a46ef011" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb78f9c50bb2fec08d30a802f663f276a46ef011.part --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "016bf051-9034-4124-948d-995aacf77caf" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "016bf051-9034-4124-948d-995aacf77caf" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:26 user nova-compute[74776]: INFO nova.compute.manager [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Unshelving
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:28:26 user nova-compute[74776]: INFO nova.compute.claims [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Claim successful on node user
Nov 22 14:28:26 user nova-compute[74776]: INFO nova.virt.block_device [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Booting with volume 277635d3-2b9a-4405-a753-9d13911445a9 at /dev/vdc
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb78f9c50bb2fec08d30a802f663f276a46ef011.part --force-share --output=json" returned: 0 in 0.204s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG nova.virt.images [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] ee5840b9-88f1-43cf-a5c9-fb04f7eaa1c5 was qcow2, converting to raw {{(pid=74776) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG nova.privsep.utils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74776) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb78f9c50bb2fec08d30a802f663f276a46ef011.part /opt/stack/data/nova/instances/_base/eb78f9c50bb2fec08d30a802f663f276a46ef011.converted {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG os_brick.utils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae16c49e-21b0-43e7-9b9d-4f23a44ae3a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1cc21c-39ae-4b92-92df-09892e8163c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7b0783-6b27-410d-afeb-dbed401bd406]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[019753c4-8dc9-4812-a91f-e276a6150370]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-3f0f11cf-9434-4f67-9501-39792e386e48 req-f84e57b7-4727-4017-baba-a78db0ccd6ff service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received event network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3f0f11cf-9434-4f67-9501-39792e386e48 req-f84e57b7-4727-4017-baba-a78db0ccd6ff service nova] Acquiring lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3f0f11cf-9434-4f67-9501-39792e386e48 req-f84e57b7-4727-4017-baba-a78db0ccd6ff service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3f0f11cf-9434-4f67-9501-39792e386e48 req-f84e57b7-4727-4017-baba-a78db0ccd6ff service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-3f0f11cf-9434-4f67-9501-39792e386e48 req-f84e57b7-4727-4017-baba-a78db0ccd6ff service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] No waiting events found dispatching network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:28:26 user nova-compute[74776]: WARNING nova.compute.manager [req-3f0f11cf-9434-4f67-9501-39792e386e48 req-f84e57b7-4727-4017-baba-a78db0ccd6ff service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received unexpected event network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf for instance with vm_state active and task_state rescuing.
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:28:26 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ae5922-546b-4469-b2a5-b0e756823f80]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG os_brick.utils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] <== get_connector_properties: return (264ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Updating existing volume attachment record: f5d04f0e-0f62-4c12-96b4-49280187564b {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb78f9c50bb2fec08d30a802f663f276a46ef011.part /opt/stack/data/nova/instances/_base/eb78f9c50bb2fec08d30a802f663f276a46ef011.converted" returned: 0 in 0.412s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb78f9c50bb2fec08d30a802f663f276a46ef011.converted --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.672s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb78f9c50bb2fec08d30a802f663f276a46ef011.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "eb78f9c50bb2fec08d30a802f663f276a46ef011" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.888s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "eb78f9c50bb2fec08d30a802f663f276a46ef011" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "eb78f9c50bb2fec08d30a802f663f276a46ef011" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb78f9c50bb2fec08d30a802f663f276a46ef011 --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG nova.network.neutron [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:28:26 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:28:26 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:28:26 user nova-compute[74776]: DEBUG nova.policy [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aac47c7fc2fc4380a5673117151dbdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2602b8e7e2414a3d88d18f9f0c973ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb78f9c50bb2fec08d30a802f663f276a46ef011 --force-share --output=json" returned: 0 in 0.173s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb78f9c50bb2fec08d30a802f663f276a46ef011,backing_fmt=raw /opt/stack/data/nova/instances/bc98341b-ca28-4097-9887-16c8e8d7f9f7/disk.rescue {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:28:27 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Creating image(s)
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "/opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "/opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "/opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "56cc66d516c1aaa3b9d52915ea9a61514add9c7b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "56cc66d516c1aaa3b9d52915ea9a61514add9c7b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb78f9c50bb2fec08d30a802f663f276a46ef011,backing_fmt=raw /opt/stack/data/nova/instances/bc98341b-ca28-4097-9887-16c8e8d7f9f7/disk.rescue" returned: 0 in 0.073s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "eb78f9c50bb2fec08d30a802f663f276a46ef011" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.objects.instance [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'migration_context' on Instance uuid bc98341b-ca28-4097-9887-16c8e8d7f9f7 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.objects.base [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Object Instance<bc98341b-ca28-4097-9887-16c8e8d7f9f7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Start _get_guest_xml network_info=[{"id": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "address": "fa:16:3e:5f:fc:12", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "vif_mac": "fa:16:3e:5f:fc:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cec0cf0-89", "ovs_interfaceid": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ee5840b9-88f1-43cf-a5c9-fb04f7eaa1c5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd47af82d-5937-4e3d-aa92-206de3451b2c', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'goChikQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'bc98341b-ca28-4097-9887-16c8e8d7f9f7', 'attached_at': '', 'detached_at': '', 'volume_id': '22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a', 'serial': '22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a'}, 'boot_index': 0, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.objects.instance [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'resources' on Instance uuid bc98341b-ca28-4097-9887-16c8e8d7f9f7 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.objects.base [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Object Instance<bc98341b-ca28-4097-9887-16c8e8d7f9f7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.objects.instance [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'numa_topology' on Instance uuid bc98341b-ca28-4097-9887-16c8e8d7f9f7 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56cc66d516c1aaa3b9d52915ea9a61514add9c7b.part --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.objects.base [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Object Instance<bc98341b-ca28-4097-9887-16c8e8d7f9f7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:28:27 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:28:27 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.objects.instance [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'vcpu_model' on Instance uuid bc98341b-ca28-4097-9887-16c8e8d7f9f7 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.network.neutron [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Successfully created port: 3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.objects.base [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Object Instance<bc98341b-ca28-4097-9887-16c8e8d7f9f7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'goChikQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:28:27 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:28:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:28:27 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:28:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:28:27 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bffe255-8e9a-43ab-bb33-bb8f8b03aece]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = goChikQA\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 22 14:28:27 user nova-compute[74776]: node.name = iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a
Nov 22 14:28:27 user nova-compute[74776]: node.tpgt = -1
Nov 22 14:28:27 user nova-compute[74776]: node.startup = automatic
Nov 22 14:28:27 user nova-compute[74776]: node.leading_login = No
Nov 22 14:28:27 user nova-compute[74776]: iface.iscsi_ifacename = default
Nov 22 14:28:27 user nova-compute[74776]: iface.net_ifacename = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.ipaddress = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.prefix_len = 0
Nov 22 14:28:27 user nova-compute[74776]: iface.hwaddress = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.transport_name = tcp
Nov 22 14:28:27 user nova-compute[74776]: iface.initiatorname = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.state = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.vlan_id = 0
Nov 22 14:28:27 user nova-compute[74776]: iface.vlan_priority = 0
Nov 22 14:28:27 user nova-compute[74776]: iface.vlan_state = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.iface_num = 0
Nov 22 14:28:27 user nova-compute[74776]: iface.mtu = 0
Nov 22 14:28:27 user nova-compute[74776]: iface.port = 0
Nov 22 14:28:27 user nova-compute[74776]: iface.bootproto = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.subnet_mask = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.gateway = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.dhcp_alt_client_id_state = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.dhcp_alt_client_id = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.dhcp_dns = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.dhcp_learn_iqn = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.dhcp_req_vendor_id_state = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.dhcp_vendor_id_state = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.dhcp_vendor_id = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.dhcp_slp_da = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.fragmentation = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.gratuitous_arp = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.incoming_forwarding = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.tos_state = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.tos = 0
Nov 22 14:28:27 user nova-compute[74776]: iface.ttl = 0
Nov 22 14:28:27 user nova-compute[74776]: iface.delayed_ack = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.tcp_nagle = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.tcp_wsf_state = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.tcp_wsf = 0
Nov 22 14:28:27 user nova-compute[74776]: iface.tcp_timer_scale = 0
Nov 22 14:28:27 user nova-compute[74776]: iface.tcp_timestamp = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.redirect = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.def_task_mgmt_timeout = 0
Nov 22 14:28:27 user nova-compute[74776]: iface.header_digest = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.data_digest = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.immediate_data = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.initial_r2t = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.data_seq_inorder = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.data_pdu_inorder = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.erl = 0
Nov 22 14:28:27 user nova-compute[74776]: iface.max_receive_data_len = 0
Nov 22 14:28:27 user nova-compute[74776]: iface.first_burst_len = 0
Nov 22 14:28:27 user nova-compute[74776]: iface.max_outstanding_r2t = 0
Nov 22 14:28:27 user nova-compute[74776]: iface.max_burst_len = 0
Nov 22 14:28:27 user nova-compute[74776]: iface.chap_auth = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.bidi_chap = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.strict_login_compliance = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.discovery_auth = <empty>
Nov 22 14:28:27 user nova-compute[74776]: iface.discovery_logout = <empty>
Nov 22 14:28:27 user nova-compute[74776]: node.discovery_address = <empty>
Nov 22 14:28:27 user nova-compute[74776]: node.discovery_port = 0
Nov 22 14:28:27 user nova-compute[74776]: node.discovery_type = static
Nov 22 14:28:27 user nova-compute[74776]: node.session.initial_cmdsn = 0
Nov 22 14:28:27 user nova-compute[74776]: node.session.initial_login_retry_max = 8
Nov 22 14:28:27 user nova-compute[74776]: node.session.xmit_thread_priority = -20
Nov 22 14:28:27 user nova-compute[74776]: node.session.cmds_max = 128
Nov 22 14:28:27 user nova-compute[74776]: node.session.queue_depth = 32
Nov 22 14:28:27 user nova-compute[74776]: node.session.nr_sessions = 1
Nov 22 14:28:27 user nova-compute[74776]: node.session.auth.authmethod = CHAP
Nov 22 14:28:27 user nova-compute[74776]: node.session.auth.username = goChikQA
Nov 22 14:28:27 user nova-compute[74776]: node.session.auth.password = ***
Nov 22 14:28:27 user nova-compute[74776]: node.session.auth.username_in = <empty>
Nov 22 14:28:27 user nova-compute[74776]: node.session.auth.password_in = <empty>
Nov 22 14:28:27 user nova-compute[74776]: node.session.auth.chap_algs = MD5
Nov 22 14:28:27 user nova-compute[74776]: node.session.timeo.replacement_timeout = 120
Nov 22 14:28:27 user nova-compute[74776]: node.session.err_timeo.abort_timeout = 15
Nov 22 14:28:27 user nova-compute[74776]: node.session.err_timeo.lu_reset_timeout = 30
Nov 22 14:28:27 user nova-compute[74776]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 22 14:28:27 user nova-compute[74776]: node.session.err_timeo.host_reset_timeout = 60
Nov 22 14:28:27 user nova-compute[74776]: node.session.iscsi.FastAbort = Yes
Nov 22 14:28:27 user nova-compute[74776]: node.session.iscsi.InitialR2T = No
Nov 22 14:28:27 user nova-compute[74776]: node.session.iscsi.ImmediateData = Yes
Nov 22 14:28:27 user nova-compute[74776]: node.session.iscsi.FirstBurstLength = 262144
Nov 22 14:28:27 user nova-compute[74776]: node.session.iscsi.MaxBurstLength = 16776192
Nov 22 14:28:27 user nova-compute[74776]: node.session.iscsi.DefaultTime2Retain = 0
Nov 22 14:28:27 user nova-compute[74776]: node.session.iscsi.DefaultTime2Wait = 2
Nov 22 14:28:27 user nova-compute[74776]: node.session.iscsi.MaxConnections = 1
Nov 22 14:28:27 user nova-compute[74776]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 22 14:28:27 user nova-compute[74776]: node.session.iscsi.ERL = 0
Nov 22 14:28:27 user nova-compute[74776]: node.session.scan = manual
Nov 22 14:28:27 user nova-compute[74776]: node.session.reopen_max = 0
Nov 22 14:28:27 user nova-compute[74776]: node.conn[0].address = 172.16.0.220
Nov 22 14:28:27 user nova-compute[74776]: node.conn[0].port = 3260
Nov 22 14:28:27 user nova-compute[74776]: node.conn[0].startup = manual
Nov 22 14:28:27 user nova-compute[74776]: node.conn[0].tcp.window_size = 524288
Nov 22 14:28:27 user nova-compute[74776]: node.conn[0].tcp.type_of_service = 0
Nov 22 14:28:27 user nova-compute[74776]: node.conn[0].timeo.logout_timeout = 15
Nov 22 14:28:27 user nova-compute[74776]: node.conn[0].timeo.login_timeout = 15
Nov 22 14:28:27 user nova-compute[74776]: node.conn[0].timeo.auth_timeout = 45
Nov 22 14:28:27 user nova-compute[74776]: node.conn[0].timeo.noop_out_interval = 5
Nov 22 14:28:27 user nova-compute[74776]: node.conn[0].timeo.noop_out_timeout = 5
Nov 22 14:28:27 user nova-compute[74776]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 22 14:28:27 user nova-compute[74776]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 22 14:28:27 user nova-compute[74776]: node.conn[0].iscsi.HeaderDigest = None
Nov 22 14:28:27 user nova-compute[74776]: node.conn[0].iscsi.DataDigest = None
Nov 22 14:28:27 user nova-compute[74776]: node.conn[0].iscsi.IFMarker = No
Nov 22 14:28:27 user nova-compute[74776]: node.conn[0].iscsi.OFMarker = No
Nov 22 14:28:27 user nova-compute[74776]: # END RECORD
Nov 22 14:28:27 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e15d99-e33b-4faa-b907-ed17de0cae6e]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56cc66d516c1aaa3b9d52915ea9a61514add9c7b.part --force-share --output=json" returned: 0 in 0.204s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.images [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] 410e18af-5ee2-4e1a-b884-991a4118fa51 was qcow2, converting to raw {{(pid=74776) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.privsep.utils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74776) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/56cc66d516c1aaa3b9d52915ea9a61514add9c7b.part /opt/stack/data/nova/instances/_base/56cc66d516c1aaa3b9d52915ea9a61514add9c7b.converted {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dd709f-5297-44a4-b5bf-21330f17ac88]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v goChikQA {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v goChikQA" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdbfcef-bdf5-4c5d-8a36-9faee704df05]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'goChikQA'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b49c3c-9020-4496-a40b-218baa13f5d8]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1d7343-7897-4ad9-a051-337879ce8148]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:28:27 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:28:27 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:28:27 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:28:27 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.174s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] HCTL ('33', '0', '0', 0) found on session 31 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/56cc66d516c1aaa3b9d52915ea9a61514add9c7b.part /opt/stack/data/nova/instances/_base/56cc66d516c1aaa3b9d52915ea9a61514add9c7b.converted" returned: 0 in 0.131s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56cc66d516c1aaa3b9d52915ea9a61514add9c7b.converted --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[945b629d-0cd7-4d51-9fdd-92b87a75a643]: (4, ('0 0 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Searching for a device in session 31 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'goChikQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.246s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] <== connect_volume: return (247ms) {'type': 'block', 'scsi_wwn': '26161303863633665', 'path': '/dev/sdb'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161303863633665', 'path': '/dev/sdb'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:26:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-727985580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-727985580',id=25,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:26:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d359aba8e95e4090a02fb0a46012f20b',ramdisk_id='',reservation_id='r-vo0i4er5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-202976361',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:26:51Z,user_data=None,user_id='dea876275c70471d9cba1c3158bd63e2',uuid=bc98341b-ca28-4097-9887-16c8e8d7f9f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "address": "fa:16:3e:5f:fc:12", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "vif_mac": "fa:16:3e:5f:fc:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cec0cf0-89", "ovs_interfaceid": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:28:27 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converting VIF {"id": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "address": "fa:16:3e:5f:fc:12", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "vif_mac": "fa:16:3e:5f:fc:12"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cec0cf0-89", "ovs_interfaceid": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:fc:12,bridge_name='br-int',has_traffic_filtering=True,id=5cec0cf0-892c-4c30-ae08-7e127098bccf,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cec0cf0-89') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG nova.objects.instance [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'pci_devices' on Instance uuid bc98341b-ca28-4097-9887-16c8e8d7f9f7 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG nova.objects.base [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Object Instance<bc98341b-ca28-4097-9887-16c8e8d7f9f7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:28:28 user nova-compute[74776]:   <uuid>bc98341b-ca28-4097-9887-16c8e8d7f9f7</uuid>
Nov 22 14:28:28 user nova-compute[74776]:   <name>instance-00000019</name>
Nov 22 14:28:28 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:28:28 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:28:28 user nova-compute[74776]:   <metadata>
Nov 22 14:28:28 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:28:28 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:28:28 user nova-compute[74776]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-727985580</nova:name>
Nov 22 14:28:28 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:28:27</nova:creationTime>
Nov 22 14:28:28 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:28:28 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:28:28 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:28:28 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:28:28 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:28:28 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:28:28 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:28:28 user nova-compute[74776]:       <nova:owner>
Nov 22 14:28:28 user nova-compute[74776]:         <nova:user uuid="dea876275c70471d9cba1c3158bd63e2">tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member</nova:user>
Nov 22 14:28:28 user nova-compute[74776]:         <nova:project uuid="d359aba8e95e4090a02fb0a46012f20b">tempest-ServerBootFromVolumeStableRescueTest-202976361</nova:project>
Nov 22 14:28:28 user nova-compute[74776]:       </nova:owner>
Nov 22 14:28:28 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:28:28 user nova-compute[74776]:       <nova:ports>
Nov 22 14:28:28 user nova-compute[74776]:         <nova:port uuid="5cec0cf0-892c-4c30-ae08-7e127098bccf">
Nov 22 14:28:28 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 14:28:28 user nova-compute[74776]:         </nova:port>
Nov 22 14:28:28 user nova-compute[74776]:       </nova:ports>
Nov 22 14:28:28 user nova-compute[74776]:     </nova:instance>
Nov 22 14:28:28 user nova-compute[74776]:   </metadata>
Nov 22 14:28:28 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:28:28 user nova-compute[74776]:     <system>
Nov 22 14:28:28 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:28:28 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:28:28 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:28:28 user nova-compute[74776]:       <entry name="serial">bc98341b-ca28-4097-9887-16c8e8d7f9f7</entry>
Nov 22 14:28:28 user nova-compute[74776]:       <entry name="uuid">bc98341b-ca28-4097-9887-16c8e8d7f9f7</entry>
Nov 22 14:28:28 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:28:28 user nova-compute[74776]:     </system>
Nov 22 14:28:28 user nova-compute[74776]:   </sysinfo>
Nov 22 14:28:28 user nova-compute[74776]:   <os>
Nov 22 14:28:28 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:28:28 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:28:28 user nova-compute[74776]:   </os>
Nov 22 14:28:28 user nova-compute[74776]:   <features>
Nov 22 14:28:28 user nova-compute[74776]:     <acpi/>
Nov 22 14:28:28 user nova-compute[74776]:     <apic/>
Nov 22 14:28:28 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:28:28 user nova-compute[74776]:   </features>
Nov 22 14:28:28 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:28:28 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:28:28 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:28:28 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:28:28 user nova-compute[74776]:   </clock>
Nov 22 14:28:28 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:28:28 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:28:28 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:28:28 user nova-compute[74776]:   </cpu>
Nov 22 14:28:28 user nova-compute[74776]:   <devices>
Nov 22 14:28:28 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:28:28 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:28:28 user nova-compute[74776]:       <source dev="/dev/sdb"/>
Nov 22 14:28:28 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:28:28 user nova-compute[74776]:       <serial>22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a</serial>
Nov 22 14:28:28 user nova-compute[74776]:     </disk>
Nov 22 14:28:28 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:28:28 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:28:28 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/bc98341b-ca28-4097-9887-16c8e8d7f9f7/disk.rescue"/>
Nov 22 14:28:28 user nova-compute[74776]:       <target dev="vdb" bus="virtio"/>
Nov 22 14:28:28 user nova-compute[74776]:       <boot order="1"/>
Nov 22 14:28:28 user nova-compute[74776]:     </disk>
Nov 22 14:28:28 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:28:28 user nova-compute[74776]:       <mac address="fa:16:3e:5f:fc:12"/>
Nov 22 14:28:28 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:28:28 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:28:28 user nova-compute[74776]:       <target dev="tap5cec0cf0-89"/>
Nov 22 14:28:28 user nova-compute[74776]:     </interface>
Nov 22 14:28:28 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:28:28 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/bc98341b-ca28-4097-9887-16c8e8d7f9f7/console.log" append="off"/>
Nov 22 14:28:28 user nova-compute[74776]:     </serial>
Nov 22 14:28:28 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:28:28 user nova-compute[74776]:     <video>
Nov 22 14:28:28 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:28:28 user nova-compute[74776]:     </video>
Nov 22 14:28:28 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:28:28 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:28:28 user nova-compute[74776]:     </rng>
Nov 22 14:28:28 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:28:28 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:28:28 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:28:28 user nova-compute[74776]:     </memballoon>
Nov 22 14:28:28 user nova-compute[74776]:   </devices>
Nov 22 14:28:28 user nova-compute[74776]: </domain>
Nov 22 14:28:28 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:28:28 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Instance destroyed successfully.
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56cc66d516c1aaa3b9d52915ea9a61514add9c7b.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "56cc66d516c1aaa3b9d52915ea9a61514add9c7b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.005s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56cc66d516c1aaa3b9d52915ea9a61514add9c7b --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] No VIF found with MAC fa:16:3e:5f:fc:12, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56cc66d516c1aaa3b9d52915ea9a61514add9c7b --force-share --output=json" returned: 0 in 0.180s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "56cc66d516c1aaa3b9d52915ea9a61514add9c7b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "56cc66d516c1aaa3b9d52915ea9a61514add9c7b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56cc66d516c1aaa3b9d52915ea9a61514add9c7b --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG nova.network.neutron [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Successfully updated port: 3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG nova.compute.manager [req-3379de35-7c32-4327-8378-6c69de7a7f33 req-9e59f57c-0b41-4b77-b8d2-1f0d1a4e7316 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received event network-changed-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG nova.compute.manager [req-3379de35-7c32-4327-8378-6c69de7a7f33 req-9e59f57c-0b41-4b77-b8d2-1f0d1a4e7316 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Refreshing instance network info cache due to event network-changed-3c7c3d69-1226-4906-b2cb-bedf570f40ee. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3379de35-7c32-4327-8378-6c69de7a7f33 req-9e59f57c-0b41-4b77-b8d2-1f0d1a4e7316 service nova] Acquiring lock "refresh_cache-68b6744f-c29d-4ccd-83ab-fcc31666d69b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3379de35-7c32-4327-8378-6c69de7a7f33 req-9e59f57c-0b41-4b77-b8d2-1f0d1a4e7316 service nova] Acquired lock "refresh_cache-68b6744f-c29d-4ccd-83ab-fcc31666d69b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG nova.network.neutron [req-3379de35-7c32-4327-8378-6c69de7a7f33 req-9e59f57c-0b41-4b77-b8d2-1f0d1a4e7316 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Refreshing network info cache for port 3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "refresh_cache-68b6744f-c29d-4ccd-83ab-fcc31666d69b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG nova.network.neutron [req-3379de35-7c32-4327-8378-6c69de7a7f33 req-9e59f57c-0b41-4b77-b8d2-1f0d1a4e7316 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56cc66d516c1aaa3b9d52915ea9a61514add9c7b --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/56cc66d516c1aaa3b9d52915ea9a61514add9c7b,backing_fmt=raw /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/56cc66d516c1aaa3b9d52915ea9a61514add9c7b,backing_fmt=raw /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk 1073741824" returned: 0 in 0.131s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "56cc66d516c1aaa3b9d52915ea9a61514add9c7b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56cc66d516c1aaa3b9d52915ea9a61514add9c7b --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG nova.network.neutron [req-3379de35-7c32-4327-8378-6c69de7a7f33 req-9e59f57c-0b41-4b77-b8d2-1f0d1a4e7316 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3379de35-7c32-4327-8378-6c69de7a7f33 req-9e59f57c-0b41-4b77-b8d2-1f0d1a4e7316 service nova] Releasing lock "refresh_cache-68b6744f-c29d-4ccd-83ab-fcc31666d69b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquired lock "refresh_cache-68b6744f-c29d-4ccd-83ab-fcc31666d69b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG nova.network.neutron [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG nova.network.neutron [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56cc66d516c1aaa3b9d52915ea9a61514add9c7b --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Cannot resize image /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Ensure instance console log exists: /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG nova.network.neutron [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Updating instance_info_cache with network_info: [{"id": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "address": "fa:16:3e:e9:fc:41", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7c3d69-12", "ovs_interfaceid": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Releasing lock "refresh_cache-68b6744f-c29d-4ccd-83ab-fcc31666d69b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:28:28 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Instance network_info: |[{"id": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "address": "fa:16:3e:e9:fc:41", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7c3d69-12", "ovs_interfaceid": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Start _get_guest_xml network_info=[{"id": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "address": "fa:16:3e:e9:fc:41", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7c3d69-12", "ovs_interfaceid": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:28:22Z,direct_url=<?>,disk_format='qcow2',id=410e18af-5ee2-4e1a-b884-991a4118fa51,min_disk=0,min_ram=0,name='tempest-scenario-img--680531403',owner='2602b8e7e2414a3d88d18f9f0c973ab5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:28:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '410e18af-5ee2-4e1a-b884-991a4118fa51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:28:29 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:28:29 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:28:22Z,direct_url=<?>,disk_format='qcow2',id=410e18af-5ee2-4e1a-b884-991a4118fa51,min_disk=0,min_ram=0,name='tempest-scenario-img--680531403',owner='2602b8e7e2414a3d88d18f9f0c973ab5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:28:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:28:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-567453205',display_name='tempest-TestMinimumBasicScenario-server-567453205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-567453205',id=29,image_ref='410e18af-5ee2-4e1a-b884-991a4118fa51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeQ5l9gobrcB3GfFb8hElj7leJSJuwdi8KEucPTmUQGpAyFzhk+F3QsYUbzmVfcbUg0T9z6vSzM3sLT40eKIk3iKPtU/szyGW0f6KEHPn7TV4/Y4vJcTWqN8K0b2V6kYA==',key_name='tempest-TestMinimumBasicScenario-536055884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2602b8e7e2414a3d88d18f9f0c973ab5',ramdisk_id='',reservation_id='r-lecfrx5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='410e18af-5ee2-4e1a-b884-991a4118fa51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1122910147',owner_user_name='tempest-TestMinimumBasicScenario-1122910147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:28:27Z,user_data=None,user_id='aac47c7fc2fc4380a5673117151dbdb0',uuid=68b6744f-c29d-4ccd-83ab-fcc31666d69b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "address": "fa:16:3e:e9:fc:41", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7c3d69-12", "ovs_interfaceid": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Converting VIF {"id": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "address": "fa:16:3e:e9:fc:41", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7c3d69-12", "ovs_interfaceid": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:fc:41,bridge_name='br-int',has_traffic_filtering=True,id=3c7c3d69-1226-4906-b2cb-bedf570f40ee,network=Network(9ede03a9-ae5e-43f2-9865-595667d6d899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7c3d69-12') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.objects.instance [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lazy-loading 'pci_devices' on Instance uuid 68b6744f-c29d-4ccd-83ab-fcc31666d69b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:28:29 user nova-compute[74776]:   <uuid>68b6744f-c29d-4ccd-83ab-fcc31666d69b</uuid>
Nov 22 14:28:29 user nova-compute[74776]:   <name>instance-0000001d</name>
Nov 22 14:28:29 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:28:29 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:28:29 user nova-compute[74776]:   <metadata>
Nov 22 14:28:29 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:28:29 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:28:29 user nova-compute[74776]:       <nova:name>tempest-TestMinimumBasicScenario-server-567453205</nova:name>
Nov 22 14:28:29 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:28:29</nova:creationTime>
Nov 22 14:28:29 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:28:29 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:28:29 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:28:29 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:28:29 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:28:29 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:28:29 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:28:29 user nova-compute[74776]:       <nova:owner>
Nov 22 14:28:29 user nova-compute[74776]:         <nova:user uuid="aac47c7fc2fc4380a5673117151dbdb0">tempest-TestMinimumBasicScenario-1122910147-project-member</nova:user>
Nov 22 14:28:29 user nova-compute[74776]:         <nova:project uuid="2602b8e7e2414a3d88d18f9f0c973ab5">tempest-TestMinimumBasicScenario-1122910147</nova:project>
Nov 22 14:28:29 user nova-compute[74776]:       </nova:owner>
Nov 22 14:28:29 user nova-compute[74776]:       <nova:root type="image" uuid="410e18af-5ee2-4e1a-b884-991a4118fa51"/>
Nov 22 14:28:29 user nova-compute[74776]:       <nova:ports>
Nov 22 14:28:29 user nova-compute[74776]:         <nova:port uuid="3c7c3d69-1226-4906-b2cb-bedf570f40ee">
Nov 22 14:28:29 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 14:28:29 user nova-compute[74776]:         </nova:port>
Nov 22 14:28:29 user nova-compute[74776]:       </nova:ports>
Nov 22 14:28:29 user nova-compute[74776]:     </nova:instance>
Nov 22 14:28:29 user nova-compute[74776]:   </metadata>
Nov 22 14:28:29 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:28:29 user nova-compute[74776]:     <system>
Nov 22 14:28:29 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:28:29 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:28:29 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:28:29 user nova-compute[74776]:       <entry name="serial">68b6744f-c29d-4ccd-83ab-fcc31666d69b</entry>
Nov 22 14:28:29 user nova-compute[74776]:       <entry name="uuid">68b6744f-c29d-4ccd-83ab-fcc31666d69b</entry>
Nov 22 14:28:29 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:28:29 user nova-compute[74776]:     </system>
Nov 22 14:28:29 user nova-compute[74776]:   </sysinfo>
Nov 22 14:28:29 user nova-compute[74776]:   <os>
Nov 22 14:28:29 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:28:29 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:28:29 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:28:29 user nova-compute[74776]:   </os>
Nov 22 14:28:29 user nova-compute[74776]:   <features>
Nov 22 14:28:29 user nova-compute[74776]:     <acpi/>
Nov 22 14:28:29 user nova-compute[74776]:     <apic/>
Nov 22 14:28:29 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:28:29 user nova-compute[74776]:   </features>
Nov 22 14:28:29 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:28:29 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:28:29 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:28:29 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:28:29 user nova-compute[74776]:   </clock>
Nov 22 14:28:29 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:28:29 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:28:29 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:28:29 user nova-compute[74776]:   </cpu>
Nov 22 14:28:29 user nova-compute[74776]:   <devices>
Nov 22 14:28:29 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:28:29 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:28:29 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk"/>
Nov 22 14:28:29 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:28:29 user nova-compute[74776]:     </disk>
Nov 22 14:28:29 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:28:29 user nova-compute[74776]:       <mac address="fa:16:3e:e9:fc:41"/>
Nov 22 14:28:29 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:28:29 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:28:29 user nova-compute[74776]:       <target dev="tap3c7c3d69-12"/>
Nov 22 14:28:29 user nova-compute[74776]:     </interface>
Nov 22 14:28:29 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:28:29 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/console.log" append="off"/>
Nov 22 14:28:29 user nova-compute[74776]:     </serial>
Nov 22 14:28:29 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:28:29 user nova-compute[74776]:     <video>
Nov 22 14:28:29 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:28:29 user nova-compute[74776]:     </video>
Nov 22 14:28:29 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:28:29 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:28:29 user nova-compute[74776]:     </rng>
Nov 22 14:28:29 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:28:29 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:28:29 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:28:29 user nova-compute[74776]:     </memballoon>
Nov 22 14:28:29 user nova-compute[74776]:   </devices>
Nov 22 14:28:29 user nova-compute[74776]: </domain>
Nov 22 14:28:29 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:28:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-567453205',display_name='tempest-TestMinimumBasicScenario-server-567453205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-567453205',id=29,image_ref='410e18af-5ee2-4e1a-b884-991a4118fa51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeQ5l9gobrcB3GfFb8hElj7leJSJuwdi8KEucPTmUQGpAyFzhk+F3QsYUbzmVfcbUg0T9z6vSzM3sLT40eKIk3iKPtU/szyGW0f6KEHPn7TV4/Y4vJcTWqN8K0b2V6kYA==',key_name='tempest-TestMinimumBasicScenario-536055884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2602b8e7e2414a3d88d18f9f0c973ab5',ramdisk_id='',reservation_id='r-lecfrx5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='410e18af-5ee2-4e1a-b884-991a4118fa51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1122910147',owner_user_name='tempest-TestMinimumBasicScenario-1122910147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:28:27Z,user_data=None,user_id='aac47c7fc2fc4380a5673117151dbdb0',uuid=68b6744f-c29d-4ccd-83ab-fcc31666d69b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "address": "fa:16:3e:e9:fc:41", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7c3d69-12", "ovs_interfaceid": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Converting VIF {"id": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "address": "fa:16:3e:e9:fc:41", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7c3d69-12", "ovs_interfaceid": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:fc:41,bridge_name='br-int',has_traffic_filtering=True,id=3c7c3d69-1226-4906-b2cb-bedf570f40ee,network=Network(9ede03a9-ae5e-43f2-9865-595667d6d899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7c3d69-12') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG os_vif [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:fc:41,bridge_name='br-int',has_traffic_filtering=True,id=3c7c3d69-1226-4906-b2cb-bedf570f40ee,network=Network(9ede03a9-ae5e-43f2-9865-595667d6d899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7c3d69-12') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f168adf8-20fb-5476-a539-a4d522ee8af5', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c7c3d69-12, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c7c3d69-12, col_values=(('qos', UUID('e9f4846b-f734-4d5f-bd78-59a09f927f17')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c7c3d69-12, col_values=(('external_ids', {'iface-id': '3c7c3d69-1226-4906-b2cb-bedf570f40ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:fc:41', 'vm-uuid': '68b6744f-c29d-4ccd-83ab-fcc31666d69b'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:29 user nova-compute[74776]: INFO os_vif [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:fc:41,bridge_name='br-int',has_traffic_filtering=True,id=3c7c3d69-1226-4906-b2cb-bedf570f40ee,network=Network(9ede03a9-ae5e-43f2-9865-595667d6d899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7c3d69-12')
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] No VIF found with MAC fa:16:3e:e9:fc:41, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.compute.manager [req-c13aeb84-1468-4131-bd7a-26e8b2c9b5a3 req-bbff0291-1997-446b-adaa-b54ef698f5c1 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received event network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c13aeb84-1468-4131-bd7a-26e8b2c9b5a3 req-bbff0291-1997-446b-adaa-b54ef698f5c1 service nova] Acquiring lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c13aeb84-1468-4131-bd7a-26e8b2c9b5a3 req-bbff0291-1997-446b-adaa-b54ef698f5c1 service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c13aeb84-1468-4131-bd7a-26e8b2c9b5a3 req-bbff0291-1997-446b-adaa-b54ef698f5c1 service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG nova.compute.manager [req-c13aeb84-1468-4131-bd7a-26e8b2c9b5a3 req-bbff0291-1997-446b-adaa-b54ef698f5c1 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] No waiting events found dispatching network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:28:29 user nova-compute[74776]: WARNING nova.compute.manager [req-c13aeb84-1468-4131-bd7a-26e8b2c9b5a3 req-bbff0291-1997-446b-adaa-b54ef698f5c1 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received unexpected event network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf for instance with vm_state active and task_state rescuing.
Nov 22 14:28:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-9aa08f7d-39e5-4f86-8253-c18185fb2d52 req-5c04d1e7-096a-4636-9717-3003cde8f3fa service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received event network-vif-plugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:28:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9aa08f7d-39e5-4f86-8253-c18185fb2d52 req-5c04d1e7-096a-4636-9717-3003cde8f3fa service nova] Acquiring lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9aa08f7d-39e5-4f86-8253-c18185fb2d52 req-5c04d1e7-096a-4636-9717-3003cde8f3fa service nova] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9aa08f7d-39e5-4f86-8253-c18185fb2d52 req-5c04d1e7-096a-4636-9717-3003cde8f3fa service nova] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-9aa08f7d-39e5-4f86-8253-c18185fb2d52 req-5c04d1e7-096a-4636-9717-3003cde8f3fa service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] No waiting events found dispatching network-vif-plugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:28:31 user nova-compute[74776]: WARNING nova.compute.manager [req-9aa08f7d-39e5-4f86-8253-c18185fb2d52 req-5c04d1e7-096a-4636-9717-3003cde8f3fa service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received unexpected event network-vif-plugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee for instance with vm_state building and task_state spawning.
Nov 22 14:28:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-7f070c7c-88a8-4003-9c6e-0e6c2bd1fb40 req-2dcd7235-f616-46ee-9ccb-8140f6f3ad90 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received event network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:28:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7f070c7c-88a8-4003-9c6e-0e6c2bd1fb40 req-2dcd7235-f616-46ee-9ccb-8140f6f3ad90 service nova] Acquiring lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7f070c7c-88a8-4003-9c6e-0e6c2bd1fb40 req-2dcd7235-f616-46ee-9ccb-8140f6f3ad90 service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7f070c7c-88a8-4003-9c6e-0e6c2bd1fb40 req-2dcd7235-f616-46ee-9ccb-8140f6f3ad90 service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-7f070c7c-88a8-4003-9c6e-0e6c2bd1fb40 req-2dcd7235-f616-46ee-9ccb-8140f6f3ad90 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] No waiting events found dispatching network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:28:31 user nova-compute[74776]: WARNING nova.compute.manager [req-7f070c7c-88a8-4003-9c6e-0e6c2bd1fb40 req-2dcd7235-f616-46ee-9ccb-8140f6f3ad90 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received unexpected event network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf for instance with vm_state active and task_state rescuing.
Nov 22 14:28:32 user nova-compute[74776]: DEBUG nova.compute.manager [None req-128f6aff-30f7-4319-85de-adcacc3cf592 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:28:33 user nova-compute[74776]: DEBUG nova.compute.manager [req-29f57850-d32c-4fbd-8498-8128c2b43a85 req-c513626c-da49-4ccf-9fc6-aad1af903523 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received event network-vif-plugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:28:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29f57850-d32c-4fbd-8498-8128c2b43a85 req-c513626c-da49-4ccf-9fc6-aad1af903523 service nova] Acquiring lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29f57850-d32c-4fbd-8498-8128c2b43a85 req-c513626c-da49-4ccf-9fc6-aad1af903523 service nova] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29f57850-d32c-4fbd-8498-8128c2b43a85 req-c513626c-da49-4ccf-9fc6-aad1af903523 service nova] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:33 user nova-compute[74776]: DEBUG nova.compute.manager [req-29f57850-d32c-4fbd-8498-8128c2b43a85 req-c513626c-da49-4ccf-9fc6-aad1af903523 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] No waiting events found dispatching network-vif-plugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:28:33 user nova-compute[74776]: WARNING nova.compute.manager [req-29f57850-d32c-4fbd-8498-8128c2b43a85 req-c513626c-da49-4ccf-9fc6-aad1af903523 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received unexpected event network-vif-plugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee for instance with vm_state building and task_state spawning.
Nov 22 14:28:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:28:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:28:33 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Instance spawned successfully.
Nov 22 14:28:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:28:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:28:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:28:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:28:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:28:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:28:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:28:33 user nova-compute[74776]: INFO nova.compute.manager [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Took 6.34 seconds to spawn the instance on the hypervisor.
Nov 22 14:28:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:28:33 user nova-compute[74776]: INFO nova.compute.manager [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Took 7.36 seconds to build instance.
Nov 22 14:28:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c3d3ef91-dede-4b12-9fd4-5768bd8799f2 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.457s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:28:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhuiUbgw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:28:36 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:28:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:28:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:28:36 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:28:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:28:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:28:36 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:28:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:36 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7992d2-91b6-46d8-9d93-679bfbae7ba1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:28:36 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:28:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cc1bd5-96fc-4132-9b0f-79eed7f8d12f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47] added
Nov 22 14:28:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9bc0a4-5784-4d8e-93c5-5f86a3b000a1]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7178c0-f65f-4967-9e7b-b02b2154f289]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xhuiUbgw {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG nova.objects.instance [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lazy-loading 'pci_requests' on Instance uuid 016bf051-9034-4124-948d-995aacf77caf {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xhuiUbgw" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3739471-e400-4a0c-9d71-fe79d44dadb1]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xhuiUbgw'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG nova.objects.instance [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lazy-loading 'numa_topology' on Instance uuid 016bf051-9034-4124-948d-995aacf77caf {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:28:37 user nova-compute[74776]: INFO nova.compute.claims [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Claim successful on node user
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bddc1c5-042a-404f-a21f-a27abdc5e1d1]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6c05e5-e189-44d8-ba5e-b500acbfd133]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:28:37 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:28:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:28:37 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:28:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[03320451-3b29-4231-8e7d-2c91998509b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47, portal: 172.16.0.220,3260]
Nov 22 14:28:37 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47, portal: 172.16.0.220,3260] successful.
Nov 22 14:28:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.107s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f401db-101c-4a9c-a335-f16317eafa09]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4893d94c-281e-49ff-82da-e8b2117d9ebb]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:28:37 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:28:37 user nova-compute[74776]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 (non-flash)
Nov 22 14:28:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:28:37 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:28:37 user nova-compute[74776]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 (non-flash)
Nov 22 14:28:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.433s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e593b89f-f185-4ee1-bddc-3b40f787298d]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhuiUbgw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:28:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.786s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:37 user nova-compute[74776]: INFO nova.network.neutron [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Updating port 19e9bf95-eee7-41e4-95ab-4f18f612d2c5 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.481s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] <== connect_volume: return (1484ms) {'type': 'block', 'scsi_wwn': '23031363164326639', 'path': '/dev/sdd'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031363164326639', 'path': '/dev/sdd'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lazy-loading 'flavor' on Instance uuid 96a7c6ec-0cb9-481b-8ec5-4337130bc000 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "refresh_cache-016bf051-9034-4124-948d-995aacf77caf" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquired lock "refresh_cache-016bf051-9034-4124-948d-995aacf77caf" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG nova.network.neutron [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:28:38 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:28:38 user nova-compute[74776]:   <source dev="/dev/sdd"/>
Nov 22 14:28:38 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:28:38 user nova-compute[74776]:   <serial>2fb64953-06fe-49f0-a3d7-157f54e81a47</serial>
Nov 22 14:28:38 user nova-compute[74776]: </disk>
Nov 22 14:28:38 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG nova.compute.manager [req-dee3a477-4255-459e-8c33-23b735288c61 req-99d1e7c8-fcc6-44f2-8877-1f765c487124 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Received event network-changed-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG nova.compute.manager [req-dee3a477-4255-459e-8c33-23b735288c61 req-99d1e7c8-fcc6-44f2-8877-1f765c487124 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Refreshing instance network info cache due to event network-changed-19e9bf95-eee7-41e4-95ab-4f18f612d2c5. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dee3a477-4255-459e-8c33-23b735288c61 req-99d1e7c8-fcc6-44f2-8877-1f765c487124 service nova] Acquiring lock "refresh_cache-016bf051-9034-4124-948d-995aacf77caf" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG nova.network.neutron [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Updating instance_info_cache with network_info: [{"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Releasing lock "refresh_cache-016bf051-9034-4124-948d-995aacf77caf" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:28:38 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Creating image(s)
Nov 22 14:28:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "/opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "/opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "/opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG nova.objects.instance [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lazy-loading 'trusted_certs' on Instance uuid 016bf051-9034-4124-948d-995aacf77caf {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dee3a477-4255-459e-8c33-23b735288c61 req-99d1e7c8-fcc6-44f2-8877-1f765c487124 service nova] Acquired lock "refresh_cache-016bf051-9034-4124-948d-995aacf77caf" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG nova.network.neutron [req-dee3a477-4255-459e-8c33-23b735288c61 req-99d1e7c8-fcc6-44f2-8877-1f765c487124 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Refreshing network info cache for port 19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] No VIF found with MAC fa:16:3e:9e:bf:17, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG nova.objects.base [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Object Instance<016bf051-9034-4124-948d-995aacf77caf> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "9a72d9f8c3846268a25872639f1260083ee26210" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "9a72d9f8c3846268a25872639f1260083ee26210" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a72d9f8c3846268a25872639f1260083ee26210.part --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d288dd35-09b2-473b-be4e-a7e893b10ce0 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.826s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a72d9f8c3846268a25872639f1260083ee26210.part --force-share --output=json" returned: 0 in 0.189s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:40 user nova-compute[74776]: DEBUG nova.virt.images [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] 970afec0-dc26-4c8b-8223-88a9e9f7b233 was qcow2, converting to raw {{(pid=74776) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 14:28:40 user nova-compute[74776]: DEBUG nova.privsep.utils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74776) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 14:28:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9a72d9f8c3846268a25872639f1260083ee26210.part /opt/stack/data/nova/instances/_base/9a72d9f8c3846268a25872639f1260083ee26210.converted {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:40 user nova-compute[74776]: DEBUG nova.network.neutron [req-dee3a477-4255-459e-8c33-23b735288c61 req-99d1e7c8-fcc6-44f2-8877-1f765c487124 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Updated VIF entry in instance network info cache for port 19e9bf95-eee7-41e4-95ab-4f18f612d2c5. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:28:40 user nova-compute[74776]: DEBUG nova.network.neutron [req-dee3a477-4255-459e-8c33-23b735288c61 req-99d1e7c8-fcc6-44f2-8877-1f765c487124 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Updating instance_info_cache with network_info: [{"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:28:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dee3a477-4255-459e-8c33-23b735288c61 req-99d1e7c8-fcc6-44f2-8877-1f765c487124 service nova] Releasing lock "refresh_cache-016bf051-9034-4124-948d-995aacf77caf" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:28:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9a72d9f8c3846268a25872639f1260083ee26210.part /opt/stack/data/nova/instances/_base/9a72d9f8c3846268a25872639f1260083ee26210.converted" returned: 0 in 0.246s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a72d9f8c3846268a25872639f1260083ee26210.converted --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a72d9f8c3846268a25872639f1260083ee26210.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "9a72d9f8c3846268a25872639f1260083ee26210" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.686s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a72d9f8c3846268a25872639f1260083ee26210 --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a72d9f8c3846268a25872639f1260083ee26210 --force-share --output=json" returned: 0 in 0.188s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "9a72d9f8c3846268a25872639f1260083ee26210" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "9a72d9f8c3846268a25872639f1260083ee26210" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a72d9f8c3846268a25872639f1260083ee26210 --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a72d9f8c3846268a25872639f1260083ee26210 --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a72d9f8c3846268a25872639f1260083ee26210,backing_fmt=raw /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a72d9f8c3846268a25872639f1260083ee26210,backing_fmt=raw /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk 1073741824" returned: 0 in 0.048s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "9a72d9f8c3846268a25872639f1260083ee26210" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a72d9f8c3846268a25872639f1260083ee26210 --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a72d9f8c3846268a25872639f1260083ee26210 --force-share --output=json" returned: 0 in 0.173s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:41 user nova-compute[74776]: DEBUG nova.objects.instance [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lazy-loading 'migration_context' on Instance uuid 016bf051-9034-4124-948d-995aacf77caf {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:28:41 user nova-compute[74776]: DEBUG nova.objects.base [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Object Instance<016bf051-9034-4124-948d-995aacf77caf> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:28:41 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Rebasing disk image.
Nov 22 14:28:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.174s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e -F raw /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e -F raw /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk" returned: 0 in 2.288s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Ensure instance console log exists: /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Start _get_guest_xml network_info=[{"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='6a7d3b3786bdc3b19e038bcd656c3c97',container_format='bare',created_at=2023-11-22T14:26:33Z,direct_url=<?>,disk_format='qcow2',id=970afec0-dc26-4c8b-8223-88a9e9f7b233,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-23240802-shelved',owner='b1d6da4f9f4149479a779475a69c9110',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-22T14:26:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f5d04f0e-0f62-4c12-96b4-49280187564b', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPlBSVwY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '016bf051-9034-4124-948d-995aacf77caf', 'attached_at': '', 'detached_at': '', 'volume_id': '277635d3-2b9a-4405-a753-9d13911445a9', 'serial': '277635d3-2b9a-4405-a753-9d13911445a9'}, 'boot_index': None, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:28:43 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:28:43 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6a7d3b3786bdc3b19e038bcd656c3c97',container_format='bare',created_at=2023-11-22T14:26:33Z,direct_url=<?>,disk_format='qcow2',id=970afec0-dc26-4c8b-8223-88a9e9f7b233,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-23240802-shelved',owner='b1d6da4f9f4149479a779475a69c9110',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-22T14:26:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.objects.instance [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lazy-loading 'vcpu_model' on Instance uuid 016bf051-9034-4124-948d-995aacf77caf {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.objects.base [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Object Instance<016bf051-9034-4124-948d-995aacf77caf> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPlBSVwY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:28:43 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:28:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:28:43 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:28:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:28:43 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7115025d-6baa-4cd4-b32c-980530a5e4be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:28:43 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cadf83-4909-47b1-af1f-0ce6fc20a7c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9] added
Nov 22 14:28:43 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10cd4ff-27ce-418f-bc0a-dcc42692296a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[645b1323-e7a3-4ee8-b8ae-76e600b36a10]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HPlBSVwY {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HPlBSVwY" returned: 0 in 0.030s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[357268fb-7be9-4851-86f9-3b71ca5b728d]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HPlBSVwY'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e572ba08-9b67-4f15-ba0e-5ecc1aaa7b92]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1477205f-ef25-4b52-a515-3652eea8bbf7]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:28:43 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:28:43 user nova-compute[74776]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 (non-flash)
Nov 22 14:28:43 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:28:43 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:28:43 user nova-compute[74776]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 (non-flash)
Nov 22 14:28:43 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:28:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:44 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b5d56a-0227-4d0d-ba3c-c1560da3d363]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:44 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9, portal: 172.16.0.220,3260]
Nov 22 14:28:44 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9, portal: 172.16.0.220,3260] successful.
Nov 22 14:28:44 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:28:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:44 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[597e45e1-1f24-4da7-8ecb-c5f160c7b93c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:44 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:28:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:44 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[19990abb-221e-4899-ab33-0ef671c3fe3a]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:44 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:28:44 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:28:44 user nova-compute[74776]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 (non-flash)
Nov 22 14:28:44 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:28:44 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:28:44 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:28:44 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:28:44 user nova-compute[74776]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 (non-flash)
Nov 22 14:28:44 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:28:44 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:28:44 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:28:44 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:28:44 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:28:44 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:28:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:44 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4f53ea-317f-4575-8f42-c2d220670825]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:28:44 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:28:44 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPlBSVwY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26465636635646131', 'path': '/dev/sde'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465636635646131', 'path': '/dev/sde'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T14:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-23240802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-23240802',id=22,image_ref='970afec0-dc26-4c8b-8223-88a9e9f7b233',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1418035038',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:24:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b1d6da4f9f4149479a779475a69c9110',ramdisk_id='',reservation_id='r-7q3t55ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1293931160',owner_user_name='tempest-AttachVolumeShelveTestJSON-1293931160-project-member',shelved_at='2023-11-22T14:26:38.263111',shelved_host='user',shelved_image_id='970afec0-dc26-4c8b-8223-88a9e9f7b233'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:28:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c63eae228f99474899ce0620a4affe75',uuid=016bf051-9034-4124-948d-995aacf77caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converting VIF {"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1f:4f,bridge_name='br-int',has_traffic_filtering=True,id=19e9bf95-eee7-41e4-95ab-4f18f612d2c5,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e9bf95-ee') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG nova.objects.instance [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lazy-loading 'pci_devices' on Instance uuid 016bf051-9034-4124-948d-995aacf77caf {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG nova.objects.base [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Object Instance<016bf051-9034-4124-948d-995aacf77caf> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:28:45 user nova-compute[74776]:   <uuid>016bf051-9034-4124-948d-995aacf77caf</uuid>
Nov 22 14:28:45 user nova-compute[74776]:   <name>instance-00000016</name>
Nov 22 14:28:45 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:28:45 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:28:45 user nova-compute[74776]:   <metadata>
Nov 22 14:28:45 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:28:45 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:28:45 user nova-compute[74776]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-23240802</nova:name>
Nov 22 14:28:45 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:28:43</nova:creationTime>
Nov 22 14:28:45 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:28:45 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:28:45 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:28:45 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:28:45 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:28:45 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:28:45 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:28:45 user nova-compute[74776]:       <nova:owner>
Nov 22 14:28:45 user nova-compute[74776]:         <nova:user uuid="c63eae228f99474899ce0620a4affe75">tempest-AttachVolumeShelveTestJSON-1293931160-project-member</nova:user>
Nov 22 14:28:45 user nova-compute[74776]:         <nova:project uuid="b1d6da4f9f4149479a779475a69c9110">tempest-AttachVolumeShelveTestJSON-1293931160</nova:project>
Nov 22 14:28:45 user nova-compute[74776]:       </nova:owner>
Nov 22 14:28:45 user nova-compute[74776]:       <nova:root type="image" uuid="970afec0-dc26-4c8b-8223-88a9e9f7b233"/>
Nov 22 14:28:45 user nova-compute[74776]:       <nova:ports>
Nov 22 14:28:45 user nova-compute[74776]:         <nova:port uuid="19e9bf95-eee7-41e4-95ab-4f18f612d2c5">
Nov 22 14:28:45 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 14:28:45 user nova-compute[74776]:         </nova:port>
Nov 22 14:28:45 user nova-compute[74776]:       </nova:ports>
Nov 22 14:28:45 user nova-compute[74776]:     </nova:instance>
Nov 22 14:28:45 user nova-compute[74776]:   </metadata>
Nov 22 14:28:45 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:28:45 user nova-compute[74776]:     <system>
Nov 22 14:28:45 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:28:45 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:28:45 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:28:45 user nova-compute[74776]:       <entry name="serial">016bf051-9034-4124-948d-995aacf77caf</entry>
Nov 22 14:28:45 user nova-compute[74776]:       <entry name="uuid">016bf051-9034-4124-948d-995aacf77caf</entry>
Nov 22 14:28:45 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:28:45 user nova-compute[74776]:     </system>
Nov 22 14:28:45 user nova-compute[74776]:   </sysinfo>
Nov 22 14:28:45 user nova-compute[74776]:   <os>
Nov 22 14:28:45 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:28:45 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:28:45 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:28:45 user nova-compute[74776]:   </os>
Nov 22 14:28:45 user nova-compute[74776]:   <features>
Nov 22 14:28:45 user nova-compute[74776]:     <acpi/>
Nov 22 14:28:45 user nova-compute[74776]:     <apic/>
Nov 22 14:28:45 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:28:45 user nova-compute[74776]:   </features>
Nov 22 14:28:45 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:28:45 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:28:45 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:28:45 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:28:45 user nova-compute[74776]:   </clock>
Nov 22 14:28:45 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:28:45 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:28:45 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:28:45 user nova-compute[74776]:   </cpu>
Nov 22 14:28:45 user nova-compute[74776]:   <devices>
Nov 22 14:28:45 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:28:45 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:28:45 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk"/>
Nov 22 14:28:45 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:28:45 user nova-compute[74776]:     </disk>
Nov 22 14:28:45 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:28:45 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:28:45 user nova-compute[74776]:       <source dev="/dev/sde"/>
Nov 22 14:28:45 user nova-compute[74776]:       <target dev="vdc" bus="virtio"/>
Nov 22 14:28:45 user nova-compute[74776]:       <serial>277635d3-2b9a-4405-a753-9d13911445a9</serial>
Nov 22 14:28:45 user nova-compute[74776]:     </disk>
Nov 22 14:28:45 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:28:45 user nova-compute[74776]:       <mac address="fa:16:3e:c7:1f:4f"/>
Nov 22 14:28:45 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:28:45 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:28:45 user nova-compute[74776]:       <target dev="tap19e9bf95-ee"/>
Nov 22 14:28:45 user nova-compute[74776]:     </interface>
Nov 22 14:28:45 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:28:45 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/console.log" append="off"/>
Nov 22 14:28:45 user nova-compute[74776]:     </serial>
Nov 22 14:28:45 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:28:45 user nova-compute[74776]:     <video>
Nov 22 14:28:45 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:28:45 user nova-compute[74776]:     </video>
Nov 22 14:28:45 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:28:45 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:28:45 user nova-compute[74776]:     </rng>
Nov 22 14:28:45 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:28:45 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:28:45 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:28:45 user nova-compute[74776]:     </memballoon>
Nov 22 14:28:45 user nova-compute[74776]:   </devices>
Nov 22 14:28:45 user nova-compute[74776]: </domain>
Nov 22 14:28:45 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T14:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-23240802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-23240802',id=22,image_ref='970afec0-dc26-4c8b-8223-88a9e9f7b233',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1418035038',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:24:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b1d6da4f9f4149479a779475a69c9110',ramdisk_id='',reservation_id='r-7q3t55ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1293931160',owner_user_name='tempest-AttachVolumeShelveTestJSON-1293931160-project-member',shelved_at='2023-11-22T14:26:38.263111',shelved_host='user',shelved_image_id='970afec0-dc26-4c8b-8223-88a9e9f7b233'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:28:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c63eae228f99474899ce0620a4affe75',uuid=016bf051-9034-4124-948d-995aacf77caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converting VIF {"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1f:4f,bridge_name='br-int',has_traffic_filtering=True,id=19e9bf95-eee7-41e4-95ab-4f18f612d2c5,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e9bf95-ee') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG os_vif [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1f:4f,bridge_name='br-int',has_traffic_filtering=True,id=19e9bf95-eee7-41e4-95ab-4f18f612d2c5,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e9bf95-ee') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0f73024-cd57-50db-aed9-496e91b29b64', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19e9bf95-ee, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19e9bf95-ee, col_values=(('qos', UUID('7b406953-e4c7-4101-96d8-2c1e32f7c871')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19e9bf95-ee, col_values=(('external_ids', {'iface-id': '19e9bf95-eee7-41e4-95ab-4f18f612d2c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:1f:4f', 'vm-uuid': '016bf051-9034-4124-948d-995aacf77caf'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:45 user nova-compute[74776]: INFO os_vif [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1f:4f,bridge_name='br-int',has_traffic_filtering=True,id=19e9bf95-eee7-41e4-95ab-4f18f612d2c5,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e9bf95-ee')
Nov 22 14:28:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] No VIF found with MAC fa:16:3e:c7:1f:4f, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:28:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:46 user nova-compute[74776]: DEBUG nova.compute.manager [req-75e2a272-a26d-4cef-a8d1-1c7b4b90faf1 req-8371a34b-9f8a-446f-b29d-26e4e9613d82 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Received event network-vif-plugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:28:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-75e2a272-a26d-4cef-a8d1-1c7b4b90faf1 req-8371a34b-9f8a-446f-b29d-26e4e9613d82 service nova] Acquiring lock "016bf051-9034-4124-948d-995aacf77caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-75e2a272-a26d-4cef-a8d1-1c7b4b90faf1 req-8371a34b-9f8a-446f-b29d-26e4e9613d82 service nova] Lock "016bf051-9034-4124-948d-995aacf77caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-75e2a272-a26d-4cef-a8d1-1c7b4b90faf1 req-8371a34b-9f8a-446f-b29d-26e4e9613d82 service nova] Lock "016bf051-9034-4124-948d-995aacf77caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:46 user nova-compute[74776]: DEBUG nova.compute.manager [req-75e2a272-a26d-4cef-a8d1-1c7b4b90faf1 req-8371a34b-9f8a-446f-b29d-26e4e9613d82 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] No waiting events found dispatching network-vif-plugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:28:46 user nova-compute[74776]: WARNING nova.compute.manager [req-75e2a272-a26d-4cef-a8d1-1c7b4b90faf1 req-8371a34b-9f8a-446f-b29d-26e4e9613d82 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Received unexpected event network-vif-plugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 22 14:28:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:49 user nova-compute[74776]: DEBUG nova.compute.manager [req-86344892-b90c-4af2-906c-23341d9c7cc9 req-e91a230d-3a0d-404d-b907-6f552d8a25f2 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Received event network-vif-plugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:28:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-86344892-b90c-4af2-906c-23341d9c7cc9 req-e91a230d-3a0d-404d-b907-6f552d8a25f2 service nova] Acquiring lock "016bf051-9034-4124-948d-995aacf77caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-86344892-b90c-4af2-906c-23341d9c7cc9 req-e91a230d-3a0d-404d-b907-6f552d8a25f2 service nova] Lock "016bf051-9034-4124-948d-995aacf77caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-86344892-b90c-4af2-906c-23341d9c7cc9 req-e91a230d-3a0d-404d-b907-6f552d8a25f2 service nova] Lock "016bf051-9034-4124-948d-995aacf77caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:49 user nova-compute[74776]: DEBUG nova.compute.manager [req-86344892-b90c-4af2-906c-23341d9c7cc9 req-e91a230d-3a0d-404d-b907-6f552d8a25f2 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] No waiting events found dispatching network-vif-plugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:28:49 user nova-compute[74776]: WARNING nova.compute.manager [req-86344892-b90c-4af2-906c-23341d9c7cc9 req-e91a230d-3a0d-404d-b907-6f552d8a25f2 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Received unexpected event network-vif-plugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 22 14:28:49 user nova-compute[74776]: DEBUG nova.compute.manager [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:28:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:28:49 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 016bf051-9034-4124-948d-995aacf77caf] Instance spawned successfully.
Nov 22 14:28:49 user nova-compute[74776]: DEBUG nova.compute.manager [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:28:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bc9007e0-d492-4ebc-8c17-34d0e35f7a2f tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "016bf051-9034-4124-948d-995aacf77caf" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.444s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:53 user nova-compute[74776]: DEBUG nova.compute.manager [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:28:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:53 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:28:53 user nova-compute[74776]: INFO nova.compute.claims [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Claim successful on node user
Nov 22 14:28:54 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:28:54 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:28:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:54 user nova-compute[74776]: DEBUG nova.compute.manager [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:28:54 user nova-compute[74776]: DEBUG nova.compute.manager [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:28:54 user nova-compute[74776]: DEBUG nova.network.neutron [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:28:54 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:28:54 user nova-compute[74776]: DEBUG nova.compute.manager [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:28:54 user nova-compute[74776]: DEBUG nova.policy [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd686d08dc36a49fa80192546c4f68940', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f36a88fd7b403d9c2dd29bcd64aac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:28:54 user nova-compute[74776]: DEBUG nova.compute.manager [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:28:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:28:54 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Creating image(s)
Nov 22 14:28:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "/opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "/opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "/opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.221s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.214s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk 1073741824" returned: 0 in 0.052s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:55 user nova-compute[74776]: DEBUG nova.network.neutron [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Successfully created port: d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:28:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.209s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:55 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:28:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:28:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:28:55 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Cannot resize image /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:28:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:28:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Ensure instance console log exists: /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:28:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:55 user nova-compute[74776]: DEBUG nova.network.neutron [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Successfully updated port: d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:28:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "refresh_cache-d374cfe8-6d04-4c4e-9055-f46488a76ed8" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:28:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquired lock "refresh_cache-d374cfe8-6d04-4c4e-9055-f46488a76ed8" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:28:55 user nova-compute[74776]: DEBUG nova.network.neutron [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:28:55 user nova-compute[74776]: DEBUG nova.compute.manager [req-207aa5f2-c5f9-4488-bbd9-98ca570c8c7b req-a5c20646-7254-49a3-b6de-6a32ca69da1b service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received event network-changed-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:28:55 user nova-compute[74776]: DEBUG nova.compute.manager [req-207aa5f2-c5f9-4488-bbd9-98ca570c8c7b req-a5c20646-7254-49a3-b6de-6a32ca69da1b service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Refreshing instance network info cache due to event network-changed-d8edc986-df1e-4de5-9926-4cbb5b4ec280. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:28:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-207aa5f2-c5f9-4488-bbd9-98ca570c8c7b req-a5c20646-7254-49a3-b6de-6a32ca69da1b service nova] Acquiring lock "refresh_cache-d374cfe8-6d04-4c4e-9055-f46488a76ed8" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:28:55 user nova-compute[74776]: DEBUG nova.network.neutron [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.network.neutron [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Updating instance_info_cache with network_info: [{"id": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "address": "fa:16:3e:1b:64:9b", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8edc986-df", "ovs_interfaceid": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Releasing lock "refresh_cache-d374cfe8-6d04-4c4e-9055-f46488a76ed8" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.compute.manager [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Instance network_info: |[{"id": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "address": "fa:16:3e:1b:64:9b", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8edc986-df", "ovs_interfaceid": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-207aa5f2-c5f9-4488-bbd9-98ca570c8c7b req-a5c20646-7254-49a3-b6de-6a32ca69da1b service nova] Acquired lock "refresh_cache-d374cfe8-6d04-4c4e-9055-f46488a76ed8" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.network.neutron [req-207aa5f2-c5f9-4488-bbd9-98ca570c8c7b req-a5c20646-7254-49a3-b6de-6a32ca69da1b service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Refreshing network info cache for port d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Start _get_guest_xml network_info=[{"id": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "address": "fa:16:3e:1b:64:9b", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8edc986-df", "ovs_interfaceid": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:28:56 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:28:56 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:28:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1107406588',display_name='tempest-ServerRescueNegativeTestJSON-server-1107406588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1107406588',id=30,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1EyvTUUIuL6MgjFwn8DE49EjeyaQMzjJ84mYADLNQzIT3JkXlfY5dJuarBt9fszAfaeI4YT8kZ6F8q9hJdZViGfNftC06XGNEwinXrNa81UMAylnLx5vkvB9ePotD5ng==',key_name='tempest-keypair-1510487701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36f36a88fd7b403d9c2dd29bcd64aac6',ramdisk_id='',reservation_id='r-7iylxjz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1360515217',owner_user_name='tempest-ServerRescueNegativeTestJSON-1360515217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:28:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d686d08dc36a49fa80192546c4f68940',uuid=d374cfe8-6d04-4c4e-9055-f46488a76ed8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "address": "fa:16:3e:1b:64:9b", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8edc986-df", "ovs_interfaceid": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converting VIF {"id": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "address": "fa:16:3e:1b:64:9b", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8edc986-df", "ovs_interfaceid": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:64:9b,bridge_name='br-int',has_traffic_filtering=True,id=d8edc986-df1e-4de5-9926-4cbb5b4ec280,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8edc986-df') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.objects.instance [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'pci_devices' on Instance uuid d374cfe8-6d04-4c4e-9055-f46488a76ed8 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:28:56 user nova-compute[74776]:   <uuid>d374cfe8-6d04-4c4e-9055-f46488a76ed8</uuid>
Nov 22 14:28:56 user nova-compute[74776]:   <name>instance-0000001e</name>
Nov 22 14:28:56 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:28:56 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:28:56 user nova-compute[74776]:   <metadata>
Nov 22 14:28:56 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:28:56 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:28:56 user nova-compute[74776]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1107406588</nova:name>
Nov 22 14:28:56 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:28:56</nova:creationTime>
Nov 22 14:28:56 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:28:56 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:28:56 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:28:56 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:28:56 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:28:56 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:28:56 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:28:56 user nova-compute[74776]:       <nova:owner>
Nov 22 14:28:56 user nova-compute[74776]:         <nova:user uuid="d686d08dc36a49fa80192546c4f68940">tempest-ServerRescueNegativeTestJSON-1360515217-project-member</nova:user>
Nov 22 14:28:56 user nova-compute[74776]:         <nova:project uuid="36f36a88fd7b403d9c2dd29bcd64aac6">tempest-ServerRescueNegativeTestJSON-1360515217</nova:project>
Nov 22 14:28:56 user nova-compute[74776]:       </nova:owner>
Nov 22 14:28:56 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:28:56 user nova-compute[74776]:       <nova:ports>
Nov 22 14:28:56 user nova-compute[74776]:         <nova:port uuid="d8edc986-df1e-4de5-9926-4cbb5b4ec280">
Nov 22 14:28:56 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 22 14:28:56 user nova-compute[74776]:         </nova:port>
Nov 22 14:28:56 user nova-compute[74776]:       </nova:ports>
Nov 22 14:28:56 user nova-compute[74776]:     </nova:instance>
Nov 22 14:28:56 user nova-compute[74776]:   </metadata>
Nov 22 14:28:56 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:28:56 user nova-compute[74776]:     <system>
Nov 22 14:28:56 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:28:56 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:28:56 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:28:56 user nova-compute[74776]:       <entry name="serial">d374cfe8-6d04-4c4e-9055-f46488a76ed8</entry>
Nov 22 14:28:56 user nova-compute[74776]:       <entry name="uuid">d374cfe8-6d04-4c4e-9055-f46488a76ed8</entry>
Nov 22 14:28:56 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:28:56 user nova-compute[74776]:     </system>
Nov 22 14:28:56 user nova-compute[74776]:   </sysinfo>
Nov 22 14:28:56 user nova-compute[74776]:   <os>
Nov 22 14:28:56 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:28:56 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:28:56 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:28:56 user nova-compute[74776]:   </os>
Nov 22 14:28:56 user nova-compute[74776]:   <features>
Nov 22 14:28:56 user nova-compute[74776]:     <acpi/>
Nov 22 14:28:56 user nova-compute[74776]:     <apic/>
Nov 22 14:28:56 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:28:56 user nova-compute[74776]:   </features>
Nov 22 14:28:56 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:28:56 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:28:56 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:28:56 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:28:56 user nova-compute[74776]:   </clock>
Nov 22 14:28:56 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:28:56 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:28:56 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:28:56 user nova-compute[74776]:   </cpu>
Nov 22 14:28:56 user nova-compute[74776]:   <devices>
Nov 22 14:28:56 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:28:56 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:28:56 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk"/>
Nov 22 14:28:56 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:28:56 user nova-compute[74776]:     </disk>
Nov 22 14:28:56 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:28:56 user nova-compute[74776]:       <mac address="fa:16:3e:1b:64:9b"/>
Nov 22 14:28:56 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:28:56 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:28:56 user nova-compute[74776]:       <target dev="tapd8edc986-df"/>
Nov 22 14:28:56 user nova-compute[74776]:     </interface>
Nov 22 14:28:56 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:28:56 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/console.log" append="off"/>
Nov 22 14:28:56 user nova-compute[74776]:     </serial>
Nov 22 14:28:56 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:28:56 user nova-compute[74776]:     <video>
Nov 22 14:28:56 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:28:56 user nova-compute[74776]:     </video>
Nov 22 14:28:56 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:28:56 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:28:56 user nova-compute[74776]:     </rng>
Nov 22 14:28:56 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:28:56 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:28:56 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:28:56 user nova-compute[74776]:     </memballoon>
Nov 22 14:28:56 user nova-compute[74776]:   </devices>
Nov 22 14:28:56 user nova-compute[74776]: </domain>
Nov 22 14:28:56 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:28:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1107406588',display_name='tempest-ServerRescueNegativeTestJSON-server-1107406588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1107406588',id=30,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1EyvTUUIuL6MgjFwn8DE49EjeyaQMzjJ84mYADLNQzIT3JkXlfY5dJuarBt9fszAfaeI4YT8kZ6F8q9hJdZViGfNftC06XGNEwinXrNa81UMAylnLx5vkvB9ePotD5ng==',key_name='tempest-keypair-1510487701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36f36a88fd7b403d9c2dd29bcd64aac6',ramdisk_id='',reservation_id='r-7iylxjz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1360515217',owner_user_name='tempest-ServerRescueNegativeTestJSON-1360515217-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:28:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d686d08dc36a49fa80192546c4f68940',uuid=d374cfe8-6d04-4c4e-9055-f46488a76ed8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "address": "fa:16:3e:1b:64:9b", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8edc986-df", "ovs_interfaceid": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converting VIF {"id": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "address": "fa:16:3e:1b:64:9b", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8edc986-df", "ovs_interfaceid": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:64:9b,bridge_name='br-int',has_traffic_filtering=True,id=d8edc986-df1e-4de5-9926-4cbb5b4ec280,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8edc986-df') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG os_vif [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:64:9b,bridge_name='br-int',has_traffic_filtering=True,id=d8edc986-df1e-4de5-9926-4cbb5b4ec280,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8edc986-df') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc4a6324-8ee2-5a29-955c-714598d57d99', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8edc986-df, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8edc986-df, col_values=(('qos', UUID('b3127384-ca3a-4efa-9e20-4f3a9b9bf67a')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8edc986-df, col_values=(('external_ids', {'iface-id': 'd8edc986-df1e-4de5-9926-4cbb5b4ec280', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:64:9b', 'vm-uuid': 'd374cfe8-6d04-4c4e-9055-f46488a76ed8'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:56 user nova-compute[74776]: INFO os_vif [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:64:9b,bridge_name='br-int',has_traffic_filtering=True,id=d8edc986-df1e-4de5-9926-4cbb5b4ec280,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8edc986-df')
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] No VIF found with MAC fa:16:3e:1b:64:9b, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.network.neutron [req-207aa5f2-c5f9-4488-bbd9-98ca570c8c7b req-a5c20646-7254-49a3-b6de-6a32ca69da1b service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Updated VIF entry in instance network info cache for port d8edc986-df1e-4de5-9926-4cbb5b4ec280. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG nova.network.neutron [req-207aa5f2-c5f9-4488-bbd9-98ca570c8c7b req-a5c20646-7254-49a3-b6de-6a32ca69da1b service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Updating instance_info_cache with network_info: [{"id": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "address": "fa:16:3e:1b:64:9b", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8edc986-df", "ovs_interfaceid": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:28:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-207aa5f2-c5f9-4488-bbd9-98ca570c8c7b req-a5c20646-7254-49a3-b6de-6a32ca69da1b service nova] Releasing lock "refresh_cache-d374cfe8-6d04-4c4e-9055-f46488a76ed8" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:28:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:57 user nova-compute[74776]: DEBUG nova.compute.manager [req-a3fe108f-2f70-4a5d-b522-84683f6275f6 req-28bc0e0f-cd66-4b92-8599-1a68eb5eb45d service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received event network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:28:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-a3fe108f-2f70-4a5d-b522-84683f6275f6 req-28bc0e0f-cd66-4b92-8599-1a68eb5eb45d service nova] Acquiring lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-a3fe108f-2f70-4a5d-b522-84683f6275f6 req-28bc0e0f-cd66-4b92-8599-1a68eb5eb45d service nova] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-a3fe108f-2f70-4a5d-b522-84683f6275f6 req-28bc0e0f-cd66-4b92-8599-1a68eb5eb45d service nova] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:57 user nova-compute[74776]: DEBUG nova.compute.manager [req-a3fe108f-2f70-4a5d-b522-84683f6275f6 req-28bc0e0f-cd66-4b92-8599-1a68eb5eb45d service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] No waiting events found dispatching network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:28:57 user nova-compute[74776]: WARNING nova.compute.manager [req-a3fe108f-2f70-4a5d-b522-84683f6275f6 req-28bc0e0f-cd66-4b92-8599-1a68eb5eb45d service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received unexpected event network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 for instance with vm_state building and task_state spawning.
Nov 22 14:28:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:28:59 user nova-compute[74776]: DEBUG nova.compute.manager [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:28:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:28:59 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Instance spawned successfully.
Nov 22 14:28:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:28:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:28:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:28:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:28:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:28:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:28:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:28:59 user nova-compute[74776]: DEBUG nova.compute.manager [req-a00e0e14-f477-4ecd-b3b3-ade96acf96bb req-477f0040-31f4-4dc4-9767-39dc025424e8 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received event network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:28:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-a00e0e14-f477-4ecd-b3b3-ade96acf96bb req-477f0040-31f4-4dc4-9767-39dc025424e8 service nova] Acquiring lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:28:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-a00e0e14-f477-4ecd-b3b3-ade96acf96bb req-477f0040-31f4-4dc4-9767-39dc025424e8 service nova] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:28:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-a00e0e14-f477-4ecd-b3b3-ade96acf96bb req-477f0040-31f4-4dc4-9767-39dc025424e8 service nova] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:28:59 user nova-compute[74776]: DEBUG nova.compute.manager [req-a00e0e14-f477-4ecd-b3b3-ade96acf96bb req-477f0040-31f4-4dc4-9767-39dc025424e8 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] No waiting events found dispatching network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:28:59 user nova-compute[74776]: WARNING nova.compute.manager [req-a00e0e14-f477-4ecd-b3b3-ade96acf96bb req-477f0040-31f4-4dc4-9767-39dc025424e8 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received unexpected event network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 for instance with vm_state building and task_state spawning.
Nov 22 14:28:59 user nova-compute[74776]: INFO nova.compute.manager [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 22 14:28:59 user nova-compute[74776]: DEBUG nova.compute.manager [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:28:59 user nova-compute[74776]: INFO nova.compute.manager [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Took 6.26 seconds to build instance.
Nov 22 14:28:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-916250df-27c9-4da1-8b7c-0257558ca25a tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.360s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:00 user nova-compute[74776]: INFO nova.compute.manager [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Detaching volume 2fb64953-06fe-49f0-a3d7-157f54e81a47
Nov 22 14:29:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:00 user nova-compute[74776]: INFO nova.virt.block_device [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Attempting to driver detach volume 2fb64953-06fe-49f0-a3d7-157f54e81a47 from mountpoint /dev/vdb
Nov 22 14:29:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Attempting to detach device vdb from instance 96a7c6ec-0cb9-481b-8ec5-4337130bc000 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:29:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:29:00 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:29:00 user nova-compute[74776]:   <source dev="/dev/sdd"/>
Nov 22 14:29:00 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:29:00 user nova-compute[74776]:   <serial>2fb64953-06fe-49f0-a3d7-157f54e81a47</serial>
Nov 22 14:29:00 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:29:00 user nova-compute[74776]: </disk>
Nov 22 14:29:00 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:29:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:00 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Successfully detached device vdb from instance 96a7c6ec-0cb9-481b-8ec5-4337130bc000 from the persistent domain config.
Nov 22 14:29:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 96a7c6ec-0cb9-481b-8ec5-4337130bc000 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:29:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:29:00 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:29:00 user nova-compute[74776]:   <source dev="/dev/sdd"/>
Nov 22 14:29:00 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:29:00 user nova-compute[74776]:   <serial>2fb64953-06fe-49f0-a3d7-157f54e81a47</serial>
Nov 22 14:29:00 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:29:00 user nova-compute[74776]: </disk>
Nov 22 14:29:00 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:29:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 96a7c6ec-0cb9-481b-8ec5-4337130bc000 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:29:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:10 user nova-compute[74776]: DEBUG nova.compute.manager [req-8009d8a3-a705-4f22-8d9a-bd6ce85f7f97 req-8cc382c3-00e8-4901-8fd8-92381a555fd8 service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Received event network-changed-6117aba3-000f-40a8-9444-33c3d9b7ae6b {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:29:10 user nova-compute[74776]: DEBUG nova.compute.manager [req-8009d8a3-a705-4f22-8d9a-bd6ce85f7f97 req-8cc382c3-00e8-4901-8fd8-92381a555fd8 service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Refreshing instance network info cache due to event network-changed-6117aba3-000f-40a8-9444-33c3d9b7ae6b. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:29:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8009d8a3-a705-4f22-8d9a-bd6ce85f7f97 req-8cc382c3-00e8-4901-8fd8-92381a555fd8 service nova] Acquiring lock "refresh_cache-771e2959-789e-4ef0-a4c9-052cdfa13b00" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:29:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8009d8a3-a705-4f22-8d9a-bd6ce85f7f97 req-8cc382c3-00e8-4901-8fd8-92381a555fd8 service nova] Acquired lock "refresh_cache-771e2959-789e-4ef0-a4c9-052cdfa13b00" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:29:10 user nova-compute[74776]: DEBUG nova.network.neutron [req-8009d8a3-a705-4f22-8d9a-bd6ce85f7f97 req-8cc382c3-00e8-4901-8fd8-92381a555fd8 service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Refreshing network info cache for port 6117aba3-000f-40a8-9444-33c3d9b7ae6b {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:29:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:10 user nova-compute[74776]: DEBUG nova.network.neutron [req-8009d8a3-a705-4f22-8d9a-bd6ce85f7f97 req-8cc382c3-00e8-4901-8fd8-92381a555fd8 service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Updated VIF entry in instance network info cache for port 6117aba3-000f-40a8-9444-33c3d9b7ae6b. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:29:10 user nova-compute[74776]: DEBUG nova.network.neutron [req-8009d8a3-a705-4f22-8d9a-bd6ce85f7f97 req-8cc382c3-00e8-4901-8fd8-92381a555fd8 service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Updating instance_info_cache with network_info: [{"id": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "address": "fa:16:3e:c4:a7:2b", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6117aba3-00", "ovs_interfaceid": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:29:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8009d8a3-a705-4f22-8d9a-bd6ce85f7f97 req-8cc382c3-00e8-4901-8fd8-92381a555fd8 service nova] Releasing lock "refresh_cache-771e2959-789e-4ef0-a4c9-052cdfa13b00" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:29:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:12 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:29:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "771e2959-789e-4ef0-a4c9-052cdfa13b00" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "771e2959-789e-4ef0-a4c9-052cdfa13b00" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG nova.objects.instance [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lazy-loading 'flavor' on Instance uuid 771e2959-789e-4ef0-a4c9-052cdfa13b00 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "771e2959-789e-4ef0-a4c9-052cdfa13b00" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "771e2959-789e-4ef0-a4c9-052cdfa13b00" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "771e2959-789e-4ef0-a4c9-052cdfa13b00" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:13 user nova-compute[74776]: INFO nova.compute.manager [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Attaching volume 708c3d6e-c063-4032-ac81-3340f8e28e4e to /dev/vdb
Nov 22 14:29:13 user nova-compute[74776]: DEBUG os_brick.utils [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[139563bb-68ca-4ee3-b290-7c06fd8b2cc1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[240a4c66-b9ea-47dd-9465-80bdbb9ec334]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[40512a1a-f399-4844-ba37-0096d180f968]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3ae6e7-9d34-4ec4-bfdc-b837f095238e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:29:13 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:29:13 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4cb41b-edb8-4bab-8184-5e8349730f3d]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG os_brick.utils [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:29:13 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Updating existing volume attachment record: f5ae8ba9-6ed1-4891-81c4-3d81a9392bd0 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:29:14 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:29:14 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:29:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-525baf66-82cc-4e8d-a37a-c92c51d4673d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:29:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-525baf66-82cc-4e8d-a37a-c92c51d4673d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:29:14 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:29:15 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Updating instance_info_cache with network_info: [{"id": "ac898a82-d482-4299-b86b-db6aacf8175a", "address": "fa:16:3e:38:af:39", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac898a82-d4", "ovs_interfaceid": "ac898a82-d482-4299-b86b-db6aacf8175a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:29:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-525baf66-82cc-4e8d-a37a-c92c51d4673d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:29:15 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:29:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:15 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:29:15 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:29:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:17 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:29:17 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:29:17 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:29:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:17 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:29:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:29:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMOPsBaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:29:19 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:29:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:29:19 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:29:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:29:19 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1335e3d6-1761-4a80-8ce4-a87e5eb094c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:29:19 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[10598f65-a5a3-4572-9984-7b74d5b7b8d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e] added
Nov 22 14:29:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a08ffca-70ac-4b78-92a8-4da37b8d2305]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c420cf68-3884-4366-bd28-babeabd64b93]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMOPsBaq {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMOPsBaq" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c29e9e1-5de2-41a4-a133-69f3d2984dc5]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dMOPsBaq'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d979a2f-d00a-489b-b822-d97592d11ce9]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4305f97-a5e8-450e-b250-3acaf4d12092]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:29:19 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:29:19 user nova-compute[74776]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 (non-flash)
Nov 22 14:29:19 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:29:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:29:19 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:29:19 user nova-compute[74776]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 (non-flash)
Nov 22 14:29:19 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:29:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50e02f9-b4f8-49b0-a475-33a4039a8a51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e, portal: 172.16.0.220,3260]
Nov 22 14:29:20 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e, portal: 172.16.0.220,3260] successful.
Nov 22 14:29:20 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb115129-1933-4603-83d5-53b8c591a2dd]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfba5204-ed13-473b-90b3-15a2505625d1]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:29:20 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:29:20 user nova-compute[74776]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 (non-flash)
Nov 22 14:29:20 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:29:20 user nova-compute[74776]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e (non-flash)
Nov 22 14:29:20 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:29:20 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:29:20 user nova-compute[74776]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 (non-flash)
Nov 22 14:29:20 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:29:20 user nova-compute[74776]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e (non-flash)
Nov 22 14:29:20 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4f67ad-57f3-4ac6-872b-f96bf4d6ca37]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMOPsBaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc98341b-ca28-4097-9887-16c8e8d7f9f7/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc98341b-ca28-4097-9887-16c8e8d7f9f7/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc98341b-ca28-4097-9887-16c8e8d7f9f7/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc98341b-ca28-4097-9887-16c8e8d7f9f7/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:21 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 96a7c6ec-0cb9-481b-8ec5-4337130bc000 is timed out.
Nov 22 14:29:21 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Successfully detached device vdb from instance 96a7c6ec-0cb9-481b-8ec5-4337130bc000 from the live domain config.
Nov 22 14:29:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhuiUbgw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:29:21 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23065373937353133', 'path': '/dev/sdf'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065373937353133', 'path': '/dev/sdf'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.070s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG nova.objects.instance [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lazy-loading 'flavor' on Instance uuid 771e2959-789e-4ef0-a4c9-052cdfa13b00 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[033b7a30-c3f5-4e52-a700-3ca8a0e12f05]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:29:21 user nova-compute[74776]: No targets found.
Nov 22 14:29:21 user nova-compute[74776]: iSNS:
Nov 22 14:29:21 user nova-compute[74776]: No targets found.
Nov 22 14:29:21 user nova-compute[74776]: STATIC:
Nov 22 14:29:21 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9
Nov 22 14:29:21 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:29:21 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:29:21 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3
Nov 22 14:29:21 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:29:21 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:29:21 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e
Nov 22 14:29:21 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:29:21 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:29:21 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a
Nov 22 14:29:21 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:29:21 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:29:21 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47
Nov 22 14:29:21 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:29:21 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:29:21 user nova-compute[74776]: FIRMWARE:
Nov 22 14:29:21 user nova-compute[74776]: No targets found.
Nov 22 14:29:21 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:29:21 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:29:21 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:29:21 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:29:21 user nova-compute[74776]:   <source dev="/dev/sdf"/>
Nov 22 14:29:21 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:29:21 user nova-compute[74776]:   <serial>708c3d6e-c063-4032-ac81-3340f8e28e4e</serial>
Nov 22 14:29:21 user nova-compute[74776]: </disk>
Nov 22 14:29:21 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cdd975-1624-448b-8aa5-d92e4ccc4672]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b93559-e4b3-42f5-92be-121a69b9544c]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:29:21 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:29:21 user nova-compute[74776]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 (non-flash)
Nov 22 14:29:21 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:29:21 user nova-compute[74776]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e (non-flash)
Nov 22 14:29:21 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:29:21 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:29:21 user nova-compute[74776]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 (non-flash)
Nov 22 14:29:21 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:29:21 user nova-compute[74776]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e (non-flash)
Nov 22 14:29:21 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c587e3760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47'): ({'sdd'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Removing single pathed devices sdd {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f004a77-4bfb-48d9-9b15-519cafabf2f2]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce34e29a-d8fd-4618-997d-a6e8096232dc]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Flushing IO for device /dev/sdd {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc1ac26-e492-4157-b680-1b9ac2c2ed59]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9a62ad-6ca9-4b2f-910a-cdbab4678a8e]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] SCSI volumes sdd have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4eefae-1081-4b07-9c01-48fe52a46912]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8337afb9-00f9-47ad-8ac3-bfff26d92097]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47, portal: 172.16.0.220,3260]
Nov 22 14:29:21 user nova-compute[74776]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47, portal: 172.16.0.220,3260] successful.
Nov 22 14:29:21 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[26291098-f098-4f24-9e1b-389b17df8cc8]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] <== disconnect_volume: return (436ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] No VIF found with MAC fa:16:3e:c4:a7:2b, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2ca8dabb-80ac-43e1-8c4a-8dfb936d0aec tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "771e2959-789e-4ef0-a4c9-052cdfa13b00" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.514s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.objects.instance [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lazy-loading 'flavor' on Instance uuid 96a7c6ec-0cb9-481b-8ec5-4337130bc000 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:29:22 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:29:22 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=7407MB free_disk=24.99781036376953GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "771e2959-789e-4ef0-a4c9-052cdfa13b00" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "771e2959-789e-4ef0-a4c9-052cdfa13b00" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0d8fe95f-4012-48ff-b099-789a059efeff tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.166s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:22 user nova-compute[74776]: INFO nova.compute.manager [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Detaching volume 708c3d6e-c063-4032-ac81-3340f8e28e4e
Nov 22 14:29:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.069s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:22 user nova-compute[74776]: INFO nova.compute.manager [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Terminating instance
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.compute.manager [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:29:22 user nova-compute[74776]: INFO nova.virt.block_device [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Attempting to driver detach volume 708c3d6e-c063-4032-ac81-3340f8e28e4e from mountpoint /dev/vdb
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Attempting to detach device vdb from instance 771e2959-789e-4ef0-a4c9-052cdfa13b00 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:29:22 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:29:22 user nova-compute[74776]:   <source dev="/dev/sdf"/>
Nov 22 14:29:22 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:29:22 user nova-compute[74776]:   <serial>708c3d6e-c063-4032-ac81-3340f8e28e4e</serial>
Nov 22 14:29:22 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:29:22 user nova-compute[74776]: </disk>
Nov 22 14:29:22 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:29:22 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Successfully detached device vdb from instance 771e2959-789e-4ef0-a4c9-052cdfa13b00 from the persistent domain config.
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 771e2959-789e-4ef0-a4c9-052cdfa13b00 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:29:22 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:29:22 user nova-compute[74776]:   <source dev="/dev/sdf"/>
Nov 22 14:29:22 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:29:22 user nova-compute[74776]:   <serial>708c3d6e-c063-4032-ac81-3340f8e28e4e</serial>
Nov 22 14:29:22 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:29:22 user nova-compute[74776]: </disk>
Nov 22 14:29:22 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4629d82d-fd02-4a58-a535-b362b493e7c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 525baf66-82cc-4e8d-a37a-c92c51d4673d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6f2ce4b2-660c-431f-b951-c6ec5090ef7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f4f30fe7-b234-4f81-b081-3214f5ebe789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance bc98341b-ca28-4097-9887-16c8e8d7f9f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 96a7c6ec-0cb9-481b-8ec5-4337130bc000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 771e2959-789e-4ef0-a4c9-052cdfa13b00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 245ff2b1-5e87-4756-b4c1-86a2fea089a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 68b6744f-c29d-4ccd-83ab-fcc31666d69b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 016bf051-9034-4124-948d-995aacf77caf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance d374cfe8-6d04-4c4e-9055-f46488a76ed8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.compute.manager [req-2b1ae12a-3af0-4bc3-832d-fcea206dc796 req-ca959c5a-80a2-4698-a3b4-a29a5e1c531e service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Received event network-vif-unplugged-600b1da5-d75f-48ff-a470-b92c141a5a8f {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2b1ae12a-3af0-4bc3-832d-fcea206dc796 req-ca959c5a-80a2-4698-a3b4-a29a5e1c531e service nova] Acquiring lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2b1ae12a-3af0-4bc3-832d-fcea206dc796 req-ca959c5a-80a2-4698-a3b4-a29a5e1c531e service nova] Lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2b1ae12a-3af0-4bc3-832d-fcea206dc796 req-ca959c5a-80a2-4698-a3b4-a29a5e1c531e service nova] Lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.compute.manager [req-2b1ae12a-3af0-4bc3-832d-fcea206dc796 req-ca959c5a-80a2-4698-a3b4-a29a5e1c531e service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] No waiting events found dispatching network-vif-unplugged-600b1da5-d75f-48ff-a470-b92c141a5a8f {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:29:22 user nova-compute[74776]: DEBUG nova.compute.manager [req-2b1ae12a-3af0-4bc3-832d-fcea206dc796 req-ca959c5a-80a2-4698-a3b4-a29a5e1c531e service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Received event network-vif-unplugged-600b1da5-d75f-48ff-a470-b92c141a5a8f for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 771e2959-789e-4ef0-a4c9-052cdfa13b00 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:29:23 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Instance destroyed successfully.
Nov 22 14:29:23 user nova-compute[74776]: DEBUG nova.objects.instance [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lazy-loading 'resources' on Instance uuid 96a7c6ec-0cb9-481b-8ec5-4337130bc000 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:26:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-102260688',display_name='tempest-VolumesSnapshotTestJSON-instance-102260688',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-102260688',id=26,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL+eoX2rggHYJ9Zd6+4KubyUbllnA4QRQoDHqoMPUoSgIjzSqJ+Jb8jAeS+/8lsFvIdPoWyF/nhbpo/uBrjvDzBnqIgyk0cX25ChqHmeLUyQfR2gmspcTphwWfLgO6Cyw==',key_name='tempest-keypair-1130718677',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:26:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ae8f6ccdd1d4762945614272ca75a1c',ramdisk_id='',reservation_id='r-kr9fcrnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1416311759',owner_user_name='tempest-VolumesSnapshotTestJSON-1416311759-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:26:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd5bd7dac415438898e5773c1722f633',uuid=96a7c6ec-0cb9-481b-8ec5-4337130bc000,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "address": "fa:16:3e:9e:bf:17", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap600b1da5-d7", "ovs_interfaceid": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Converting VIF {"id": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "address": "fa:16:3e:9e:bf:17", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap600b1da5-d7", "ovs_interfaceid": "600b1da5-d75f-48ff-a470-b92c141a5a8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:bf:17,bridge_name='br-int',has_traffic_filtering=True,id=600b1da5-d75f-48ff-a470-b92c141a5a8f,network=Network(e38b6baa-4dea-488c-ad93-634cb26fdb5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap600b1da5-d7') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG os_vif [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:bf:17,bridge_name='br-int',has_traffic_filtering=True,id=600b1da5-d75f-48ff-a470-b92c141a5a8f,network=Network(e38b6baa-4dea-488c-ad93-634cb26fdb5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap600b1da5-d7') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap600b1da5-d7, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=630bbd26-6f53-4171-b476-54c1d09ef82a) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:29:23 user nova-compute[74776]: INFO os_vif [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:bf:17,bridge_name='br-int',has_traffic_filtering=True,id=600b1da5-d75f-48ff-a470-b92c141a5a8f,network=Network(e38b6baa-4dea-488c-ad93-634cb26fdb5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap600b1da5-d7')
Nov 22 14:29:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhuiUbgw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:29:23 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:29:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa73d4e2-2be0-4a87-910d-9f9143e927d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:29:23 user nova-compute[74776]: No targets found.
Nov 22 14:29:23 user nova-compute[74776]: iSNS:
Nov 22 14:29:23 user nova-compute[74776]: No targets found.
Nov 22 14:29:23 user nova-compute[74776]: STATIC:
Nov 22 14:29:23 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9
Nov 22 14:29:23 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:29:23 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:29:23 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3
Nov 22 14:29:23 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:29:23 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:29:23 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e
Nov 22 14:29:23 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:29:23 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:29:23 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a
Nov 22 14:29:23 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:29:23 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:29:23 user nova-compute[74776]: FIRMWARE:
Nov 22 14:29:23 user nova-compute[74776]: No targets found.
Nov 22 14:29:23 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:29:23 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:29:23 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fb64953-06fe-49f0-a3d7-157f54e81a47', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[997c4af1-d4e7-45d4-aaa1-7ad4c21759d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[741abcf8-0407-4312-88da-5872983998a8]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:29:23 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:29:23 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:29:23 user nova-compute[74776]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e (non-flash)
Nov 22 14:29:23 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:29:23 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:29:23 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:29:23 user nova-compute[74776]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e (non-flash)
Nov 22 14:29:23 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c38618790>, {}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Disconnecting from: [] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] <== disconnect_volume: return (80ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:29:23 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Deleting instance files /opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000_del
Nov 22 14:29:23 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Deletion of /opt/stack/data/nova/instances/96a7c6ec-0cb9-481b-8ec5-4337130bc000_del complete
Nov 22 14:29:23 user nova-compute[74776]: INFO nova.compute.manager [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 22 14:29:23 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:29:23 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:29:24 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:29:24 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:29:24 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:29:24 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:29:24 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Took 0.73 seconds to deallocate network for instance.
Nov 22 14:29:24 user nova-compute[74776]: WARNING nova.volume.cinder [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Attachment 45ce7664-659d-4b74-95da-ed6250345084 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 45ce7664-659d-4b74-95da-ed6250345084. (HTTP 404) (Request-ID: req-50a7765b-8832-458c-a460-b32b8a348c29)
Nov 22 14:29:24 user nova-compute[74776]: INFO nova.compute.manager [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Took 0.02 seconds to detach 1 volumes for instance.
Nov 22 14:29:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:24 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:29:24 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:29:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:24 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Deleted allocations for instance 96a7c6ec-0cb9-481b-8ec5-4337130bc000
Nov 22 14:29:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-77d8bf41-a010-4990-94ae-44a67d7536e3 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.338s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-bf4378b9-f76c-480b-8c8a-df8ed4fab8a6 req-80781120-1d46-410c-8655-8af28981e3ad service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Received event network-vif-plugged-600b1da5-d75f-48ff-a470-b92c141a5a8f {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:29:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-bf4378b9-f76c-480b-8c8a-df8ed4fab8a6 req-80781120-1d46-410c-8655-8af28981e3ad service nova] Acquiring lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-bf4378b9-f76c-480b-8c8a-df8ed4fab8a6 req-80781120-1d46-410c-8655-8af28981e3ad service nova] Lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-bf4378b9-f76c-480b-8c8a-df8ed4fab8a6 req-80781120-1d46-410c-8655-8af28981e3ad service nova] Lock "96a7c6ec-0cb9-481b-8ec5-4337130bc000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-bf4378b9-f76c-480b-8c8a-df8ed4fab8a6 req-80781120-1d46-410c-8655-8af28981e3ad service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] No waiting events found dispatching network-vif-plugged-600b1da5-d75f-48ff-a470-b92c141a5a8f {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:29:24 user nova-compute[74776]: WARNING nova.compute.manager [req-bf4378b9-f76c-480b-8c8a-df8ed4fab8a6 req-80781120-1d46-410c-8655-8af28981e3ad service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Received unexpected event network-vif-plugged-600b1da5-d75f-48ff-a470-b92c141a5a8f for instance with vm_state deleted and task_state None.
Nov 22 14:29:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-bf4378b9-f76c-480b-8c8a-df8ed4fab8a6 req-80781120-1d46-410c-8655-8af28981e3ad service nova] [instance: 96a7c6ec-0cb9-481b-8ec5-4337130bc000] Received event network-vif-deleted-600b1da5-d75f-48ff-a470-b92c141a5a8f {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:29:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquiring lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:29 user nova-compute[74776]: INFO nova.compute.manager [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Unshelving
Nov 22 14:29:29 user nova-compute[74776]: INFO nova.virt.block_device [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Booting with volume 4916cee9-8763-4a88-a0d4-2555e772ec71 at /dev/vda
Nov 22 14:29:29 user nova-compute[74776]: DEBUG os_brick.utils [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaaa48c-a2fb-49ba-9ba4-9fc7fb8a8379]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f087d8-3c54-4f2b-8fea-ecaeefefbb0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fea8d1-1421-4959-8f47-ff22d669903c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[996f5485-c17a-4a23-98c6-f1d0e2acccf5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:29:29 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:29:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b60ce6a-2621-4b0d-8a92-33e5fcd44337]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG os_brick.utils [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:29:29 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Updating existing volume attachment record: 048ec44a-e41e-46f6-8458-05a93cbe83af {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:29:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:35 user nova-compute[74776]: DEBUG nova.compute.manager [req-2edcb201-bf08-4512-9cef-7c4e04905549 req-2dcdbd43-6715-47e6-9390-9f5e5ee48b6d service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Received event network-changed-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:29:35 user nova-compute[74776]: DEBUG nova.compute.manager [req-2edcb201-bf08-4512-9cef-7c4e04905549 req-2dcdbd43-6715-47e6-9390-9f5e5ee48b6d service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Refreshing instance network info cache due to event network-changed-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:29:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2edcb201-bf08-4512-9cef-7c4e04905549 req-2dcdbd43-6715-47e6-9390-9f5e5ee48b6d service nova] Acquiring lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:29:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2edcb201-bf08-4512-9cef-7c4e04905549 req-2dcdbd43-6715-47e6-9390-9f5e5ee48b6d service nova] Acquired lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:29:35 user nova-compute[74776]: DEBUG nova.network.neutron [req-2edcb201-bf08-4512-9cef-7c4e04905549 req-2dcdbd43-6715-47e6-9390-9f5e5ee48b6d service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Refreshing network info cache for port abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:29:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:35 user nova-compute[74776]: DEBUG nova.objects.instance [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lazy-loading 'pci_requests' on Instance uuid b30a5c6b-ea71-4a06-ad03-a02ebd584a80 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:29:35 user nova-compute[74776]: DEBUG nova.objects.instance [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lazy-loading 'numa_topology' on Instance uuid b30a5c6b-ea71-4a06-ad03-a02ebd584a80 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:29:35 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:29:35 user nova-compute[74776]: INFO nova.compute.claims [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Claim successful on node user
Nov 22 14:29:35 user nova-compute[74776]: DEBUG nova.network.neutron [req-2edcb201-bf08-4512-9cef-7c4e04905549 req-2dcdbd43-6715-47e6-9390-9f5e5ee48b6d service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Updated VIF entry in instance network info cache for port abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:29:35 user nova-compute[74776]: DEBUG nova.network.neutron [req-2edcb201-bf08-4512-9cef-7c4e04905549 req-2dcdbd43-6715-47e6-9390-9f5e5ee48b6d service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Updating instance_info_cache with network_info: [{"id": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "address": "fa:16:3e:a5:87:db", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabaa3c9b-98", "ovs_interfaceid": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:29:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2edcb201-bf08-4512-9cef-7c4e04905549 req-2dcdbd43-6715-47e6-9390-9f5e5ee48b6d service nova] Releasing lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:29:35 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:29:35 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:29:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:35 user nova-compute[74776]: INFO nova.network.neutron [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Updating port 5b603149-0a4f-4aac-890c-fade34245023 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 22 14:29:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Stashing vm_state: active {{(pid=74776) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 22 14:29:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:29:36 user nova-compute[74776]: INFO nova.compute.claims [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Claim successful on node user
Nov 22 14:29:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquiring lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:29:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquired lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:29:36 user nova-compute[74776]: DEBUG nova.network.neutron [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:29:36 user nova-compute[74776]: INFO nova.compute.resource_tracker [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Updating resource usage from migration 60b093a3-1b59-4ec2-94fa-f3f9d6307534
Nov 22 14:29:36 user nova-compute[74776]: DEBUG nova.compute.manager [req-6d3c2abb-84a1-46bd-aad1-4e7207fafcf0 req-3667ab95-75d4-4a50-a2a8-da307fb6e653 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received event network-changed-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:29:36 user nova-compute[74776]: DEBUG nova.compute.manager [req-6d3c2abb-84a1-46bd-aad1-4e7207fafcf0 req-3667ab95-75d4-4a50-a2a8-da307fb6e653 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Refreshing instance network info cache due to event network-changed-5b603149-0a4f-4aac-890c-fade34245023. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:29:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6d3c2abb-84a1-46bd-aad1-4e7207fafcf0 req-3667ab95-75d4-4a50-a2a8-da307fb6e653 service nova] Acquiring lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.compute.manager [req-cba6d17d-6e7f-452c-99e4-210eef087d9a req-591b2984-c53b-4ca3-82f9-ec14a1b03a58 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received event network-changed-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.compute.manager [req-cba6d17d-6e7f-452c-99e4-210eef087d9a req-591b2984-c53b-4ca3-82f9-ec14a1b03a58 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Refreshing instance network info cache due to event network-changed-414f82bf-343b-4e38-bc14-6af797152ea5. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cba6d17d-6e7f-452c-99e4-210eef087d9a req-591b2984-c53b-4ca3-82f9-ec14a1b03a58 service nova] Acquiring lock "refresh_cache-245ff2b1-5e87-4756-b4c1-86a2fea089a5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cba6d17d-6e7f-452c-99e4-210eef087d9a req-591b2984-c53b-4ca3-82f9-ec14a1b03a58 service nova] Acquired lock "refresh_cache-245ff2b1-5e87-4756-b4c1-86a2fea089a5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.network.neutron [req-cba6d17d-6e7f-452c-99e4-210eef087d9a req-591b2984-c53b-4ca3-82f9-ec14a1b03a58 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Refreshing network info cache for port 414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.415s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:37 user nova-compute[74776]: INFO nova.compute.manager [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Migrating
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.network.neutron [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Updating instance_info_cache with network_info: [{"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "refresh_cache-245ff2b1-5e87-4756-b4c1-86a2fea089a5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Releasing lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:29:37 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Creating image(s)
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Did not create local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Ensure instance console log exists: /opt/stack/data/nova/instances/b30a5c6b-ea71-4a06-ad03-a02ebd584a80/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Start _get_guest_xml network_info=[{"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '048ec44a-e41e-46f6-8458-05a93cbe83af', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeMqQUCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b30a5c6b-ea71-4a06-ad03-a02ebd584a80', 'attached_at': '', 'detached_at': '', 'volume_id': '4916cee9-8763-4a88-a0d4-2555e772ec71', 'serial': '4916cee9-8763-4a88-a0d4-2555e772ec71'}, 'boot_index': 0, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6d3c2abb-84a1-46bd-aad1-4e7207fafcf0 req-3667ab95-75d4-4a50-a2a8-da307fb6e653 service nova] Acquired lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.network.neutron [req-6d3c2abb-84a1-46bd-aad1-4e7207fafcf0 req-3667ab95-75d4-4a50-a2a8-da307fb6e653 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Refreshing network info cache for port 5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:29:37 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:29:37 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.objects.instance [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lazy-loading 'vcpu_model' on Instance uuid b30a5c6b-ea71-4a06-ad03-a02ebd584a80 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.objects.base [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Object Instance<b30a5c6b-ea71-4a06-ad03-a02ebd584a80> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeMqQUCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:29:37 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:29:37 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:29:37 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a1397b-59aa-48b5-9871-6270e2063efc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:29:37 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59bb7d2-75a3-40a2-9ffb-40b2161e3032]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71] added
Nov 22 14:29:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7a1557-e2f5-4469-81cf-b4df038a8f05]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a238aae-49b2-46ec-870e-5f32ae2baa15]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KeMqQUCF {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KeMqQUCF" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2b168e-d105-4845-91f5-e48cc5b8dbc0]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KeMqQUCF'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a14a513-44dd-4759-b8da-33fea32b52b9]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba42a9ad-db32-447a-98a8-7c729dbefffe]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:29:37 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:29:37 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:29:37 user nova-compute[74776]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e (non-flash)
Nov 22 14:29:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:29:37 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:29:37 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:29:37 user nova-compute[74776]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e (non-flash)
Nov 22 14:29:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9617ce56-6cba-491b-8bee-845fdf37a335]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71, portal: 172.16.0.220,3260]
Nov 22 14:29:37 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71, portal: 172.16.0.220,3260] successful.
Nov 22 14:29:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad950eff-35c2-49ed-b545-1b7aa663131a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4688fd7-590a-4edc-9634-462c15c2d407]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:29:37 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:29:37 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:29:37 user nova-compute[74776]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e (non-flash)
Nov 22 14:29:37 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:29:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:29:37 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:29:37 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:29:37 user nova-compute[74776]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e (non-flash)
Nov 22 14:29:37 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:29:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.network.neutron [req-6d3c2abb-84a1-46bd-aad1-4e7207fafcf0 req-3667ab95-75d4-4a50-a2a8-da307fb6e653 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Updated VIF entry in instance network info cache for port 5b603149-0a4f-4aac-890c-fade34245023. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.network.neutron [req-6d3c2abb-84a1-46bd-aad1-4e7207fafcf0 req-3667ab95-75d4-4a50-a2a8-da307fb6e653 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Updating instance_info_cache with network_info: [{"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6d3c2abb-84a1-46bd-aad1-4e7207fafcf0 req-3667ab95-75d4-4a50-a2a8-da307fb6e653 service nova] Releasing lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.040s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c3a642-7846-43ed-9c53-f76b3adfca91]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeMqQUCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.network.neutron [req-cba6d17d-6e7f-452c-99e4-210eef087d9a req-591b2984-c53b-4ca3-82f9-ec14a1b03a58 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Updated VIF entry in instance network info cache for port 414f82bf-343b-4e38-bc14-6af797152ea5. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.network.neutron [req-cba6d17d-6e7f-452c-99e4-210eef087d9a req-591b2984-c53b-4ca3-82f9-ec14a1b03a58 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Updating instance_info_cache with network_info: [{"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cba6d17d-6e7f-452c-99e4-210eef087d9a req-591b2984-c53b-4ca3-82f9-ec14a1b03a58 service nova] Releasing lock "refresh_cache-245ff2b1-5e87-4756-b4c1-86a2fea089a5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquired lock "refresh_cache-245ff2b1-5e87-4756-b4c1-86a2fea089a5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:29:37 user nova-compute[74776]: DEBUG nova.network.neutron [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG nova.network.neutron [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Updating instance_info_cache with network_info: [{"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Releasing lock "refresh_cache-245ff2b1-5e87-4756-b4c1-86a2fea089a5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Starting migrate_disk_and_power_off {{(pid=74776) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26330316233623737', 'path': '/dev/sdd'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330316233623737', 'path': '/dev/sdd'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T14:25:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-119206767',display_name='tempest-TestShelveInstance-server-119206767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-119206767',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-457038765',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:26:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='529b6ffebfe549278c4462796677a969',ramdisk_id='',reservation_id='r-lsktxgb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-853764329',owner_user_name='tempest-TestShelveInstance-853764329-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:29:29Z,user_data=None,user_id='1d42ed53e03c4b6b8989293a3737d2f2',uuid=b30a5c6b-ea71-4a06-ad03-a02ebd584a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Converting VIF {"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:cc:9b,bridge_name='br-int',has_traffic_filtering=True,id=5b603149-0a4f-4aac-890c-fade34245023,network=Network(bac4cf3b-8492-4d07-859d-266e1cddf6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b603149-0a') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG nova.objects.instance [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lazy-loading 'pci_devices' on Instance uuid b30a5c6b-ea71-4a06-ad03-a02ebd584a80 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG nova.objects.base [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Object Instance<b30a5c6b-ea71-4a06-ad03-a02ebd584a80> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:29:38 user nova-compute[74776]:   <uuid>b30a5c6b-ea71-4a06-ad03-a02ebd584a80</uuid>
Nov 22 14:29:38 user nova-compute[74776]:   <name>instance-00000018</name>
Nov 22 14:29:38 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:29:38 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:29:38 user nova-compute[74776]:   <metadata>
Nov 22 14:29:38 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:29:38 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:29:38 user nova-compute[74776]:       <nova:name>tempest-TestShelveInstance-server-119206767</nova:name>
Nov 22 14:29:38 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:29:37</nova:creationTime>
Nov 22 14:29:38 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:29:38 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:29:38 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:29:38 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:29:38 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:29:38 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:29:38 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:29:38 user nova-compute[74776]:       <nova:owner>
Nov 22 14:29:38 user nova-compute[74776]:         <nova:user uuid="1d42ed53e03c4b6b8989293a3737d2f2">tempest-TestShelveInstance-853764329-project-member</nova:user>
Nov 22 14:29:38 user nova-compute[74776]:         <nova:project uuid="529b6ffebfe549278c4462796677a969">tempest-TestShelveInstance-853764329</nova:project>
Nov 22 14:29:38 user nova-compute[74776]:       </nova:owner>
Nov 22 14:29:38 user nova-compute[74776]:       <nova:ports>
Nov 22 14:29:38 user nova-compute[74776]:         <nova:port uuid="5b603149-0a4f-4aac-890c-fade34245023">
Nov 22 14:29:38 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 14:29:38 user nova-compute[74776]:         </nova:port>
Nov 22 14:29:38 user nova-compute[74776]:       </nova:ports>
Nov 22 14:29:38 user nova-compute[74776]:     </nova:instance>
Nov 22 14:29:38 user nova-compute[74776]:   </metadata>
Nov 22 14:29:38 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:29:38 user nova-compute[74776]:     <system>
Nov 22 14:29:38 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:29:38 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:29:38 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:29:38 user nova-compute[74776]:       <entry name="serial">b30a5c6b-ea71-4a06-ad03-a02ebd584a80</entry>
Nov 22 14:29:38 user nova-compute[74776]:       <entry name="uuid">b30a5c6b-ea71-4a06-ad03-a02ebd584a80</entry>
Nov 22 14:29:38 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:29:38 user nova-compute[74776]:     </system>
Nov 22 14:29:38 user nova-compute[74776]:   </sysinfo>
Nov 22 14:29:38 user nova-compute[74776]:   <os>
Nov 22 14:29:38 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:29:38 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:29:38 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:29:38 user nova-compute[74776]:   </os>
Nov 22 14:29:38 user nova-compute[74776]:   <features>
Nov 22 14:29:38 user nova-compute[74776]:     <acpi/>
Nov 22 14:29:38 user nova-compute[74776]:     <apic/>
Nov 22 14:29:38 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:29:38 user nova-compute[74776]:   </features>
Nov 22 14:29:38 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:29:38 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:29:38 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:29:38 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:29:38 user nova-compute[74776]:   </clock>
Nov 22 14:29:38 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:29:38 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:29:38 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:29:38 user nova-compute[74776]:   </cpu>
Nov 22 14:29:38 user nova-compute[74776]:   <devices>
Nov 22 14:29:38 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:29:38 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:29:38 user nova-compute[74776]:       <source dev="/dev/sdd"/>
Nov 22 14:29:38 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:29:38 user nova-compute[74776]:       <serial>4916cee9-8763-4a88-a0d4-2555e772ec71</serial>
Nov 22 14:29:38 user nova-compute[74776]:     </disk>
Nov 22 14:29:38 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:29:38 user nova-compute[74776]:       <mac address="fa:16:3e:c6:cc:9b"/>
Nov 22 14:29:38 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:29:38 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:29:38 user nova-compute[74776]:       <target dev="tap5b603149-0a"/>
Nov 22 14:29:38 user nova-compute[74776]:     </interface>
Nov 22 14:29:38 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:29:38 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/b30a5c6b-ea71-4a06-ad03-a02ebd584a80/console.log" append="off"/>
Nov 22 14:29:38 user nova-compute[74776]:     </serial>
Nov 22 14:29:38 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:29:38 user nova-compute[74776]:     <video>
Nov 22 14:29:38 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:29:38 user nova-compute[74776]:     </video>
Nov 22 14:29:38 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:29:38 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:29:38 user nova-compute[74776]:     </rng>
Nov 22 14:29:38 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:29:38 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:29:38 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:29:38 user nova-compute[74776]:     </memballoon>
Nov 22 14:29:38 user nova-compute[74776]:   </devices>
Nov 22 14:29:38 user nova-compute[74776]: </domain>
Nov 22 14:29:38 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T14:25:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-119206767',display_name='tempest-TestShelveInstance-server-119206767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-119206767',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-457038765',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:26:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='529b6ffebfe549278c4462796677a969',ramdisk_id='',reservation_id='r-lsktxgb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-853764329',owner_user_name='tempest-TestShelveInstance-853764329-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:29:29Z,user_data=None,user_id='1d42ed53e03c4b6b8989293a3737d2f2',uuid=b30a5c6b-ea71-4a06-ad03-a02ebd584a80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Converting VIF {"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:cc:9b,bridge_name='br-int',has_traffic_filtering=True,id=5b603149-0a4f-4aac-890c-fade34245023,network=Network(bac4cf3b-8492-4d07-859d-266e1cddf6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b603149-0a') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG os_vif [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:cc:9b,bridge_name='br-int',has_traffic_filtering=True,id=5b603149-0a4f-4aac-890c-fade34245023,network=Network(bac4cf3b-8492-4d07-859d-266e1cddf6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b603149-0a') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a98b0142-4370-5722-b742-9775ff54e7c7', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b603149-0a, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b603149-0a, col_values=(('qos', UUID('2928f8a4-f467-4a54-b4b4-dfc816a41eba')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b603149-0a, col_values=(('external_ids', {'iface-id': '5b603149-0a4f-4aac-890c-fade34245023', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:cc:9b', 'vm-uuid': 'b30a5c6b-ea71-4a06-ad03-a02ebd584a80'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:38 user nova-compute[74776]: INFO os_vif [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:cc:9b,bridge_name='br-int',has_traffic_filtering=True,id=5b603149-0a4f-4aac-890c-fade34245023,network=Network(bac4cf3b-8492-4d07-859d-266e1cddf6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b603149-0a')
Nov 22 14:29:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] No VIF found with MAC fa:16:3e:c6:cc:9b, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-493d62c7-d364-4fda-9ec8-c28239d667fa req-469478ef-20c4-4148-aac8-4650751ed460 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received event network-vif-unplugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-493d62c7-d364-4fda-9ec8-c28239d667fa req-469478ef-20c4-4148-aac8-4650751ed460 service nova] Acquiring lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-493d62c7-d364-4fda-9ec8-c28239d667fa req-469478ef-20c4-4148-aac8-4650751ed460 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-493d62c7-d364-4fda-9ec8-c28239d667fa req-469478ef-20c4-4148-aac8-4650751ed460 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-493d62c7-d364-4fda-9ec8-c28239d667fa req-469478ef-20c4-4148-aac8-4650751ed460 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] No waiting events found dispatching network-vif-unplugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:29:39 user nova-compute[74776]: WARNING nova.compute.manager [req-493d62c7-d364-4fda-9ec8-c28239d667fa req-469478ef-20c4-4148-aac8-4650751ed460 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received unexpected event network-vif-unplugged-414f82bf-343b-4e38-bc14-6af797152ea5 for instance with vm_state active and task_state resize_migrating.
Nov 22 14:29:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-493d62c7-d364-4fda-9ec8-c28239d667fa req-469478ef-20c4-4148-aac8-4650751ed460 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received event network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-493d62c7-d364-4fda-9ec8-c28239d667fa req-469478ef-20c4-4148-aac8-4650751ed460 service nova] Acquiring lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-493d62c7-d364-4fda-9ec8-c28239d667fa req-469478ef-20c4-4148-aac8-4650751ed460 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-493d62c7-d364-4fda-9ec8-c28239d667fa req-469478ef-20c4-4148-aac8-4650751ed460 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-493d62c7-d364-4fda-9ec8-c28239d667fa req-469478ef-20c4-4148-aac8-4650751ed460 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] No waiting events found dispatching network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:29:39 user nova-compute[74776]: WARNING nova.compute.manager [req-493d62c7-d364-4fda-9ec8-c28239d667fa req-469478ef-20c4-4148-aac8-4650751ed460 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received unexpected event network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 for instance with vm_state active and task_state resize_migrating.
Nov 22 14:29:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:39 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Instance destroyed successfully.
Nov 22 14:29:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-10125610',display_name='tempest-ServerActionsTestOtherA-server-10125610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-10125610',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+0/ONa93QEWt5XODlWdDhT3U9g8+KkiNeYX5RdCfVnODI9hDpQVCexgtOudugmxzZAzaK3M5HeFwSkQ11sjSni+XdF+kkALoXukp/BrvBbOU8ZVGgWEOMKJnkhO9ZxRw==',key_name='tempest-keypair-1736172995',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:27:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3958d7be91b4bb1b9e314d8867cd8f5',ramdisk_id='',reservation_id='r-n2u0p23v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-109524404',owner_user_name='tempest-ServerActionsTestOtherA-109524404-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:29:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f703bfbe762447778429bda22b74505c',uuid=245ff2b1-5e87-4756-b4c1-86a2fea089a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2027168286-network", "vif_mac": "fa:16:3e:c0:9f:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converting VIF {"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2027168286-network", "vif_mac": "fa:16:3e:c0:9f:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:9f:55,bridge_name='br-int',has_traffic_filtering=True,id=414f82bf-343b-4e38-bc14-6af797152ea5,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap414f82bf-34') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG os_vif [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:9f:55,bridge_name='br-int',has_traffic_filtering=True,id=414f82bf-343b-4e38-bc14-6af797152ea5,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap414f82bf-34') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap414f82bf-34, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=280a2d1b-97d5-45e1-8395-062f94345a03) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:39 user nova-compute[74776]: INFO os_vif [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:9f:55,bridge_name='br-int',has_traffic_filtering=True,id=414f82bf-343b-4e38-bc14-6af797152ea5,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap414f82bf-34')
Nov 22 14:29:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxWHJsVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:29:39 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:29:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f62b95-b676-45ba-bc07-6b087ced779f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:29:39 user nova-compute[74776]: No targets found.
Nov 22 14:29:39 user nova-compute[74776]: iSNS:
Nov 22 14:29:39 user nova-compute[74776]: No targets found.
Nov 22 14:29:39 user nova-compute[74776]: STATIC:
Nov 22 14:29:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9
Nov 22 14:29:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:29:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:29:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3
Nov 22 14:29:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:29:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:29:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e
Nov 22 14:29:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:29:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:29:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a
Nov 22 14:29:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:29:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:29:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71
Nov 22 14:29:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:29:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:29:39 user nova-compute[74776]: FIRMWARE:
Nov 22 14:29:39 user nova-compute[74776]: No targets found.
Nov 22 14:29:39 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:29:39 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:29:39 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5441cb31-e937-4db4-b523-6f25a527aa5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e06042-7e57-4adf-9662-d43c43174f90]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:29:39 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:29:39 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:29:39 user nova-compute[74776]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e (non-flash)
Nov 22 14:29:39 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:29:39 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:29:39 user nova-compute[74776]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:29:39 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:29:39 user nova-compute[74776]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e (non-flash)
Nov 22 14:29:39 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:29:39 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c58253ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3'): ({'sdc'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Removing single pathed devices sdc {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[111a9635-3235-4ffe-a824-029efbc3f35e]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[72400a96-cd52-4389-8857-cf68dcfa24c9]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Flushing IO for device /dev/sdc {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51b21a0-c1f7-4ef3-9ec3-7bf8fef3ee63]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[94febf1e-d5fe-4763-9f00-6e48cb79045e]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a497a54-5179-468d-b2aa-a7e6f25a6ac1]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[baeacdd3-56e1-4b36-ae45-06b0bad9649e]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3, portal: 172.16.0.220,3260]
Nov 22 14:29:39 user nova-compute[74776]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3, portal: 172.16.0.220,3260] successful.
Nov 22 14:29:39 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f479a654-c3aa-4054-a89d-63f282f82f83]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] <== disconnect_volume: return (377ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:29:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:29:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:40 user nova-compute[74776]: DEBUG nova.network.neutron [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Port 414f82bf-343b-4e38-bc14-6af797152ea5 binding to destination host user is already ACTIVE {{(pid=74776) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 22 14:29:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "refresh_cache-245ff2b1-5e87-4756-b4c1-86a2fea089a5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:29:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquired lock "refresh_cache-245ff2b1-5e87-4756-b4c1-86a2fea089a5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:29:40 user nova-compute[74776]: DEBUG nova.network.neutron [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received event network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] Acquiring lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] No waiting events found dispatching network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:29:41 user nova-compute[74776]: WARNING nova.compute.manager [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received unexpected event network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 for instance with vm_state active and task_state resize_migrated.
Nov 22 14:29:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received event network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] Acquiring lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] No waiting events found dispatching network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:29:41 user nova-compute[74776]: WARNING nova.compute.manager [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received unexpected event network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 for instance with vm_state active and task_state resize_migrated.
Nov 22 14:29:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received event network-vif-unplugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] Acquiring lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] No waiting events found dispatching network-vif-unplugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:29:41 user nova-compute[74776]: WARNING nova.compute.manager [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received unexpected event network-vif-unplugged-414f82bf-343b-4e38-bc14-6af797152ea5 for instance with vm_state active and task_state resize_migrated.
Nov 22 14:29:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received event network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] Acquiring lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] No waiting events found dispatching network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:29:41 user nova-compute[74776]: WARNING nova.compute.manager [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received unexpected event network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 for instance with vm_state active and task_state resize_migrated.
Nov 22 14:29:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received event network-vif-plugged-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] Acquiring lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] No waiting events found dispatching network-vif-plugged-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:29:41 user nova-compute[74776]: WARNING nova.compute.manager [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received unexpected event network-vif-plugged-5b603149-0a4f-4aac-890c-fade34245023 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 22 14:29:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received event network-vif-plugged-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] Acquiring lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] No waiting events found dispatching network-vif-plugged-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:29:41 user nova-compute[74776]: WARNING nova.compute.manager [req-922c840a-0b12-4bc2-b5c7-f139a3181a7f req-64a58730-b1c3-486a-ab5f-2018cb582fc0 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received unexpected event network-vif-plugged-5b603149-0a4f-4aac-890c-fade34245023 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 22 14:29:41 user nova-compute[74776]: DEBUG nova.network.neutron [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Updating instance_info_cache with network_info: [{"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Releasing lock "refresh_cache-245ff2b1-5e87-4756-b4c1-86a2fea089a5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG os_brick.utils [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b2b025-8fe6-46d4-b5fb-f658bdca0579]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ca10b7-482b-4993-9486-09531dda7bc4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d6814b-81b5-4ccf-bf7d-edc2fc535b6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[964a6717-2c60-46ef-8875-9eb9fe3f681e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:29:41 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:29:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d055b1-b39f-4542-a3b4-d685172e6052]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:29:41 user nova-compute[74776]: DEBUG os_brick.utils [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:29:42 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:29:42 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:29:42 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Instance spawned successfully.
Nov 22 14:29:42 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:29:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ee2ea02d-0958-4290-8371-d98a5e170792 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.320s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:43 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 771e2959-789e-4ef0-a4c9-052cdfa13b00 is timed out.
Nov 22 14:29:43 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Successfully detached device vdb from instance 771e2959-789e-4ef0-a4c9-052cdfa13b00 from the live domain config.
Nov 22 14:29:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMOPsBaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:29:43 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:29:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb69f4f-bfd5-4661-9884-6bfe1a12d97d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:29:43 user nova-compute[74776]: No targets found.
Nov 22 14:29:43 user nova-compute[74776]: iSNS:
Nov 22 14:29:43 user nova-compute[74776]: No targets found.
Nov 22 14:29:43 user nova-compute[74776]: STATIC:
Nov 22 14:29:43 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9
Nov 22 14:29:43 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:29:43 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:29:43 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e
Nov 22 14:29:43 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:29:43 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:29:43 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a
Nov 22 14:29:43 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:29:43 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:29:43 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71
Nov 22 14:29:43 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:29:43 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:29:43 user nova-compute[74776]: FIRMWARE:
Nov 22 14:29:43 user nova-compute[74776]: No targets found.
Nov 22 14:29:43 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:29:43 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:29:43 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf934b58-4e77-4b43-bf38-cf0f7e1ed2ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca6a9c7-b1b1-4ef2-a97f-7a5a818b8744]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:29:43 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:29:43 user nova-compute[74776]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e (non-flash)
Nov 22 14:29:43 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:29:43 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:29:43 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:29:43 user nova-compute[74776]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e (non-flash)
Nov 22 14:29:43 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:29:43 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c58276b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e'): ({'sdf'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Removing single pathed devices sdf {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6414ea16-5ec0-485a-9cc7-d9d959e408bd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6a64e2-d4a2-4c97-a728-b904dadba8d4]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Flushing IO for device /dev/sdf {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9ed8ba-2984-4802-8c9f-07e764be98f1]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[284932a3-d327-469f-b1ad-1bda2c9d9782]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] SCSI volumes sdf have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb7524c-52c5-4ae4-99dc-8f2e2845f74a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9b0983-3036-42b5-84ee-c6370b80812d]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e, portal: 172.16.0.220,3260]
Nov 22 14:29:43 user nova-compute[74776]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e, portal: 172.16.0.220,3260] successful.
Nov 22 14:29:43 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:708c3d6e-c063-4032-ac81-3340f8e28e4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[48db5b3c-81fa-4735-bfcf-5ba769ffd463]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] <== disconnect_volume: return (332ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:29:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:29:44 user nova-compute[74776]: DEBUG nova.objects.instance [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lazy-loading 'flavor' on Instance uuid 771e2959-789e-4ef0-a4c9-052cdfa13b00 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:29:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-45e11dd2-d81d-4627-ae92-f3805755436b tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "771e2959-789e-4ef0-a4c9-052cdfa13b00" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.731s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Starting finish_migration {{(pid=74776) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Instance directory exists: not creating {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 14:29:47 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Creating image(s)
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Did not create local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Ensure instance console log exists: /opt/stack/data/nova/instances/245ff2b1-5e87-4756-b4c1-86a2fea089a5/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Start _get_guest_xml network_info=[{"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2027168286-network", "vif_mac": "fa:16:3e:c0:9f:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2490f218-b03e-4e98-a962-a8eed522ac5b', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxWHJsVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '245ff2b1-5e87-4756-b4c1-86a2fea089a5', 'attached_at': '2023-11-22T14:29:48.000000', 'detached_at': '', 'volume_id': '7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3', 'serial': '7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3'}, 'boot_index': 0, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:29:47 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:29:47 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxWHJsVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:29:47 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:29:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:29:47 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:29:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:29:47 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:29:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28067c3-dc5a-4278-a4f1-3224d183ea00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:29:47 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa783a33-08eb-4235-a77b-b6b210dd76f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3] added
Nov 22 14:29:47 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5bd6bd-86ff-4088-86b1-ec40c5e88c53]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:47 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5eba18e-9fdc-458e-9365-238d5e8b53a5]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XxWHJsVr {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XxWHJsVr" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52ae546-adc7-4402-9ce5-5fb657e1eb3a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XxWHJsVr'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aadd5a5-7cea-431e-b7ff-9716072b875e]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8114681-4720-414c-94ce-f1111abcf5a9]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:29:48 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:29:48 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:29:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:29:48 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:29:48 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:29:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[56310145-8c92-49b0-943f-99f3ef1194cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3, portal: 172.16.0.220,3260]
Nov 22 14:29:48 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3, portal: 172.16.0.220,3260] successful.
Nov 22 14:29:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[92503670-e1e3-47ab-b778-0386a6c8a671]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b344082-96d6-43e2-81e8-41176932109f]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:29:48 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:29:48 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:29:48 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:29:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:29:48 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:29:48 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:29:48 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:29:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfbebea-7cce-4334-a4d8-4a8d66b514e4]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:29:48 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: None {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxWHJsVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23831366538313961', 'path': '/dev/sdc'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831366538313961', 'path': '/dev/sdc'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-10125610',display_name='tempest-ServerActionsTestOtherA-server-10125610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-10125610',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+0/ONa93QEWt5XODlWdDhT3U9g8+KkiNeYX5RdCfVnODI9hDpQVCexgtOudugmxzZAzaK3M5HeFwSkQ11sjSni+XdF+kkALoXukp/BrvBbOU8ZVGgWEOMKJnkhO9ZxRw==',key_name='tempest-keypair-1736172995',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:27:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3958d7be91b4bb1b9e314d8867cd8f5',ramdisk_id='',reservation_id='r-n2u0p23v',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-109524404',owner_user_name='tempest-ServerActionsTestOtherA-109524404-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:29:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f703bfbe762447778429bda22b74505c',uuid=245ff2b1-5e87-4756-b4c1-86a2fea089a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2027168286-network", "vif_mac": "fa:16:3e:c0:9f:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converting VIF {"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2027168286-network", "vif_mac": "fa:16:3e:c0:9f:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:9f:55,bridge_name='br-int',has_traffic_filtering=True,id=414f82bf-343b-4e38-bc14-6af797152ea5,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap414f82bf-34') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:29:49 user nova-compute[74776]:   <uuid>245ff2b1-5e87-4756-b4c1-86a2fea089a5</uuid>
Nov 22 14:29:49 user nova-compute[74776]:   <name>instance-0000001c</name>
Nov 22 14:29:49 user nova-compute[74776]:   <memory>2097152</memory>
Nov 22 14:29:49 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:29:49 user nova-compute[74776]:   <metadata>
Nov 22 14:29:49 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:29:49 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:29:49 user nova-compute[74776]:       <nova:name>tempest-ServerActionsTestOtherA-server-10125610</nova:name>
Nov 22 14:29:49 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:29:47</nova:creationTime>
Nov 22 14:29:49 user nova-compute[74776]:       <nova:flavor name="m1.small">
Nov 22 14:29:49 user nova-compute[74776]:         <nova:memory>2048</nova:memory>
Nov 22 14:29:49 user nova-compute[74776]:         <nova:disk>20</nova:disk>
Nov 22 14:29:49 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:29:49 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:29:49 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:29:49 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:29:49 user nova-compute[74776]:       <nova:owner>
Nov 22 14:29:49 user nova-compute[74776]:         <nova:user uuid="f703bfbe762447778429bda22b74505c">tempest-ServerActionsTestOtherA-109524404-project-member</nova:user>
Nov 22 14:29:49 user nova-compute[74776]:         <nova:project uuid="a3958d7be91b4bb1b9e314d8867cd8f5">tempest-ServerActionsTestOtherA-109524404</nova:project>
Nov 22 14:29:49 user nova-compute[74776]:       </nova:owner>
Nov 22 14:29:49 user nova-compute[74776]:       <nova:ports>
Nov 22 14:29:49 user nova-compute[74776]:         <nova:port uuid="414f82bf-343b-4e38-bc14-6af797152ea5">
Nov 22 14:29:49 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 14:29:49 user nova-compute[74776]:         </nova:port>
Nov 22 14:29:49 user nova-compute[74776]:       </nova:ports>
Nov 22 14:29:49 user nova-compute[74776]:     </nova:instance>
Nov 22 14:29:49 user nova-compute[74776]:   </metadata>
Nov 22 14:29:49 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:29:49 user nova-compute[74776]:     <system>
Nov 22 14:29:49 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:29:49 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:29:49 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:29:49 user nova-compute[74776]:       <entry name="serial">245ff2b1-5e87-4756-b4c1-86a2fea089a5</entry>
Nov 22 14:29:49 user nova-compute[74776]:       <entry name="uuid">245ff2b1-5e87-4756-b4c1-86a2fea089a5</entry>
Nov 22 14:29:49 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:29:49 user nova-compute[74776]:     </system>
Nov 22 14:29:49 user nova-compute[74776]:   </sysinfo>
Nov 22 14:29:49 user nova-compute[74776]:   <os>
Nov 22 14:29:49 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:29:49 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:29:49 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:29:49 user nova-compute[74776]:   </os>
Nov 22 14:29:49 user nova-compute[74776]:   <features>
Nov 22 14:29:49 user nova-compute[74776]:     <acpi/>
Nov 22 14:29:49 user nova-compute[74776]:     <apic/>
Nov 22 14:29:49 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:29:49 user nova-compute[74776]:   </features>
Nov 22 14:29:49 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:29:49 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:29:49 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:29:49 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:29:49 user nova-compute[74776]:   </clock>
Nov 22 14:29:49 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:29:49 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:29:49 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:29:49 user nova-compute[74776]:   </cpu>
Nov 22 14:29:49 user nova-compute[74776]:   <devices>
Nov 22 14:29:49 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:29:49 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:29:49 user nova-compute[74776]:       <source dev="/dev/sdc"/>
Nov 22 14:29:49 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:29:49 user nova-compute[74776]:       <serial>7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3</serial>
Nov 22 14:29:49 user nova-compute[74776]:     </disk>
Nov 22 14:29:49 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:29:49 user nova-compute[74776]:       <mac address="fa:16:3e:c0:9f:55"/>
Nov 22 14:29:49 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:29:49 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:29:49 user nova-compute[74776]:       <target dev="tap414f82bf-34"/>
Nov 22 14:29:49 user nova-compute[74776]:     </interface>
Nov 22 14:29:49 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:29:49 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/245ff2b1-5e87-4756-b4c1-86a2fea089a5/console.log" append="off"/>
Nov 22 14:29:49 user nova-compute[74776]:     </serial>
Nov 22 14:29:49 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:29:49 user nova-compute[74776]:     <video>
Nov 22 14:29:49 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:29:49 user nova-compute[74776]:     </video>
Nov 22 14:29:49 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:29:49 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:29:49 user nova-compute[74776]:     </rng>
Nov 22 14:29:49 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:29:49 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:29:49 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:29:49 user nova-compute[74776]:     </memballoon>
Nov 22 14:29:49 user nova-compute[74776]:   </devices>
Nov 22 14:29:49 user nova-compute[74776]: </domain>
Nov 22 14:29:49 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-10125610',display_name='tempest-ServerActionsTestOtherA-server-10125610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-10125610',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+0/ONa93QEWt5XODlWdDhT3U9g8+KkiNeYX5RdCfVnODI9hDpQVCexgtOudugmxzZAzaK3M5HeFwSkQ11sjSni+XdF+kkALoXukp/BrvBbOU8ZVGgWEOMKJnkhO9ZxRw==',key_name='tempest-keypair-1736172995',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:27:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a3958d7be91b4bb1b9e314d8867cd8f5',ramdisk_id='',reservation_id='r-n2u0p23v',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-109524404',owner_user_name='tempest-ServerActionsTestOtherA-109524404-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:29:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f703bfbe762447778429bda22b74505c',uuid=245ff2b1-5e87-4756-b4c1-86a2fea089a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2027168286-network", "vif_mac": "fa:16:3e:c0:9f:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converting VIF {"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2027168286-network", "vif_mac": "fa:16:3e:c0:9f:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:9f:55,bridge_name='br-int',has_traffic_filtering=True,id=414f82bf-343b-4e38-bc14-6af797152ea5,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap414f82bf-34') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG os_vif [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:9f:55,bridge_name='br-int',has_traffic_filtering=True,id=414f82bf-343b-4e38-bc14-6af797152ea5,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap414f82bf-34') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9242ce82-37e2-5a2d-890f-828130d45777', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap414f82bf-34, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap414f82bf-34, col_values=(('qos', UUID('9093efe6-77d6-4cd4-bb97-883d89eccc11')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap414f82bf-34, col_values=(('external_ids', {'iface-id': '414f82bf-343b-4e38-bc14-6af797152ea5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:9f:55', 'vm-uuid': '245ff2b1-5e87-4756-b4c1-86a2fea089a5'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:49 user nova-compute[74776]: INFO os_vif [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:9f:55,bridge_name='br-int',has_traffic_filtering=True,id=414f82bf-343b-4e38-bc14-6af797152ea5,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap414f82bf-34')
Nov 22 14:29:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:29:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] No VIF found with MAC fa:16:3e:c0:9f:55, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:29:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-c227dcb1-32d5-4722-9f36-17f4ee4896f7 req-ed0b9664-a81a-4305-8892-a2b031c0c44c service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received event network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:29:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c227dcb1-32d5-4722-9f36-17f4ee4896f7 req-ed0b9664-a81a-4305-8892-a2b031c0c44c service nova] Acquiring lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c227dcb1-32d5-4722-9f36-17f4ee4896f7 req-ed0b9664-a81a-4305-8892-a2b031c0c44c service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c227dcb1-32d5-4722-9f36-17f4ee4896f7 req-ed0b9664-a81a-4305-8892-a2b031c0c44c service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-c227dcb1-32d5-4722-9f36-17f4ee4896f7 req-ed0b9664-a81a-4305-8892-a2b031c0c44c service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] No waiting events found dispatching network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:29:50 user nova-compute[74776]: WARNING nova.compute.manager [req-c227dcb1-32d5-4722-9f36-17f4ee4896f7 req-ed0b9664-a81a-4305-8892-a2b031c0c44c service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received unexpected event network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 for instance with vm_state active and task_state resize_finish.
Nov 22 14:29:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:52 user nova-compute[74776]: DEBUG nova.compute.manager [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:29:52 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Instance running successfully.
Nov 22 14:29:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Failed to set time: agent not configured {{(pid=74776) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 22 14:29:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-262a7123-0f98-4c41-a604-6cfd11798289 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] finish_migration finished successfully. {{(pid=74776) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 22 14:29:52 user nova-compute[74776]: DEBUG nova.compute.manager [req-dfd77811-b64b-4193-955e-11df5a24c21c req-d4655b11-8616-4264-8773-4b7de7057f99 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received event network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:29:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dfd77811-b64b-4193-955e-11df5a24c21c req-d4655b11-8616-4264-8773-4b7de7057f99 service nova] Acquiring lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:29:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dfd77811-b64b-4193-955e-11df5a24c21c req-d4655b11-8616-4264-8773-4b7de7057f99 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:29:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dfd77811-b64b-4193-955e-11df5a24c21c req-d4655b11-8616-4264-8773-4b7de7057f99 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:29:52 user nova-compute[74776]: DEBUG nova.compute.manager [req-dfd77811-b64b-4193-955e-11df5a24c21c req-d4655b11-8616-4264-8773-4b7de7057f99 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] No waiting events found dispatching network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:29:52 user nova-compute[74776]: WARNING nova.compute.manager [req-dfd77811-b64b-4193-955e-11df5a24c21c req-d4655b11-8616-4264-8773-4b7de7057f99 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received unexpected event network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 for instance with vm_state active and task_state resize_finish.
Nov 22 14:29:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:29:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "47d7c0f7-8496-4766-8717-5da631f7c94b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "47d7c0f7-8496-4766-8717-5da631f7c94b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:07 user nova-compute[74776]: DEBUG nova.compute.manager [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:30:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:07 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:30:07 user nova-compute[74776]: INFO nova.compute.claims [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Claim successful on node user
Nov 22 14:30:08 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:30:08 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:30:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:08 user nova-compute[74776]: DEBUG nova.compute.manager [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:30:08 user nova-compute[74776]: DEBUG nova.compute.manager [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:30:08 user nova-compute[74776]: DEBUG nova.network.neutron [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:30:08 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:30:08 user nova-compute[74776]: DEBUG nova.compute.manager [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:30:08 user nova-compute[74776]: DEBUG nova.policy [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd5bd7dac415438898e5773c1722f633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae8f6ccdd1d4762945614272ca75a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:30:08 user nova-compute[74776]: DEBUG nova.compute.manager [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:30:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:30:08 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Creating image(s)
Nov 22 14:30:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "/opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "/opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "/opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.168s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk 1073741824" returned: 0 in 0.049s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:09 user nova-compute[74776]: DEBUG nova.network.neutron [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Successfully created port: cfc90514-d813-4c8e-8f0a-2f538ea95e23 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:30:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:09 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:30:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:09 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Cannot resize image /opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:30:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:30:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Ensure instance console log exists: /opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:30:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:09 user nova-compute[74776]: DEBUG nova.network.neutron [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Successfully updated port: cfc90514-d813-4c8e-8f0a-2f538ea95e23 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:30:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "refresh_cache-47d7c0f7-8496-4766-8717-5da631f7c94b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:30:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquired lock "refresh_cache-47d7c0f7-8496-4766-8717-5da631f7c94b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:30:09 user nova-compute[74776]: DEBUG nova.network.neutron [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:30:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-bac4beaa-1449-46fe-be0a-8c25c1d12746 req-d44c064b-bb02-4c6d-8770-21b29a6b90c0 service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Received event network-changed-cfc90514-d813-4c8e-8f0a-2f538ea95e23 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:30:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-bac4beaa-1449-46fe-be0a-8c25c1d12746 req-d44c064b-bb02-4c6d-8770-21b29a6b90c0 service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Refreshing instance network info cache due to event network-changed-cfc90514-d813-4c8e-8f0a-2f538ea95e23. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:30:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-bac4beaa-1449-46fe-be0a-8c25c1d12746 req-d44c064b-bb02-4c6d-8770-21b29a6b90c0 service nova] Acquiring lock "refresh_cache-47d7c0f7-8496-4766-8717-5da631f7c94b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:30:09 user nova-compute[74776]: DEBUG nova.network.neutron [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.network.neutron [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Updating instance_info_cache with network_info: [{"id": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "address": "fa:16:3e:8c:2c:13", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc90514-d8", "ovs_interfaceid": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Releasing lock "refresh_cache-47d7c0f7-8496-4766-8717-5da631f7c94b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.compute.manager [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Instance network_info: |[{"id": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "address": "fa:16:3e:8c:2c:13", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc90514-d8", "ovs_interfaceid": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-bac4beaa-1449-46fe-be0a-8c25c1d12746 req-d44c064b-bb02-4c6d-8770-21b29a6b90c0 service nova] Acquired lock "refresh_cache-47d7c0f7-8496-4766-8717-5da631f7c94b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.network.neutron [req-bac4beaa-1449-46fe-be0a-8c25c1d12746 req-d44c064b-bb02-4c6d-8770-21b29a6b90c0 service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Refreshing network info cache for port cfc90514-d813-4c8e-8f0a-2f538ea95e23 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Start _get_guest_xml network_info=[{"id": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "address": "fa:16:3e:8c:2c:13", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc90514-d8", "ovs_interfaceid": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:30:10 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:30:10 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-598607464',display_name='tempest-VolumesSnapshotTestJSON-instance-598607464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-598607464',id=31,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDljD+FSmdMWcx1E6rLDkjQR+9RokL1HmEtebKXkYwxnY89g6UJHOC+gycAJB4jMzVrFb6ZPCtAqKj4Q/G9X3o/T3iQoUdghdtexny+PwvEN7ucEyG3fxmvbnzjcBCPMaQ==',key_name='tempest-keypair-1324158616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ae8f6ccdd1d4762945614272ca75a1c',ramdisk_id='',reservation_id='r-ypo4oxmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1416311759',owner_user_name='tempest-VolumesSnapshotTestJSON-1416311759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:30:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd5bd7dac415438898e5773c1722f633',uuid=47d7c0f7-8496-4766-8717-5da631f7c94b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "address": "fa:16:3e:8c:2c:13", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc90514-d8", "ovs_interfaceid": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Converting VIF {"id": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "address": "fa:16:3e:8c:2c:13", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc90514-d8", "ovs_interfaceid": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:2c:13,bridge_name='br-int',has_traffic_filtering=True,id=cfc90514-d813-4c8e-8f0a-2f538ea95e23,network=Network(e38b6baa-4dea-488c-ad93-634cb26fdb5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfc90514-d8') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.objects.instance [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lazy-loading 'pci_devices' on Instance uuid 47d7c0f7-8496-4766-8717-5da631f7c94b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:30:10 user nova-compute[74776]:   <uuid>47d7c0f7-8496-4766-8717-5da631f7c94b</uuid>
Nov 22 14:30:10 user nova-compute[74776]:   <name>instance-0000001f</name>
Nov 22 14:30:10 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:30:10 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:30:10 user nova-compute[74776]:   <metadata>
Nov 22 14:30:10 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:30:10 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:30:10 user nova-compute[74776]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-598607464</nova:name>
Nov 22 14:30:10 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:30:10</nova:creationTime>
Nov 22 14:30:10 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:30:10 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:30:10 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:30:10 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:30:10 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:30:10 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:30:10 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:30:10 user nova-compute[74776]:       <nova:owner>
Nov 22 14:30:10 user nova-compute[74776]:         <nova:user uuid="bd5bd7dac415438898e5773c1722f633">tempest-VolumesSnapshotTestJSON-1416311759-project-member</nova:user>
Nov 22 14:30:10 user nova-compute[74776]:         <nova:project uuid="1ae8f6ccdd1d4762945614272ca75a1c">tempest-VolumesSnapshotTestJSON-1416311759</nova:project>
Nov 22 14:30:10 user nova-compute[74776]:       </nova:owner>
Nov 22 14:30:10 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:30:10 user nova-compute[74776]:       <nova:ports>
Nov 22 14:30:10 user nova-compute[74776]:         <nova:port uuid="cfc90514-d813-4c8e-8f0a-2f538ea95e23">
Nov 22 14:30:10 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 14:30:10 user nova-compute[74776]:         </nova:port>
Nov 22 14:30:10 user nova-compute[74776]:       </nova:ports>
Nov 22 14:30:10 user nova-compute[74776]:     </nova:instance>
Nov 22 14:30:10 user nova-compute[74776]:   </metadata>
Nov 22 14:30:10 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:30:10 user nova-compute[74776]:     <system>
Nov 22 14:30:10 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:30:10 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:30:10 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:30:10 user nova-compute[74776]:       <entry name="serial">47d7c0f7-8496-4766-8717-5da631f7c94b</entry>
Nov 22 14:30:10 user nova-compute[74776]:       <entry name="uuid">47d7c0f7-8496-4766-8717-5da631f7c94b</entry>
Nov 22 14:30:10 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:30:10 user nova-compute[74776]:     </system>
Nov 22 14:30:10 user nova-compute[74776]:   </sysinfo>
Nov 22 14:30:10 user nova-compute[74776]:   <os>
Nov 22 14:30:10 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:30:10 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:30:10 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:30:10 user nova-compute[74776]:   </os>
Nov 22 14:30:10 user nova-compute[74776]:   <features>
Nov 22 14:30:10 user nova-compute[74776]:     <acpi/>
Nov 22 14:30:10 user nova-compute[74776]:     <apic/>
Nov 22 14:30:10 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:30:10 user nova-compute[74776]:   </features>
Nov 22 14:30:10 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:30:10 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:30:10 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:30:10 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:30:10 user nova-compute[74776]:   </clock>
Nov 22 14:30:10 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:30:10 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:30:10 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:30:10 user nova-compute[74776]:   </cpu>
Nov 22 14:30:10 user nova-compute[74776]:   <devices>
Nov 22 14:30:10 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:30:10 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:30:10 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk"/>
Nov 22 14:30:10 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:30:10 user nova-compute[74776]:     </disk>
Nov 22 14:30:10 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:30:10 user nova-compute[74776]:       <mac address="fa:16:3e:8c:2c:13"/>
Nov 22 14:30:10 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:30:10 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:30:10 user nova-compute[74776]:       <target dev="tapcfc90514-d8"/>
Nov 22 14:30:10 user nova-compute[74776]:     </interface>
Nov 22 14:30:10 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:30:10 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/console.log" append="off"/>
Nov 22 14:30:10 user nova-compute[74776]:     </serial>
Nov 22 14:30:10 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:30:10 user nova-compute[74776]:     <video>
Nov 22 14:30:10 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:30:10 user nova-compute[74776]:     </video>
Nov 22 14:30:10 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:30:10 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:30:10 user nova-compute[74776]:     </rng>
Nov 22 14:30:10 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:30:10 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:30:10 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:30:10 user nova-compute[74776]:     </memballoon>
Nov 22 14:30:10 user nova-compute[74776]:   </devices>
Nov 22 14:30:10 user nova-compute[74776]: </domain>
Nov 22 14:30:10 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-598607464',display_name='tempest-VolumesSnapshotTestJSON-instance-598607464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-598607464',id=31,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDljD+FSmdMWcx1E6rLDkjQR+9RokL1HmEtebKXkYwxnY89g6UJHOC+gycAJB4jMzVrFb6ZPCtAqKj4Q/G9X3o/T3iQoUdghdtexny+PwvEN7ucEyG3fxmvbnzjcBCPMaQ==',key_name='tempest-keypair-1324158616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ae8f6ccdd1d4762945614272ca75a1c',ramdisk_id='',reservation_id='r-ypo4oxmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1416311759',owner_user_name='tempest-VolumesSnapshotTestJSON-1416311759-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:30:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd5bd7dac415438898e5773c1722f633',uuid=47d7c0f7-8496-4766-8717-5da631f7c94b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "address": "fa:16:3e:8c:2c:13", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc90514-d8", "ovs_interfaceid": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Converting VIF {"id": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "address": "fa:16:3e:8c:2c:13", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc90514-d8", "ovs_interfaceid": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:2c:13,bridge_name='br-int',has_traffic_filtering=True,id=cfc90514-d813-4c8e-8f0a-2f538ea95e23,network=Network(e38b6baa-4dea-488c-ad93-634cb26fdb5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfc90514-d8') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG os_vif [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:2c:13,bridge_name='br-int',has_traffic_filtering=True,id=cfc90514-d813-4c8e-8f0a-2f538ea95e23,network=Network(e38b6baa-4dea-488c-ad93-634cb26fdb5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfc90514-d8') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ace2d73-f993-5fd5-b34b-fab7026c8c3c', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfc90514-d8, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcfc90514-d8, col_values=(('qos', UUID('4813da50-d104-4d68-b571-2f2904bb16f6')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcfc90514-d8, col_values=(('external_ids', {'iface-id': 'cfc90514-d813-4c8e-8f0a-2f538ea95e23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:2c:13', 'vm-uuid': '47d7c0f7-8496-4766-8717-5da631f7c94b'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:10 user nova-compute[74776]: INFO os_vif [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:2c:13,bridge_name='br-int',has_traffic_filtering=True,id=cfc90514-d813-4c8e-8f0a-2f538ea95e23,network=Network(e38b6baa-4dea-488c-ad93-634cb26fdb5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfc90514-d8')
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] No VIF found with MAC fa:16:3e:8c:2c:13, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.network.neutron [req-bac4beaa-1449-46fe-be0a-8c25c1d12746 req-d44c064b-bb02-4c6d-8770-21b29a6b90c0 service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Updated VIF entry in instance network info cache for port cfc90514-d813-4c8e-8f0a-2f538ea95e23. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG nova.network.neutron [req-bac4beaa-1449-46fe-be0a-8c25c1d12746 req-d44c064b-bb02-4c6d-8770-21b29a6b90c0 service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Updating instance_info_cache with network_info: [{"id": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "address": "fa:16:3e:8c:2c:13", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc90514-d8", "ovs_interfaceid": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-bac4beaa-1449-46fe-be0a-8c25c1d12746 req-d44c064b-bb02-4c6d-8770-21b29a6b90c0 service nova] Releasing lock "refresh_cache-47d7c0f7-8496-4766-8717-5da631f7c94b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:30:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:11 user nova-compute[74776]: DEBUG nova.compute.manager [req-1338b5a2-4a1b-41eb-be32-26c56060dbd3 req-550975df-fb3a-46de-babf-15c947083448 service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Received event network-vif-plugged-cfc90514-d813-4c8e-8f0a-2f538ea95e23 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:30:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1338b5a2-4a1b-41eb-be32-26c56060dbd3 req-550975df-fb3a-46de-babf-15c947083448 service nova] Acquiring lock "47d7c0f7-8496-4766-8717-5da631f7c94b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1338b5a2-4a1b-41eb-be32-26c56060dbd3 req-550975df-fb3a-46de-babf-15c947083448 service nova] Lock "47d7c0f7-8496-4766-8717-5da631f7c94b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1338b5a2-4a1b-41eb-be32-26c56060dbd3 req-550975df-fb3a-46de-babf-15c947083448 service nova] Lock "47d7c0f7-8496-4766-8717-5da631f7c94b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:11 user nova-compute[74776]: DEBUG nova.compute.manager [req-1338b5a2-4a1b-41eb-be32-26c56060dbd3 req-550975df-fb3a-46de-babf-15c947083448 service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] No waiting events found dispatching network-vif-plugged-cfc90514-d813-4c8e-8f0a-2f538ea95e23 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:30:11 user nova-compute[74776]: WARNING nova.compute.manager [req-1338b5a2-4a1b-41eb-be32-26c56060dbd3 req-550975df-fb3a-46de-babf-15c947083448 service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Received unexpected event network-vif-plugged-cfc90514-d813-4c8e-8f0a-2f538ea95e23 for instance with vm_state building and task_state spawning.
Nov 22 14:30:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "771e2959-789e-4ef0-a4c9-052cdfa13b00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "771e2959-789e-4ef0-a4c9-052cdfa13b00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "771e2959-789e-4ef0-a4c9-052cdfa13b00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "771e2959-789e-4ef0-a4c9-052cdfa13b00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "771e2959-789e-4ef0-a4c9-052cdfa13b00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:12 user nova-compute[74776]: INFO nova.compute.manager [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Terminating instance
Nov 22 14:30:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:30:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-4ac6f4fd-5b75-4d47-be05-ab7c8b7e6957 req-68b6c066-41d5-422d-be28-04d3080214ce service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Received event network-vif-unplugged-6117aba3-000f-40a8-9444-33c3d9b7ae6b {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:30:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4ac6f4fd-5b75-4d47-be05-ab7c8b7e6957 req-68b6c066-41d5-422d-be28-04d3080214ce service nova] Acquiring lock "771e2959-789e-4ef0-a4c9-052cdfa13b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4ac6f4fd-5b75-4d47-be05-ab7c8b7e6957 req-68b6c066-41d5-422d-be28-04d3080214ce service nova] Lock "771e2959-789e-4ef0-a4c9-052cdfa13b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4ac6f4fd-5b75-4d47-be05-ab7c8b7e6957 req-68b6c066-41d5-422d-be28-04d3080214ce service nova] Lock "771e2959-789e-4ef0-a4c9-052cdfa13b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-4ac6f4fd-5b75-4d47-be05-ab7c8b7e6957 req-68b6c066-41d5-422d-be28-04d3080214ce service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] No waiting events found dispatching network-vif-unplugged-6117aba3-000f-40a8-9444-33c3d9b7ae6b {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:30:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-4ac6f4fd-5b75-4d47-be05-ab7c8b7e6957 req-68b6c066-41d5-422d-be28-04d3080214ce service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Received event network-vif-unplugged-6117aba3-000f-40a8-9444-33c3d9b7ae6b for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:30:13 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Instance destroyed successfully.
Nov 22 14:30:13 user nova-compute[74776]: DEBUG nova.objects.instance [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lazy-loading 'resources' on Instance uuid 771e2959-789e-4ef0-a4c9-052cdfa13b00 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:27:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-460436496',display_name='tempest-AttachVolumeNegativeTest-server-460436496',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-460436496',id=27,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGR1XvhjLp+f1KBHcU/oRHYRwppeeHyiYluMEHCr0oXoYvt15OWoFAHe71w3l5NSm+uvZHOVJK5ejlil7r3J86GuZT7EAuYFk49i74psTUJyzG0ofssZpOhv/x+uTSAEA==',key_name='tempest-keypair-2035396926',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:27:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dee58d331979425eb9d48d2a52fc1f68',ramdisk_id='',reservation_id='r-t7b13571',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-577275639',owner_user_name='tempest-AttachVolumeNegativeTest-577275639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:27:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1807bb240de749499809fd3dfb520d78',uuid=771e2959-789e-4ef0-a4c9-052cdfa13b00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "address": "fa:16:3e:c4:a7:2b", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6117aba3-00", "ovs_interfaceid": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converting VIF {"id": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "address": "fa:16:3e:c4:a7:2b", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6117aba3-00", "ovs_interfaceid": "6117aba3-000f-40a8-9444-33c3d9b7ae6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:a7:2b,bridge_name='br-int',has_traffic_filtering=True,id=6117aba3-000f-40a8-9444-33c3d9b7ae6b,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6117aba3-00') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG os_vif [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:a7:2b,bridge_name='br-int',has_traffic_filtering=True,id=6117aba3-000f-40a8-9444-33c3d9b7ae6b,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6117aba3-00') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6117aba3-00, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f9a560c-d96b-461c-b3c0-75372afd3c9b) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:13 user nova-compute[74776]: INFO os_vif [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:a7:2b,bridge_name='br-int',has_traffic_filtering=True,id=6117aba3-000f-40a8-9444-33c3d9b7ae6b,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6117aba3-00')
Nov 22 14:30:13 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Deleting instance files /opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00_del
Nov 22 14:30:13 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Deletion of /opt/stack/data/nova/instances/771e2959-789e-4ef0-a4c9-052cdfa13b00_del complete
Nov 22 14:30:13 user nova-compute[74776]: INFO nova.compute.manager [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 22 14:30:13 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG nova.compute.manager [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:30:13 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Instance spawned successfully.
Nov 22 14:30:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:30:13 user nova-compute[74776]: INFO nova.compute.manager [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 22 14:30:13 user nova-compute[74776]: DEBUG nova.compute.manager [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG nova.compute.manager [req-03141a16-0c25-42e1-93a4-ebb28a3f5a93 req-7689e072-70e0-4c00-91a0-0e5d27645eaa service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Received event network-vif-plugged-cfc90514-d813-4c8e-8f0a-2f538ea95e23 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-03141a16-0c25-42e1-93a4-ebb28a3f5a93 req-7689e072-70e0-4c00-91a0-0e5d27645eaa service nova] Acquiring lock "47d7c0f7-8496-4766-8717-5da631f7c94b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-03141a16-0c25-42e1-93a4-ebb28a3f5a93 req-7689e072-70e0-4c00-91a0-0e5d27645eaa service nova] Lock "47d7c0f7-8496-4766-8717-5da631f7c94b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-03141a16-0c25-42e1-93a4-ebb28a3f5a93 req-7689e072-70e0-4c00-91a0-0e5d27645eaa service nova] Lock "47d7c0f7-8496-4766-8717-5da631f7c94b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:13 user nova-compute[74776]: DEBUG nova.compute.manager [req-03141a16-0c25-42e1-93a4-ebb28a3f5a93 req-7689e072-70e0-4c00-91a0-0e5d27645eaa service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] No waiting events found dispatching network-vif-plugged-cfc90514-d813-4c8e-8f0a-2f538ea95e23 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:30:13 user nova-compute[74776]: WARNING nova.compute.manager [req-03141a16-0c25-42e1-93a4-ebb28a3f5a93 req-7689e072-70e0-4c00-91a0-0e5d27645eaa service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Received unexpected event network-vif-plugged-cfc90514-d813-4c8e-8f0a-2f538ea95e23 for instance with vm_state building and task_state spawning.
Nov 22 14:30:13 user nova-compute[74776]: INFO nova.compute.manager [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Took 6.14 seconds to build instance.
Nov 22 14:30:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-42c64c4b-bbc6-4529-849c-fd7d010d90fb tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "47d7c0f7-8496-4766-8717-5da631f7c94b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.231s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:14 user nova-compute[74776]: INFO nova.compute.manager [None req-f3149ce1-16d7-4720-a405-3c6136edc168 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Unrescuing
Nov 22 14:30:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3149ce1-16d7-4720-a405-3c6136edc168 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "refresh_cache-bc98341b-ca28-4097-9887-16c8e8d7f9f7" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:30:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3149ce1-16d7-4720-a405-3c6136edc168 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquired lock "refresh_cache-bc98341b-ca28-4097-9887-16c8e8d7f9f7" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:30:14 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f3149ce1-16d7-4720-a405-3c6136edc168 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:30:14 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:30:14 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Took 0.76 seconds to deallocate network for instance.
Nov 22 14:30:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:14 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f3149ce1-16d7-4720-a405-3c6136edc168 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Updating instance_info_cache with network_info: [{"id": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "address": "fa:16:3e:5f:fc:12", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cec0cf0-89", "ovs_interfaceid": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:30:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3149ce1-16d7-4720-a405-3c6136edc168 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Releasing lock "refresh_cache-bc98341b-ca28-4097-9887-16c8e8d7f9f7" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:30:14 user nova-compute[74776]: DEBUG nova.objects.instance [None req-f3149ce1-16d7-4720-a405-3c6136edc168 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'flavor' on Instance uuid bc98341b-ca28-4097-9887-16c8e8d7f9f7 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:30:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:14 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:30:14 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:30:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:14 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Deleted allocations for instance 771e2959-789e-4ef0-a4c9-052cdfa13b00
Nov 22 14:30:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-6e73084e-7c28-4724-8955-1988394d9d1b req-89ab1898-1c2d-42ca-b5ec-1a56ef086fde service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Received event network-vif-plugged-6117aba3-000f-40a8-9444-33c3d9b7ae6b {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:30:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6e73084e-7c28-4724-8955-1988394d9d1b req-89ab1898-1c2d-42ca-b5ec-1a56ef086fde service nova] Acquiring lock "771e2959-789e-4ef0-a4c9-052cdfa13b00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6e73084e-7c28-4724-8955-1988394d9d1b req-89ab1898-1c2d-42ca-b5ec-1a56ef086fde service nova] Lock "771e2959-789e-4ef0-a4c9-052cdfa13b00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6e73084e-7c28-4724-8955-1988394d9d1b req-89ab1898-1c2d-42ca-b5ec-1a56ef086fde service nova] Lock "771e2959-789e-4ef0-a4c9-052cdfa13b00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-6e73084e-7c28-4724-8955-1988394d9d1b req-89ab1898-1c2d-42ca-b5ec-1a56ef086fde service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] No waiting events found dispatching network-vif-plugged-6117aba3-000f-40a8-9444-33c3d9b7ae6b {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:30:14 user nova-compute[74776]: WARNING nova.compute.manager [req-6e73084e-7c28-4724-8955-1988394d9d1b req-89ab1898-1c2d-42ca-b5ec-1a56ef086fde service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Received unexpected event network-vif-plugged-6117aba3-000f-40a8-9444-33c3d9b7ae6b for instance with vm_state deleted and task_state None.
Nov 22 14:30:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e6df6443-45a0-4ca2-b06f-24de5be90224 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "771e2959-789e-4ef0-a4c9-052cdfa13b00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.348s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:15 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Instance destroyed successfully.
Nov 22 14:30:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:15 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG nova.compute.manager [req-9732c766-5dbc-4e11-8f7e-e7ac4b1096c6 req-b0fadde3-fdd5-479a-9f86-f621cc2d1908 service nova] [instance: 771e2959-789e-4ef0-a4c9-052cdfa13b00] Received event network-vif-deleted-6117aba3-000f-40a8-9444-33c3d9b7ae6b {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG nova.compute.manager [req-9732c766-5dbc-4e11-8f7e-e7ac4b1096c6 req-b0fadde3-fdd5-479a-9f86-f621cc2d1908 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received event network-vif-unplugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9732c766-5dbc-4e11-8f7e-e7ac4b1096c6 req-b0fadde3-fdd5-479a-9f86-f621cc2d1908 service nova] Acquiring lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9732c766-5dbc-4e11-8f7e-e7ac4b1096c6 req-b0fadde3-fdd5-479a-9f86-f621cc2d1908 service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9732c766-5dbc-4e11-8f7e-e7ac4b1096c6 req-b0fadde3-fdd5-479a-9f86-f621cc2d1908 service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG nova.compute.manager [req-9732c766-5dbc-4e11-8f7e-e7ac4b1096c6 req-b0fadde3-fdd5-479a-9f86-f621cc2d1908 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] No waiting events found dispatching network-vif-unplugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:30:16 user nova-compute[74776]: WARNING nova.compute.manager [req-9732c766-5dbc-4e11-8f7e-e7ac4b1096c6 req-b0fadde3-fdd5-479a-9f86-f621cc2d1908 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received unexpected event network-vif-unplugged-5cec0cf0-892c-4c30-ae08-7e127098bccf for instance with vm_state rescued and task_state unrescuing.
Nov 22 14:30:16 user nova-compute[74776]: DEBUG nova.compute.manager [req-9732c766-5dbc-4e11-8f7e-e7ac4b1096c6 req-b0fadde3-fdd5-479a-9f86-f621cc2d1908 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received event network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9732c766-5dbc-4e11-8f7e-e7ac4b1096c6 req-b0fadde3-fdd5-479a-9f86-f621cc2d1908 service nova] Acquiring lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9732c766-5dbc-4e11-8f7e-e7ac4b1096c6 req-b0fadde3-fdd5-479a-9f86-f621cc2d1908 service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9732c766-5dbc-4e11-8f7e-e7ac4b1096c6 req-b0fadde3-fdd5-479a-9f86-f621cc2d1908 service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG nova.compute.manager [req-9732c766-5dbc-4e11-8f7e-e7ac4b1096c6 req-b0fadde3-fdd5-479a-9f86-f621cc2d1908 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] No waiting events found dispatching network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:30:16 user nova-compute[74776]: WARNING nova.compute.manager [req-9732c766-5dbc-4e11-8f7e-e7ac4b1096c6 req-b0fadde3-fdd5-479a-9f86-f621cc2d1908 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received unexpected event network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf for instance with vm_state rescued and task_state unrescuing.
Nov 22 14:30:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "016bf051-9034-4124-948d-995aacf77caf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "016bf051-9034-4124-948d-995aacf77caf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:16 user nova-compute[74776]: INFO nova.compute.manager [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Detaching volume 277635d3-2b9a-4405-a753-9d13911445a9
Nov 22 14:30:16 user nova-compute[74776]: INFO nova.virt.block_device [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Attempting to driver detach volume 277635d3-2b9a-4405-a753-9d13911445a9 from mountpoint /dev/vdc
Nov 22 14:30:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Attempting to detach device vdc from instance 016bf051-9034-4124-948d-995aacf77caf from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:30:16 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:30:16 user nova-compute[74776]:   <source dev="/dev/sde"/>
Nov 22 14:30:16 user nova-compute[74776]:   <target dev="vdc" bus="virtio"/>
Nov 22 14:30:16 user nova-compute[74776]:   <serial>277635d3-2b9a-4405-a753-9d13911445a9</serial>
Nov 22 14:30:16 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 14:30:16 user nova-compute[74776]: </disk>
Nov 22 14:30:16 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:30:16 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Successfully detached device vdc from instance 016bf051-9034-4124-948d-995aacf77caf from the persistent domain config.
Nov 22 14:30:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 016bf051-9034-4124-948d-995aacf77caf from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:30:16 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:30:16 user nova-compute[74776]:   <source dev="/dev/sde"/>
Nov 22 14:30:16 user nova-compute[74776]:   <target dev="vdc" bus="virtio"/>
Nov 22 14:30:16 user nova-compute[74776]:   <serial>277635d3-2b9a-4405-a753-9d13911445a9</serial>
Nov 22 14:30:16 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 14:30:16 user nova-compute[74776]: </disk>
Nov 22 14:30:16 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-6f2ce4b2-660c-431f-b951-c6ec5090ef7e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-6f2ce4b2-660c-431f-b951-c6ec5090ef7e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 016bf051-9034-4124-948d-995aacf77caf {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:30:17 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Updating instance_info_cache with network_info: [{"id": "c83b6599-820f-462a-bd26-af48014d7d7d", "address": "fa:16:3e:18:32:09", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b6599-82", "ovs_interfaceid": "c83b6599-820f-462a-bd26-af48014d7d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:30:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-6f2ce4b2-660c-431f-b951-c6ec5090ef7e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:30:17 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:30:17 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-5c38c83e-28b2-4d88-b37f-0aa84886d002 req-af47016c-48a3-4228-8d12-48aae023bf29 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received event network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5c38c83e-28b2-4d88-b37f-0aa84886d002 req-af47016c-48a3-4228-8d12-48aae023bf29 service nova] Acquiring lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5c38c83e-28b2-4d88-b37f-0aa84886d002 req-af47016c-48a3-4228-8d12-48aae023bf29 service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5c38c83e-28b2-4d88-b37f-0aa84886d002 req-af47016c-48a3-4228-8d12-48aae023bf29 service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-5c38c83e-28b2-4d88-b37f-0aa84886d002 req-af47016c-48a3-4228-8d12-48aae023bf29 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] No waiting events found dispatching network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:30:18 user nova-compute[74776]: WARNING nova.compute.manager [req-5c38c83e-28b2-4d88-b37f-0aa84886d002 req-af47016c-48a3-4228-8d12-48aae023bf29 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received unexpected event network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf for instance with vm_state rescued and task_state unrescuing.
Nov 22 14:30:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-5c38c83e-28b2-4d88-b37f-0aa84886d002 req-af47016c-48a3-4228-8d12-48aae023bf29 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received event network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5c38c83e-28b2-4d88-b37f-0aa84886d002 req-af47016c-48a3-4228-8d12-48aae023bf29 service nova] Acquiring lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5c38c83e-28b2-4d88-b37f-0aa84886d002 req-af47016c-48a3-4228-8d12-48aae023bf29 service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5c38c83e-28b2-4d88-b37f-0aa84886d002 req-af47016c-48a3-4228-8d12-48aae023bf29 service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-5c38c83e-28b2-4d88-b37f-0aa84886d002 req-af47016c-48a3-4228-8d12-48aae023bf29 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] No waiting events found dispatching network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:30:18 user nova-compute[74776]: WARNING nova.compute.manager [req-5c38c83e-28b2-4d88-b37f-0aa84886d002 req-af47016c-48a3-4228-8d12-48aae023bf29 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received unexpected event network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf for instance with vm_state rescued and task_state unrescuing.
Nov 22 14:30:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lazy-loading 'flavor' on Instance uuid 68b6744f-c29d-4ccd-83ab-fcc31666d69b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:18 user nova-compute[74776]: INFO nova.compute.manager [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Attaching volume d96ea52c-e306-43bc-b529-8a1b47ebfecb to /dev/vdb
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG os_brick.utils [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2523d26-4ef9-40d6-94ee-41b427773427]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b78499-910c-4b01-9b14-2c06d4407e3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0942b773-66f2-4cd6-8e11-3452909c6382]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[87781d45-d9f9-442f-a0cf-0cd2377f973c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:30:18 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:30:18 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e945426-273b-46ef-9539-ddf1b2a4b8f6]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG os_brick.utils [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:30:18 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Updating existing volume attachment record: 1b68c0cf-00b4-45bf-91a1-e8ebca1cf99e {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:30:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f3149ce1-16d7-4720-a405-3c6136edc168 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:30:19 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:30:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:30:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:30:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:30:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:30:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:23 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:30:23 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:30:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=7544MB free_disk=25.047340393066406GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:30:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Applying migration context for instance 245ff2b1-5e87-4756-b4c1-86a2fea089a5 as it has an incoming, in-progress migration 60b093a3-1b59-4ec2-94fa-f3f9d6307534. Migration status is finished {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 22 14:30:23 user nova-compute[74776]: INFO nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Updating resource usage from migration 60b093a3-1b59-4ec2-94fa-f3f9d6307534
Nov 22 14:30:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4629d82d-fd02-4a58-a535-b362b493e7c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:30:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 525baf66-82cc-4e8d-a37a-c92c51d4673d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:30:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6f2ce4b2-660c-431f-b951-c6ec5090ef7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:30:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f4f30fe7-b234-4f81-b081-3214f5ebe789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:30:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance bc98341b-ca28-4097-9887-16c8e8d7f9f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:30:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 68b6744f-c29d-4ccd-83ab-fcc31666d69b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:30:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 016bf051-9034-4124-948d-995aacf77caf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:30:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance d374cfe8-6d04-4c4e-9055-f46488a76ed8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:30:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance b30a5c6b-ea71-4a06-ad03-a02ebd584a80 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:30:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Migration 60b093a3-1b59-4ec2-94fa-f3f9d6307534 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 22 14:30:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 245ff2b1-5e87-4756-b4c1-86a2fea089a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:30:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 47d7c0f7-8496-4766-8717-5da631f7c94b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:30:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:30:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:30:24 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:30:24 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:30:24 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:30:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDefcdCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:30:25 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:30:25 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:30:25 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b43e15-6e66-4ef9-b659-2f821ca71a21]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:30:25 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8753831-4f8a-44f8-b4e9-ee6e74f878bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb] added
Nov 22 14:30:25 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0d9305-e04e-44a6-b397-ca16da185f30]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9900e2-9ce4-4708-bc46-42ff51010990]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QDefcdCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QDefcdCE" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbf3f3a-bd72-45db-a536-5d3d5caac647]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QDefcdCE'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edb337c-77b5-418e-9c2f-0b7b5f84940f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2f471d-79fe-41a9-8e67-708bf8d0d1f9]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:30:25 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:30:25 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:30:25 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:30:25 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:30:25 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:30:25 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:30:25 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:30:25 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f16ab75-9c4b-47d9-ab51-b3f5f1e9f4aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb, portal: 172.16.0.220,3260]
Nov 22 14:30:25 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb, portal: 172.16.0.220,3260] successful.
Nov 22 14:30:25 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3b826c-27ea-4b44-83d8-306b8a5d55cc]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8a5a5c-dcc3-4419-ad0b-971f885c3c70]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:30:25 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:30:25 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:30:25 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:30:25 user nova-compute[74776]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:30:25 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:30:25 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:30:25 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:30:25 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:30:25 user nova-compute[74776]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:30:25 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] HCTL ('37', '-', '-', 0) found on session 39 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[31082994-fcae-4660-9891-ff97aa3c9208]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Searching for a device in session 39 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDefcdCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:30:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:26 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:30:26 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23064663865346562', 'path': '/dev/sdf'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:30:26 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064663865346562', 'path': '/dev/sdf'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:30:26 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lazy-loading 'flavor' on Instance uuid 68b6744f-c29d-4ccd-83ab-fcc31666d69b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:30:26 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:30:26 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:30:26 user nova-compute[74776]:   <source dev="/dev/sdf"/>
Nov 22 14:30:26 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:30:26 user nova-compute[74776]:   <serial>d96ea52c-e306-43bc-b529-8a1b47ebfecb</serial>
Nov 22 14:30:26 user nova-compute[74776]: </disk>
Nov 22 14:30:26 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:30:26 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:30:26 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:30:26 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] No VIF found with MAC fa:16:3e:e9:fc:41, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:30:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7c285b1c-1dd9-4709-b1a7-3b3ec998b1b7 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.368s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:29 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:30:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:32 user nova-compute[74776]: DEBUG nova.compute.manager [req-43cc8cf0-9634-4f67-aa46-991a33280319 req-aa2a0ee4-816a-4267-91b9-bf43e8258a4f service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received event network-changed-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:30:32 user nova-compute[74776]: DEBUG nova.compute.manager [req-43cc8cf0-9634-4f67-aa46-991a33280319 req-aa2a0ee4-816a-4267-91b9-bf43e8258a4f service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Refreshing instance network info cache due to event network-changed-3c7c3d69-1226-4906-b2cb-bedf570f40ee. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:30:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-43cc8cf0-9634-4f67-aa46-991a33280319 req-aa2a0ee4-816a-4267-91b9-bf43e8258a4f service nova] Acquiring lock "refresh_cache-68b6744f-c29d-4ccd-83ab-fcc31666d69b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:30:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-43cc8cf0-9634-4f67-aa46-991a33280319 req-aa2a0ee4-816a-4267-91b9-bf43e8258a4f service nova] Acquired lock "refresh_cache-68b6744f-c29d-4ccd-83ab-fcc31666d69b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:30:32 user nova-compute[74776]: DEBUG nova.network.neutron [req-43cc8cf0-9634-4f67-aa46-991a33280319 req-aa2a0ee4-816a-4267-91b9-bf43e8258a4f service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Refreshing network info cache for port 3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:30:32 user nova-compute[74776]: DEBUG nova.network.neutron [req-43cc8cf0-9634-4f67-aa46-991a33280319 req-aa2a0ee4-816a-4267-91b9-bf43e8258a4f service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Updated VIF entry in instance network info cache for port 3c7c3d69-1226-4906-b2cb-bedf570f40ee. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:30:32 user nova-compute[74776]: DEBUG nova.network.neutron [req-43cc8cf0-9634-4f67-aa46-991a33280319 req-aa2a0ee4-816a-4267-91b9-bf43e8258a4f service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Updating instance_info_cache with network_info: [{"id": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "address": "fa:16:3e:e9:fc:41", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7c3d69-12", "ovs_interfaceid": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:30:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-43cc8cf0-9634-4f67-aa46-991a33280319 req-aa2a0ee4-816a-4267-91b9-bf43e8258a4f service nova] Releasing lock "refresh_cache-68b6744f-c29d-4ccd-83ab-fcc31666d69b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:30:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:34 user nova-compute[74776]: DEBUG nova.compute.manager [req-1152a626-2be0-41c8-94a1-892f0f49bffb req-c66b149e-bca0-4c5d-92c9-d550c32e3398 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received event network-changed-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:30:34 user nova-compute[74776]: DEBUG nova.compute.manager [req-1152a626-2be0-41c8-94a1-892f0f49bffb req-c66b149e-bca0-4c5d-92c9-d550c32e3398 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Refreshing instance network info cache due to event network-changed-3c7c3d69-1226-4906-b2cb-bedf570f40ee. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:30:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1152a626-2be0-41c8-94a1-892f0f49bffb req-c66b149e-bca0-4c5d-92c9-d550c32e3398 service nova] Acquiring lock "refresh_cache-68b6744f-c29d-4ccd-83ab-fcc31666d69b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:30:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1152a626-2be0-41c8-94a1-892f0f49bffb req-c66b149e-bca0-4c5d-92c9-d550c32e3398 service nova] Acquired lock "refresh_cache-68b6744f-c29d-4ccd-83ab-fcc31666d69b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:30:34 user nova-compute[74776]: DEBUG nova.network.neutron [req-1152a626-2be0-41c8-94a1-892f0f49bffb req-c66b149e-bca0-4c5d-92c9-d550c32e3398 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Refreshing network info cache for port 3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:30:34 user nova-compute[74776]: DEBUG nova.network.neutron [req-1152a626-2be0-41c8-94a1-892f0f49bffb req-c66b149e-bca0-4c5d-92c9-d550c32e3398 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Updated VIF entry in instance network info cache for port 3c7c3d69-1226-4906-b2cb-bedf570f40ee. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:30:34 user nova-compute[74776]: DEBUG nova.network.neutron [req-1152a626-2be0-41c8-94a1-892f0f49bffb req-c66b149e-bca0-4c5d-92c9-d550c32e3398 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Updating instance_info_cache with network_info: [{"id": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "address": "fa:16:3e:e9:fc:41", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7c3d69-12", "ovs_interfaceid": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:30:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1152a626-2be0-41c8-94a1-892f0f49bffb req-c66b149e-bca0-4c5d-92c9-d550c32e3398 service nova] Releasing lock "refresh_cache-68b6744f-c29d-4ccd-83ab-fcc31666d69b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:30:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:36 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 016bf051-9034-4124-948d-995aacf77caf is timed out.
Nov 22 14:30:36 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Successfully detached device vdc from instance 016bf051-9034-4124-948d-995aacf77caf from the live domain config.
Nov 22 14:30:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:30:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPlBSVwY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:30:36 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:30:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:30:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:30:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:36 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34fe731-da0e-4f04-87e6-86c391f7601e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:30:36 user nova-compute[74776]: No targets found.
Nov 22 14:30:36 user nova-compute[74776]: iSNS:
Nov 22 14:30:36 user nova-compute[74776]: No targets found.
Nov 22 14:30:36 user nova-compute[74776]: STATIC:
Nov 22 14:30:36 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9
Nov 22 14:30:36 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:30:36 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:30:36 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3
Nov 22 14:30:36 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:30:36 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:30:36 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a
Nov 22 14:30:36 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:30:36 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:30:36 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb
Nov 22 14:30:36 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:30:36 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:30:36 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71
Nov 22 14:30:36 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:30:36 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:30:36 user nova-compute[74776]: FIRMWARE:
Nov 22 14:30:36 user nova-compute[74776]: No targets found.
Nov 22 14:30:36 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:30:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:30:36 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:30:36 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:30:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:30:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a7617c-965b-4835-a9e6-33b4d3620e08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c010351-99b9-4265-a467-ecd406cfb26a]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:30:37 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:30:37 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:30:37 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:30:37 user nova-compute[74776]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:30:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:30:37 user nova-compute[74776]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 (non-flash)
Nov 22 14:30:37 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:30:37 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:30:37 user nova-compute[74776]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:30:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c78242cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9'): ({'sde'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Removing single pathed devices sde {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3c2ba6-e520-4a79-9dc3-3d866d4c9202]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccb9c36-449f-4d1a-8ed9-8b800c066c2c]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Flushing IO for device /dev/sde {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[158e7c66-0024-4305-b731-ffbb3e62d758]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9677afe-0999-4414-934c-13a6982ab7e4]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] SCSI volumes sde have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d13539-647d-4740-8fa1-1859913e2f5b]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4e3c86-7b0b-4d58-b7ee-b4a2bf06d454]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9, portal: 172.16.0.220,3260]
Nov 22 14:30:37 user nova-compute[74776]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9, portal: 172.16.0.220,3260] successful.
Nov 22 14:30:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:277635d3-2b9a-4405-a753-9d13911445a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[443fd09d-78dc-4a19-a98e-cc8f6bf2adfe]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] <== disconnect_volume: return (311ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:30:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:30:38 user nova-compute[74776]: DEBUG nova.objects.instance [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lazy-loading 'flavor' on Instance uuid 016bf051-9034-4124-948d-995aacf77caf {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:30:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-56cbb37e-cb7d-4cb5-806e-81a15c511ae9 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "016bf051-9034-4124-948d-995aacf77caf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.147s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:38 user nova-compute[74776]: INFO nova.compute.manager [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Rebooting instance
Nov 22 14:30:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "refresh_cache-68b6744f-c29d-4ccd-83ab-fcc31666d69b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:30:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquired lock "refresh_cache-68b6744f-c29d-4ccd-83ab-fcc31666d69b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:30:38 user nova-compute[74776]: DEBUG nova.network.neutron [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:30:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:38 user nova-compute[74776]: DEBUG nova.network.neutron [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Updating instance_info_cache with network_info: [{"id": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "address": "fa:16:3e:e9:fc:41", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7c3d69-12", "ovs_interfaceid": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:30:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Releasing lock "refresh_cache-68b6744f-c29d-4ccd-83ab-fcc31666d69b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:30:38 user nova-compute[74776]: DEBUG nova.compute.manager [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-e3e31566-442c-43ab-a197-e39cb8407f3f req-88f336ed-e61a-441a-81f1-2f1990343126 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received event network-vif-unplugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e3e31566-442c-43ab-a197-e39cb8407f3f req-88f336ed-e61a-441a-81f1-2f1990343126 service nova] Acquiring lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e3e31566-442c-43ab-a197-e39cb8407f3f req-88f336ed-e61a-441a-81f1-2f1990343126 service nova] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e3e31566-442c-43ab-a197-e39cb8407f3f req-88f336ed-e61a-441a-81f1-2f1990343126 service nova] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-e3e31566-442c-43ab-a197-e39cb8407f3f req-88f336ed-e61a-441a-81f1-2f1990343126 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] No waiting events found dispatching network-vif-unplugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:30:39 user nova-compute[74776]: WARNING nova.compute.manager [req-e3e31566-442c-43ab-a197-e39cb8407f3f req-88f336ed-e61a-441a-81f1-2f1990343126 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received unexpected event network-vif-unplugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee for instance with vm_state active and task_state reboot_started_hard.
Nov 22 14:30:39 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Instance destroyed successfully.
Nov 22 14:30:39 user nova-compute[74776]: DEBUG nova.objects.instance [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lazy-loading 'resources' on Instance uuid 68b6744f-c29d-4ccd-83ab-fcc31666d69b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:28:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-567453205',display_name='tempest-TestMinimumBasicScenario-server-567453205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-567453205',id=29,image_ref='410e18af-5ee2-4e1a-b884-991a4118fa51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeQ5l9gobrcB3GfFb8hElj7leJSJuwdi8KEucPTmUQGpAyFzhk+F3QsYUbzmVfcbUg0T9z6vSzM3sLT40eKIk3iKPtU/szyGW0f6KEHPn7TV4/Y4vJcTWqN8K0b2V6kYA==',key_name='tempest-TestMinimumBasicScenario-536055884',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:28:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2602b8e7e2414a3d88d18f9f0c973ab5',ramdisk_id='',reservation_id='r-lecfrx5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='410e18af-5ee2-4e1a-b884-991a4118fa51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1122910147',owner_user_name='tempest-TestMinimumBasicScenario-1122910147-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:30:39Z,user_data=None,user_id='aac47c7fc2fc4380a5673117151dbdb0',uuid=68b6744f-c29d-4ccd-83ab-fcc31666d69b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "address": "fa:16:3e:e9:fc:41", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7c3d69-12", "ovs_interfaceid": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Converting VIF {"id": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "address": "fa:16:3e:e9:fc:41", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7c3d69-12", "ovs_interfaceid": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:fc:41,bridge_name='br-int',has_traffic_filtering=True,id=3c7c3d69-1226-4906-b2cb-bedf570f40ee,network=Network(9ede03a9-ae5e-43f2-9865-595667d6d899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7c3d69-12') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG os_vif [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:fc:41,bridge_name='br-int',has_traffic_filtering=True,id=3c7c3d69-1226-4906-b2cb-bedf570f40ee,network=Network(9ede03a9-ae5e-43f2-9865-595667d6d899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7c3d69-12') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c7c3d69-12, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9f4846b-f734-4d5f-bd78-59a09f927f17) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:39 user nova-compute[74776]: INFO os_vif [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:fc:41,bridge_name='br-int',has_traffic_filtering=True,id=3c7c3d69-1226-4906-b2cb-bedf570f40ee,network=Network(9ede03a9-ae5e-43f2-9865-595667d6d899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7c3d69-12')
Nov 22 14:30:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDefcdCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:30:39 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:30:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[915b681f-73bc-4a78-b301-3b91e49e1aef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:30:39 user nova-compute[74776]: No targets found.
Nov 22 14:30:39 user nova-compute[74776]: iSNS:
Nov 22 14:30:39 user nova-compute[74776]: No targets found.
Nov 22 14:30:39 user nova-compute[74776]: STATIC:
Nov 22 14:30:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3
Nov 22 14:30:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:30:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:30:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a
Nov 22 14:30:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:30:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:30:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb
Nov 22 14:30:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:30:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:30:39 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71
Nov 22 14:30:39 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:30:39 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:30:39 user nova-compute[74776]: FIRMWARE:
Nov 22 14:30:39 user nova-compute[74776]: No targets found.
Nov 22 14:30:39 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:30:39 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:30:39 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9ffe60-e0ce-4fe6-8fb2-f31d247ee6a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efd5d7f-30c8-44ce-ab2f-861d99fea9c1]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:30:39 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:30:39 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:30:39 user nova-compute[74776]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:30:39 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:30:39 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:30:39 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:30:39 user nova-compute[74776]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:30:39 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c581feb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb'): ({'sdf'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Removing single pathed devices sdf {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd33535-d8de-44ce-9648-9a2e37b30eb4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[47569953-75b5-48f8-8d79-5019fccc148d]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Flushing IO for device /dev/sdf {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba00ff0-8761-4d9b-b0e2-6fab7831beb2]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.031s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e483440e-6be6-4fca-bb98-6048232c5a82]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] SCSI volumes sdf have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c1698d-8bef-4af6-8107-f6f049bfca46]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e92687-3141-4b25-a1f7-3186f118a18a]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb, portal: 172.16.0.220,3260]
Nov 22 14:30:40 user nova-compute[74776]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb, portal: 172.16.0.220,3260] successful.
Nov 22 14:30:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bae99f-3a99-46f1-87e5-a9f168122134]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] <== disconnect_volume: return (285ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Start _get_guest_xml network_info=[{"id": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "address": "fa:16:3e:e9:fc:41", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7c3d69-12", "ovs_interfaceid": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=410e18af-5ee2-4e1a-b884-991a4118fa51,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': '410e18af-5ee2-4e1a-b884-991a4118fa51'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1b68c0cf-00b4-45bf-91a1-e8ebca1cf99e', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDefcdCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '68b6744f-c29d-4ccd-83ab-fcc31666d69b', 'attached_at': '', 'detached_at': '', 'volume_id': 'd96ea52c-e306-43bc-b529-8a1b47ebfecb', 'serial': 'd96ea52c-e306-43bc-b529-8a1b47ebfecb'}, 'boot_index': None, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:30:40 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:30:40 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:30:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=410e18af-5ee2-4e1a-b884-991a4118fa51,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG nova.objects.instance [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lazy-loading 'vcpu_model' on Instance uuid 68b6744f-c29d-4ccd-83ab-fcc31666d69b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG nova.objects.base [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Object Instance<68b6744f-c29d-4ccd-83ab-fcc31666d69b> lazy-loaded attributes: resources,vcpu_model {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDefcdCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:30:40 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:30:40 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:30:40 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13231ff-a3eb-45e5-9fd2-5fc6c1371d09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:30:40 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29a7c3c-d76a-4b8f-a31b-65277361c6f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb] added
Nov 22 14:30:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab4913d-a1f8-48b1-bc99-d6fb94e15248]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a5f5ee-999b-4fe3-aa3c-d8d420b8f5e4]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QDefcdCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QDefcdCE" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f758c04e-7d12-4677-8e31-fccdffac42c8]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QDefcdCE'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c70bd27-e6d4-433b-9148-3bece2e25378]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[10452764-0e34-4994-ac87-16681ac2663d]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:30:40 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:30:40 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:30:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:30:40 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:30:40 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:30:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc2346f-d903-48e3-81fb-b21d4d5496ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb, portal: 172.16.0.220,3260]
Nov 22 14:30:40 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb, portal: 172.16.0.220,3260] successful.
Nov 22 14:30:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[32333632-49e9-467a-8d4a-2b26e38859e4]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6abd9d3-ae9c-4419-a976-84c5e4c3692e]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:30:40 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:30:40 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:30:40 user nova-compute[74776]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:30:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:30:40 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:30:40 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:30:40 user nova-compute[74776]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:30:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf041581-b78a-40be-8820-63ca38226f13]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: None {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:30:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-29e8fddb-8760-4ca6-9b08-4d3cbc97cf90 req-042bae5b-0f3e-4a59-b2b0-6c83e4ecd643 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received event network-vif-plugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29e8fddb-8760-4ca6-9b08-4d3cbc97cf90 req-042bae5b-0f3e-4a59-b2b0-6c83e4ecd643 service nova] Acquiring lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29e8fddb-8760-4ca6-9b08-4d3cbc97cf90 req-042bae5b-0f3e-4a59-b2b0-6c83e4ecd643 service nova] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29e8fddb-8760-4ca6-9b08-4d3cbc97cf90 req-042bae5b-0f3e-4a59-b2b0-6c83e4ecd643 service nova] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-29e8fddb-8760-4ca6-9b08-4d3cbc97cf90 req-042bae5b-0f3e-4a59-b2b0-6c83e4ecd643 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] No waiting events found dispatching network-vif-plugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:30:41 user nova-compute[74776]: WARNING nova.compute.manager [req-29e8fddb-8760-4ca6-9b08-4d3cbc97cf90 req-042bae5b-0f3e-4a59-b2b0-6c83e4ecd643 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received unexpected event network-vif-plugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee for instance with vm_state active and task_state reboot_started_hard.
Nov 22 14:30:41 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDefcdCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23064663865346562', 'path': '/dev/sde'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064663865346562', 'path': '/dev/sde'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:28:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-567453205',display_name='tempest-TestMinimumBasicScenario-server-567453205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-567453205',id=29,image_ref='410e18af-5ee2-4e1a-b884-991a4118fa51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeQ5l9gobrcB3GfFb8hElj7leJSJuwdi8KEucPTmUQGpAyFzhk+F3QsYUbzmVfcbUg0T9z6vSzM3sLT40eKIk3iKPtU/szyGW0f6KEHPn7TV4/Y4vJcTWqN8K0b2V6kYA==',key_name='tempest-TestMinimumBasicScenario-536055884',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:28:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2602b8e7e2414a3d88d18f9f0c973ab5',ramdisk_id='',reservation_id='r-lecfrx5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='410e18af-5ee2-4e1a-b884-991a4118fa51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1122910147',owner_user_name='tempest-TestMinimumBasicScenario-1122910147-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:30:39Z,user_data=None,user_id='aac47c7fc2fc4380a5673117151dbdb0',uuid=68b6744f-c29d-4ccd-83ab-fcc31666d69b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "address": "fa:16:3e:e9:fc:41", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7c3d69-12", "ovs_interfaceid": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Converting VIF {"id": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "address": "fa:16:3e:e9:fc:41", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7c3d69-12", "ovs_interfaceid": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:fc:41,bridge_name='br-int',has_traffic_filtering=True,id=3c7c3d69-1226-4906-b2cb-bedf570f40ee,network=Network(9ede03a9-ae5e-43f2-9865-595667d6d899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7c3d69-12') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG nova.objects.instance [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lazy-loading 'pci_devices' on Instance uuid 68b6744f-c29d-4ccd-83ab-fcc31666d69b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG nova.objects.base [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Object Instance<68b6744f-c29d-4ccd-83ab-fcc31666d69b> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:30:41 user nova-compute[74776]:   <uuid>68b6744f-c29d-4ccd-83ab-fcc31666d69b</uuid>
Nov 22 14:30:41 user nova-compute[74776]:   <name>instance-0000001d</name>
Nov 22 14:30:41 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:30:41 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:30:41 user nova-compute[74776]:   <metadata>
Nov 22 14:30:41 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:30:41 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:30:41 user nova-compute[74776]:       <nova:name>tempest-TestMinimumBasicScenario-server-567453205</nova:name>
Nov 22 14:30:41 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:30:40</nova:creationTime>
Nov 22 14:30:41 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:30:41 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:30:41 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:30:41 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:30:41 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:30:41 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:30:41 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:30:41 user nova-compute[74776]:       <nova:owner>
Nov 22 14:30:41 user nova-compute[74776]:         <nova:user uuid="aac47c7fc2fc4380a5673117151dbdb0">tempest-TestMinimumBasicScenario-1122910147-project-member</nova:user>
Nov 22 14:30:41 user nova-compute[74776]:         <nova:project uuid="2602b8e7e2414a3d88d18f9f0c973ab5">tempest-TestMinimumBasicScenario-1122910147</nova:project>
Nov 22 14:30:41 user nova-compute[74776]:       </nova:owner>
Nov 22 14:30:41 user nova-compute[74776]:       <nova:root type="image" uuid="410e18af-5ee2-4e1a-b884-991a4118fa51"/>
Nov 22 14:30:41 user nova-compute[74776]:       <nova:ports>
Nov 22 14:30:41 user nova-compute[74776]:         <nova:port uuid="3c7c3d69-1226-4906-b2cb-bedf570f40ee">
Nov 22 14:30:41 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 14:30:41 user nova-compute[74776]:         </nova:port>
Nov 22 14:30:41 user nova-compute[74776]:       </nova:ports>
Nov 22 14:30:41 user nova-compute[74776]:     </nova:instance>
Nov 22 14:30:41 user nova-compute[74776]:   </metadata>
Nov 22 14:30:41 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:30:41 user nova-compute[74776]:     <system>
Nov 22 14:30:41 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:30:41 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:30:41 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:30:41 user nova-compute[74776]:       <entry name="serial">68b6744f-c29d-4ccd-83ab-fcc31666d69b</entry>
Nov 22 14:30:41 user nova-compute[74776]:       <entry name="uuid">68b6744f-c29d-4ccd-83ab-fcc31666d69b</entry>
Nov 22 14:30:41 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:30:41 user nova-compute[74776]:     </system>
Nov 22 14:30:41 user nova-compute[74776]:   </sysinfo>
Nov 22 14:30:41 user nova-compute[74776]:   <os>
Nov 22 14:30:41 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:30:41 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:30:41 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:30:41 user nova-compute[74776]:   </os>
Nov 22 14:30:41 user nova-compute[74776]:   <features>
Nov 22 14:30:41 user nova-compute[74776]:     <acpi/>
Nov 22 14:30:41 user nova-compute[74776]:     <apic/>
Nov 22 14:30:41 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:30:41 user nova-compute[74776]:   </features>
Nov 22 14:30:41 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:30:41 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:30:41 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:30:41 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:30:41 user nova-compute[74776]:   </clock>
Nov 22 14:30:41 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:30:41 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:30:41 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:30:41 user nova-compute[74776]:   </cpu>
Nov 22 14:30:41 user nova-compute[74776]:   <devices>
Nov 22 14:30:41 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:30:41 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:30:41 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk"/>
Nov 22 14:30:41 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:30:41 user nova-compute[74776]:     </disk>
Nov 22 14:30:41 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:30:41 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:30:41 user nova-compute[74776]:       <source dev="/dev/sde"/>
Nov 22 14:30:41 user nova-compute[74776]:       <target dev="vdb" bus="virtio"/>
Nov 22 14:30:41 user nova-compute[74776]:       <serial>d96ea52c-e306-43bc-b529-8a1b47ebfecb</serial>
Nov 22 14:30:41 user nova-compute[74776]:     </disk>
Nov 22 14:30:41 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:30:41 user nova-compute[74776]:       <mac address="fa:16:3e:e9:fc:41"/>
Nov 22 14:30:41 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:30:41 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:30:41 user nova-compute[74776]:       <target dev="tap3c7c3d69-12"/>
Nov 22 14:30:41 user nova-compute[74776]:     </interface>
Nov 22 14:30:41 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:30:41 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/console.log" append="off"/>
Nov 22 14:30:41 user nova-compute[74776]:     </serial>
Nov 22 14:30:41 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:30:41 user nova-compute[74776]:     <video>
Nov 22 14:30:41 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:30:41 user nova-compute[74776]:     </video>
Nov 22 14:30:41 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:30:41 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:30:41 user nova-compute[74776]:     </rng>
Nov 22 14:30:41 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:30:41 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:30:41 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:30:41 user nova-compute[74776]:     </memballoon>
Nov 22 14:30:41 user nova-compute[74776]:   </devices>
Nov 22 14:30:41 user nova-compute[74776]: </domain>
Nov 22 14:30:41 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG nova.objects.instance [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lazy-loading 'trusted_certs' on Instance uuid 68b6744f-c29d-4ccd-83ab-fcc31666d69b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG nova.objects.base [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Object Instance<68b6744f-c29d-4ccd-83ab-fcc31666d69b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:30:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56cc66d516c1aaa3b9d52915ea9a61514add9c7b --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56cc66d516c1aaa3b9d52915ea9a61514add9c7b --force-share --output=json" returned: 0 in 0.174s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Cannot resize image /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG nova.objects.instance [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lazy-loading 'migration_context' on Instance uuid 68b6744f-c29d-4ccd-83ab-fcc31666d69b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG nova.objects.base [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Object Instance<68b6744f-c29d-4ccd-83ab-fcc31666d69b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:28:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-567453205',display_name='tempest-TestMinimumBasicScenario-server-567453205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-567453205',id=29,image_ref='410e18af-5ee2-4e1a-b884-991a4118fa51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeQ5l9gobrcB3GfFb8hElj7leJSJuwdi8KEucPTmUQGpAyFzhk+F3QsYUbzmVfcbUg0T9z6vSzM3sLT40eKIk3iKPtU/szyGW0f6KEHPn7TV4/Y4vJcTWqN8K0b2V6kYA==',key_name='tempest-TestMinimumBasicScenario-536055884',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:28:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='2602b8e7e2414a3d88d18f9f0c973ab5',ramdisk_id='',reservation_id='r-lecfrx5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='410e18af-5ee2-4e1a-b884-991a4118fa51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1122910147',owner_user_name='tempest-TestMinimumBasicScenario-1122910147-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:30:39Z,user_data=None,user_id='aac47c7fc2fc4380a5673117151dbdb0',uuid=68b6744f-c29d-4ccd-83ab-fcc31666d69b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "address": "fa:16:3e:e9:fc:41", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7c3d69-12", "ovs_interfaceid": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Converting VIF {"id": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "address": "fa:16:3e:e9:fc:41", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7c3d69-12", "ovs_interfaceid": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:fc:41,bridge_name='br-int',has_traffic_filtering=True,id=3c7c3d69-1226-4906-b2cb-bedf570f40ee,network=Network(9ede03a9-ae5e-43f2-9865-595667d6d899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7c3d69-12') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG os_vif [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:fc:41,bridge_name='br-int',has_traffic_filtering=True,id=3c7c3d69-1226-4906-b2cb-bedf570f40ee,network=Network(9ede03a9-ae5e-43f2-9865-595667d6d899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7c3d69-12') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f168adf8-20fb-5476-a539-a4d522ee8af5', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c7c3d69-12, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c7c3d69-12, col_values=(('qos', UUID('146f5e7c-178c-4114-88f6-fc9beb4c3fb1')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c7c3d69-12, col_values=(('external_ids', {'iface-id': '3c7c3d69-1226-4906-b2cb-bedf570f40ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:fc:41', 'vm-uuid': '68b6744f-c29d-4ccd-83ab-fcc31666d69b'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:30:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:42 user nova-compute[74776]: INFO os_vif [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:fc:41,bridge_name='br-int',has_traffic_filtering=True,id=3c7c3d69-1226-4906-b2cb-bedf570f40ee,network=Network(9ede03a9-ae5e-43f2-9865-595667d6d899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7c3d69-12')
Nov 22 14:30:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:44 user nova-compute[74776]: DEBUG nova.compute.manager [req-9b145e25-e048-4213-b137-8b7fe58c6d16 req-bc1af197-e18e-4ae6-a0a8-df6f75c5bfe2 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received event network-vif-plugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:30:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9b145e25-e048-4213-b137-8b7fe58c6d16 req-bc1af197-e18e-4ae6-a0a8-df6f75c5bfe2 service nova] Acquiring lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9b145e25-e048-4213-b137-8b7fe58c6d16 req-bc1af197-e18e-4ae6-a0a8-df6f75c5bfe2 service nova] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9b145e25-e048-4213-b137-8b7fe58c6d16 req-bc1af197-e18e-4ae6-a0a8-df6f75c5bfe2 service nova] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:44 user nova-compute[74776]: DEBUG nova.compute.manager [req-9b145e25-e048-4213-b137-8b7fe58c6d16 req-bc1af197-e18e-4ae6-a0a8-df6f75c5bfe2 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] No waiting events found dispatching network-vif-plugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:30:44 user nova-compute[74776]: WARNING nova.compute.manager [req-9b145e25-e048-4213-b137-8b7fe58c6d16 req-bc1af197-e18e-4ae6-a0a8-df6f75c5bfe2 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received unexpected event network-vif-plugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee for instance with vm_state active and task_state reboot_started_hard.
Nov 22 14:30:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:45 user nova-compute[74776]: DEBUG nova.compute.manager [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:30:45 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Instance rebooted successfully.
Nov 22 14:30:45 user nova-compute[74776]: DEBUG nova.compute.manager [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:30:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9c2a5bce-6ea1-441d-a54a-3ca77f1ffae6 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.459s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG nova.objects.instance [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'flavor' on Instance uuid d374cfe8-6d04-4c4e-9055-f46488a76ed8 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG nova.compute.manager [req-d2069e69-f71f-4cf5-901c-aef3f764a97d req-47de7f63-a663-4b8f-be17-8b7307be63ed service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received event network-vif-plugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2069e69-f71f-4cf5-901c-aef3f764a97d req-47de7f63-a663-4b8f-be17-8b7307be63ed service nova] Acquiring lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2069e69-f71f-4cf5-901c-aef3f764a97d req-47de7f63-a663-4b8f-be17-8b7307be63ed service nova] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2069e69-f71f-4cf5-901c-aef3f764a97d req-47de7f63-a663-4b8f-be17-8b7307be63ed service nova] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG nova.compute.manager [req-d2069e69-f71f-4cf5-901c-aef3f764a97d req-47de7f63-a663-4b8f-be17-8b7307be63ed service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] No waiting events found dispatching network-vif-plugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:30:46 user nova-compute[74776]: WARNING nova.compute.manager [req-d2069e69-f71f-4cf5-901c-aef3f764a97d req-47de7f63-a663-4b8f-be17-8b7307be63ed service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received unexpected event network-vif-plugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee for instance with vm_state active and task_state None.
Nov 22 14:30:46 user nova-compute[74776]: DEBUG nova.compute.manager [req-d2069e69-f71f-4cf5-901c-aef3f764a97d req-47de7f63-a663-4b8f-be17-8b7307be63ed service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received event network-changed-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG nova.compute.manager [req-d2069e69-f71f-4cf5-901c-aef3f764a97d req-47de7f63-a663-4b8f-be17-8b7307be63ed service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Refreshing instance network info cache due to event network-changed-d8edc986-df1e-4de5-9926-4cbb5b4ec280. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2069e69-f71f-4cf5-901c-aef3f764a97d req-47de7f63-a663-4b8f-be17-8b7307be63ed service nova] Acquiring lock "refresh_cache-d374cfe8-6d04-4c4e-9055-f46488a76ed8" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2069e69-f71f-4cf5-901c-aef3f764a97d req-47de7f63-a663-4b8f-be17-8b7307be63ed service nova] Acquired lock "refresh_cache-d374cfe8-6d04-4c4e-9055-f46488a76ed8" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG nova.network.neutron [req-d2069e69-f71f-4cf5-901c-aef3f764a97d req-47de7f63-a663-4b8f-be17-8b7307be63ed service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Refreshing network info cache for port d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:46 user nova-compute[74776]: INFO nova.compute.manager [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Attaching volume bf3345cf-179f-42e9-b81c-523f1043ed09 to /dev/vdb
Nov 22 14:30:46 user nova-compute[74776]: DEBUG os_brick.utils [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f86d5f-a356-46c2-882b-d70d61de9540]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1369f03-720e-47f3-bb2b-489af3942028]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52d2c5a-8817-4b11-beea-3b540ca4f538]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b3935a-7904-4fb6-b041-cad0c5e0ca3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:30:46 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8254585-c990-4512-b86c-39d94960b3e0]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG os_brick.utils [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Updating existing volume attachment record: 88e59663-fd25-4453-bf0d-b8db8af244f8 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG nova.network.neutron [req-d2069e69-f71f-4cf5-901c-aef3f764a97d req-47de7f63-a663-4b8f-be17-8b7307be63ed service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Updated VIF entry in instance network info cache for port d8edc986-df1e-4de5-9926-4cbb5b4ec280. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG nova.network.neutron [req-d2069e69-f71f-4cf5-901c-aef3f764a97d req-47de7f63-a663-4b8f-be17-8b7307be63ed service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Updating instance_info_cache with network_info: [{"id": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "address": "fa:16:3e:1b:64:9b", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8edc986-df", "ovs_interfaceid": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:30:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d2069e69-f71f-4cf5-901c-aef3f764a97d req-47de7f63-a663-4b8f-be17-8b7307be63ed service nova] Releasing lock "refresh_cache-d374cfe8-6d04-4c4e-9055-f46488a76ed8" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:30:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rGcdPnwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:30:52 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:30:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:30:52 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:30:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:30:52 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:30:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3479ec6-54bc-42d2-a38f-67bb236e96ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:30:52 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e717e65-99cb-4936-b56a-de6090a71375]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09] added
Nov 22 14:30:52 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f59e1b5-1f02-4363-89f4-ea363813a2db]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[07792614-ff50-4394-995c-81c78a997134]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rGcdPnwA {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rGcdPnwA" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2d8f22-0eb3-4bb1-81a6-b33ae08f71e4]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rGcdPnwA'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.200s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[432ac3ea-994d-47c1-acc3-12e1b9c3485c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bf3fb6-4698-4ccd-aa4d-c9f63a0b2431]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:30:53 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:30:53 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:30:53 user nova-compute[74776]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:30:53 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:30:53 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:30:53 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:30:53 user nova-compute[74776]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:30:53 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00f1935-2717-4505-a546-85078a40cc38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09, portal: 172.16.0.220,3260]
Nov 22 14:30:53 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09, portal: 172.16.0.220,3260] successful.
Nov 22 14:30:53 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0309c182-eff6-4821-871f-310676f6a518]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43a0b92-4032-43aa-aba7-e1e3443c4b04]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:30:53 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:30:53 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:30:53 user nova-compute[74776]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:30:53 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:30:53 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:30:53 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:30:53 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:30:53 user nova-compute[74776]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:30:53 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:30:53 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.466s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43b4a9e-69f2-4356-9dc9-6f4932ceb048]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:30:53 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: None {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:30:54 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:30:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rGcdPnwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:30:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.495s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:30:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] <== connect_volume: return (1496ms) {'type': 'block', 'scsi_wwn': '23736633965386665', 'path': '/dev/sdf'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:30:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736633965386665', 'path': '/dev/sdf'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:30:54 user nova-compute[74776]: DEBUG nova.objects.instance [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'flavor' on Instance uuid d374cfe8-6d04-4c4e-9055-f46488a76ed8 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:30:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:30:54 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:30:54 user nova-compute[74776]:   <source dev="/dev/sdf"/>
Nov 22 14:30:54 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:30:54 user nova-compute[74776]:   <serial>bf3345cf-179f-42e9-b81c-523f1043ed09</serial>
Nov 22 14:30:54 user nova-compute[74776]: </disk>
Nov 22 14:30:54 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:30:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:30:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:30:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] No VIF found with MAC fa:16:3e:1b:64:9b, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:30:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-cdcc10e3-8d6d-4de3-9ada-2152da4ac530 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.551s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:56 user nova-compute[74776]: INFO nova.compute.manager [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Rescuing
Nov 22 14:30:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "refresh_cache-d374cfe8-6d04-4c4e-9055-f46488a76ed8" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:30:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquired lock "refresh_cache-d374cfe8-6d04-4c4e-9055-f46488a76ed8" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:30:56 user nova-compute[74776]: DEBUG nova.network.neutron [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:30:56 user nova-compute[74776]: DEBUG nova.network.neutron [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Updating instance_info_cache with network_info: [{"id": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "address": "fa:16:3e:1b:64:9b", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8edc986-df", "ovs_interfaceid": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:30:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Releasing lock "refresh_cache-d374cfe8-6d04-4c4e-9055-f46488a76ed8" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:30:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-ad454820-88db-4a73-8bb1-3b2c4023d210 req-677cd4d9-b15f-4da7-aaf6-c7bd245f0c4b service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received event network-vif-unplugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:30:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ad454820-88db-4a73-8bb1-3b2c4023d210 req-677cd4d9-b15f-4da7-aaf6-c7bd245f0c4b service nova] Acquiring lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ad454820-88db-4a73-8bb1-3b2c4023d210 req-677cd4d9-b15f-4da7-aaf6-c7bd245f0c4b service nova] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ad454820-88db-4a73-8bb1-3b2c4023d210 req-677cd4d9-b15f-4da7-aaf6-c7bd245f0c4b service nova] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-ad454820-88db-4a73-8bb1-3b2c4023d210 req-677cd4d9-b15f-4da7-aaf6-c7bd245f0c4b service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] No waiting events found dispatching network-vif-unplugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:30:56 user nova-compute[74776]: WARNING nova.compute.manager [req-ad454820-88db-4a73-8bb1-3b2c4023d210 req-677cd4d9-b15f-4da7-aaf6-c7bd245f0c4b service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received unexpected event network-vif-unplugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 for instance with vm_state active and task_state rescuing.
Nov 22 14:30:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:57 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Instance destroyed successfully.
Nov 22 14:30:57 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Attempting rescue
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74776) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Instance directory exists: not creating {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 14:30:57 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Creating image(s)
Nov 22 14:30:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "/opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "/opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "/opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'trusted_certs' on Instance uuid d374cfe8-6d04-4c4e-9055-f46488a76ed8 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk.rescue {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk.rescue" returned: 0 in 0.059s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'migration_context' on Instance uuid d374cfe8-6d04-4c4e-9055-f46488a76ed8 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.objects.base [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Object Instance<d374cfe8-6d04-4c4e-9055-f46488a76ed8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Start _get_guest_xml network_info=[{"id": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "address": "fa:16:3e:1b:64:9b", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "vif_mac": "fa:16:3e:1b:64:9b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8edc986-df", "ovs_interfaceid": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'resources' on Instance uuid d374cfe8-6d04-4c4e-9055-f46488a76ed8 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.objects.base [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Object Instance<d374cfe8-6d04-4c4e-9055-f46488a76ed8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'numa_topology' on Instance uuid d374cfe8-6d04-4c4e-9055-f46488a76ed8 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.objects.base [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Object Instance<d374cfe8-6d04-4c4e-9055-f46488a76ed8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:30:57 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:30:57 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'vcpu_model' on Instance uuid d374cfe8-6d04-4c4e-9055-f46488a76ed8 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.objects.base [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Object Instance<d374cfe8-6d04-4c4e-9055-f46488a76ed8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:28:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1107406588',display_name='tempest-ServerRescueNegativeTestJSON-server-1107406588',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1107406588',id=30,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1EyvTUUIuL6MgjFwn8DE49EjeyaQMzjJ84mYADLNQzIT3JkXlfY5dJuarBt9fszAfaeI4YT8kZ6F8q9hJdZViGfNftC06XGNEwinXrNa81UMAylnLx5vkvB9ePotD5ng==',key_name='tempest-keypair-1510487701',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:28:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36f36a88fd7b403d9c2dd29bcd64aac6',ramdisk_id='',reservation_id='r-7iylxjz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1360515217',owner_user_name='tempest-ServerRescueNegativeTestJSON-1360515217-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:29:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d686d08dc36a49fa80192546c4f68940',uuid=d374cfe8-6d04-4c4e-9055-f46488a76ed8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "address": "fa:16:3e:1b:64:9b", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "vif_mac": "fa:16:3e:1b:64:9b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8edc986-df", "ovs_interfaceid": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converting VIF {"id": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "address": "fa:16:3e:1b:64:9b", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "vif_mac": "fa:16:3e:1b:64:9b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8edc986-df", "ovs_interfaceid": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:64:9b,bridge_name='br-int',has_traffic_filtering=True,id=d8edc986-df1e-4de5-9926-4cbb5b4ec280,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8edc986-df') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'pci_devices' on Instance uuid d374cfe8-6d04-4c4e-9055-f46488a76ed8 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.objects.base [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Object Instance<d374cfe8-6d04-4c4e-9055-f46488a76ed8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:30:57 user nova-compute[74776]:   <uuid>d374cfe8-6d04-4c4e-9055-f46488a76ed8</uuid>
Nov 22 14:30:57 user nova-compute[74776]:   <name>instance-0000001e</name>
Nov 22 14:30:57 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:30:57 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:30:57 user nova-compute[74776]:   <metadata>
Nov 22 14:30:57 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:30:57 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:30:57 user nova-compute[74776]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1107406588</nova:name>
Nov 22 14:30:57 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:30:57</nova:creationTime>
Nov 22 14:30:57 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:30:57 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:30:57 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:30:57 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:30:57 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:30:57 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:30:57 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:30:57 user nova-compute[74776]:       <nova:owner>
Nov 22 14:30:57 user nova-compute[74776]:         <nova:user uuid="d686d08dc36a49fa80192546c4f68940">tempest-ServerRescueNegativeTestJSON-1360515217-project-member</nova:user>
Nov 22 14:30:57 user nova-compute[74776]:         <nova:project uuid="36f36a88fd7b403d9c2dd29bcd64aac6">tempest-ServerRescueNegativeTestJSON-1360515217</nova:project>
Nov 22 14:30:57 user nova-compute[74776]:       </nova:owner>
Nov 22 14:30:57 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:30:57 user nova-compute[74776]:       <nova:ports>
Nov 22 14:30:57 user nova-compute[74776]:         <nova:port uuid="d8edc986-df1e-4de5-9926-4cbb5b4ec280">
Nov 22 14:30:57 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 22 14:30:57 user nova-compute[74776]:         </nova:port>
Nov 22 14:30:57 user nova-compute[74776]:       </nova:ports>
Nov 22 14:30:57 user nova-compute[74776]:     </nova:instance>
Nov 22 14:30:57 user nova-compute[74776]:   </metadata>
Nov 22 14:30:57 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:30:57 user nova-compute[74776]:     <system>
Nov 22 14:30:57 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:30:57 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:30:57 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:30:57 user nova-compute[74776]:       <entry name="serial">d374cfe8-6d04-4c4e-9055-f46488a76ed8</entry>
Nov 22 14:30:57 user nova-compute[74776]:       <entry name="uuid">d374cfe8-6d04-4c4e-9055-f46488a76ed8</entry>
Nov 22 14:30:57 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:30:57 user nova-compute[74776]:     </system>
Nov 22 14:30:57 user nova-compute[74776]:   </sysinfo>
Nov 22 14:30:57 user nova-compute[74776]:   <os>
Nov 22 14:30:57 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:30:57 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:30:57 user nova-compute[74776]:   </os>
Nov 22 14:30:57 user nova-compute[74776]:   <features>
Nov 22 14:30:57 user nova-compute[74776]:     <acpi/>
Nov 22 14:30:57 user nova-compute[74776]:     <apic/>
Nov 22 14:30:57 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:30:57 user nova-compute[74776]:   </features>
Nov 22 14:30:57 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:30:57 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:30:57 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:30:57 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:30:57 user nova-compute[74776]:   </clock>
Nov 22 14:30:57 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:30:57 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:30:57 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:30:57 user nova-compute[74776]:   </cpu>
Nov 22 14:30:57 user nova-compute[74776]:   <devices>
Nov 22 14:30:57 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:30:57 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:30:57 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk.rescue"/>
Nov 22 14:30:57 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:30:57 user nova-compute[74776]:     </disk>
Nov 22 14:30:57 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:30:57 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:30:57 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk"/>
Nov 22 14:30:57 user nova-compute[74776]:       <target dev="vdb" bus="virtio"/>
Nov 22 14:30:57 user nova-compute[74776]:     </disk>
Nov 22 14:30:57 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:30:57 user nova-compute[74776]:       <mac address="fa:16:3e:1b:64:9b"/>
Nov 22 14:30:57 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:30:57 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:30:57 user nova-compute[74776]:       <target dev="tapd8edc986-df"/>
Nov 22 14:30:57 user nova-compute[74776]:     </interface>
Nov 22 14:30:57 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:30:57 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/console.log" append="off"/>
Nov 22 14:30:57 user nova-compute[74776]:     </serial>
Nov 22 14:30:57 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:30:57 user nova-compute[74776]:     <video>
Nov 22 14:30:57 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:30:57 user nova-compute[74776]:     </video>
Nov 22 14:30:57 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:30:57 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:30:57 user nova-compute[74776]:     </rng>
Nov 22 14:30:57 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:30:57 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:30:57 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:30:57 user nova-compute[74776]:     </memballoon>
Nov 22 14:30:57 user nova-compute[74776]:   </devices>
Nov 22 14:30:57 user nova-compute[74776]: </domain>
Nov 22 14:30:57 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:30:57 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Instance destroyed successfully.
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:30:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] No VIF found with MAC fa:16:3e:1b:64:9b, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:30:58 user nova-compute[74776]: DEBUG nova.compute.manager [req-c9a82c31-17ea-4fa9-8019-da7671a7e79d req-843f9640-8307-468c-8865-37ace64f364a service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received event network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:30:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c9a82c31-17ea-4fa9-8019-da7671a7e79d req-843f9640-8307-468c-8865-37ace64f364a service nova] Acquiring lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:30:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c9a82c31-17ea-4fa9-8019-da7671a7e79d req-843f9640-8307-468c-8865-37ace64f364a service nova] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:30:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c9a82c31-17ea-4fa9-8019-da7671a7e79d req-843f9640-8307-468c-8865-37ace64f364a service nova] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:30:58 user nova-compute[74776]: DEBUG nova.compute.manager [req-c9a82c31-17ea-4fa9-8019-da7671a7e79d req-843f9640-8307-468c-8865-37ace64f364a service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] No waiting events found dispatching network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:30:58 user nova-compute[74776]: WARNING nova.compute.manager [req-c9a82c31-17ea-4fa9-8019-da7671a7e79d req-843f9640-8307-468c-8865-37ace64f364a service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received unexpected event network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 for instance with vm_state active and task_state rescuing.
Nov 22 14:30:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:30:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-14cff5d5-eac6-4a7c-b3e2-b476fb4e4b98 req-726b58fc-6c1c-4bef-8928-32f603c73818 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received event network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:31:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-14cff5d5-eac6-4a7c-b3e2-b476fb4e4b98 req-726b58fc-6c1c-4bef-8928-32f603c73818 service nova] Acquiring lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-14cff5d5-eac6-4a7c-b3e2-b476fb4e4b98 req-726b58fc-6c1c-4bef-8928-32f603c73818 service nova] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-14cff5d5-eac6-4a7c-b3e2-b476fb4e4b98 req-726b58fc-6c1c-4bef-8928-32f603c73818 service nova] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-14cff5d5-eac6-4a7c-b3e2-b476fb4e4b98 req-726b58fc-6c1c-4bef-8928-32f603c73818 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] No waiting events found dispatching network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:31:00 user nova-compute[74776]: WARNING nova.compute.manager [req-14cff5d5-eac6-4a7c-b3e2-b476fb4e4b98 req-726b58fc-6c1c-4bef-8928-32f603c73818 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received unexpected event network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 for instance with vm_state active and task_state rescuing.
Nov 22 14:31:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-14cff5d5-eac6-4a7c-b3e2-b476fb4e4b98 req-726b58fc-6c1c-4bef-8928-32f603c73818 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received event network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:31:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-14cff5d5-eac6-4a7c-b3e2-b476fb4e4b98 req-726b58fc-6c1c-4bef-8928-32f603c73818 service nova] Acquiring lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-14cff5d5-eac6-4a7c-b3e2-b476fb4e4b98 req-726b58fc-6c1c-4bef-8928-32f603c73818 service nova] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-14cff5d5-eac6-4a7c-b3e2-b476fb4e4b98 req-726b58fc-6c1c-4bef-8928-32f603c73818 service nova] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-14cff5d5-eac6-4a7c-b3e2-b476fb4e4b98 req-726b58fc-6c1c-4bef-8928-32f603c73818 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] No waiting events found dispatching network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:31:00 user nova-compute[74776]: WARNING nova.compute.manager [req-14cff5d5-eac6-4a7c-b3e2-b476fb4e4b98 req-726b58fc-6c1c-4bef-8928-32f603c73818 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received unexpected event network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 for instance with vm_state active and task_state rescuing.
Nov 22 14:31:01 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d8bb9ded-4091-41a0-894f-8da7bc697e5d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:31:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "016bf051-9034-4124-948d-995aacf77caf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "016bf051-9034-4124-948d-995aacf77caf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "016bf051-9034-4124-948d-995aacf77caf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "016bf051-9034-4124-948d-995aacf77caf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "016bf051-9034-4124-948d-995aacf77caf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:06 user nova-compute[74776]: INFO nova.compute.manager [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Terminating instance
Nov 22 14:31:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-be833ede-143c-49b0-8dbe-31300131cccb req-4bd92348-392e-4747-a48b-9d04b7a9d510 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Received event network-vif-unplugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-be833ede-143c-49b0-8dbe-31300131cccb req-4bd92348-392e-4747-a48b-9d04b7a9d510 service nova] Acquiring lock "016bf051-9034-4124-948d-995aacf77caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-be833ede-143c-49b0-8dbe-31300131cccb req-4bd92348-392e-4747-a48b-9d04b7a9d510 service nova] Lock "016bf051-9034-4124-948d-995aacf77caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-be833ede-143c-49b0-8dbe-31300131cccb req-4bd92348-392e-4747-a48b-9d04b7a9d510 service nova] Lock "016bf051-9034-4124-948d-995aacf77caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-be833ede-143c-49b0-8dbe-31300131cccb req-4bd92348-392e-4747-a48b-9d04b7a9d510 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] No waiting events found dispatching network-vif-unplugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-be833ede-143c-49b0-8dbe-31300131cccb req-4bd92348-392e-4747-a48b-9d04b7a9d510 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Received event network-vif-unplugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:06 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:31:06 user nova-compute[74776]: INFO nova.compute.claims [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Claim successful on node user
Nov 22 14:31:07 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 016bf051-9034-4124-948d-995aacf77caf] Instance destroyed successfully.
Nov 22 14:31:07 user nova-compute[74776]: DEBUG nova.objects.instance [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lazy-loading 'resources' on Instance uuid 016bf051-9034-4124-948d-995aacf77caf {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T14:24:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-23240802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-23240802',id=22,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKduD23N0jjd+/3aswFbVaCynWvn+B/yMtXKe3RKoy1nzyj4V1/dApS8ji97SS0HNw9OqdGuyusGE/CV8+iyxp5s4Ox44gq/tz45m/A8mDHXREpPgLCGWwIAVtzjkC4U5g==',key_name='tempest-keypair-1418035038',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:28:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1d6da4f9f4149479a779475a69c9110',ramdisk_id='',reservation_id='r-7q3t55ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1293931160',owner_user_name='tempest-AttachVolumeShelveTestJSON-1293931160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:28:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c63eae228f99474899ce0620a4affe75',uuid=016bf051-9034-4124-948d-995aacf77caf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converting VIF {"id": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "address": "fa:16:3e:c7:1f:4f", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19e9bf95-ee", "ovs_interfaceid": "19e9bf95-eee7-41e4-95ab-4f18f612d2c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1f:4f,bridge_name='br-int',has_traffic_filtering=True,id=19e9bf95-eee7-41e4-95ab-4f18f612d2c5,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e9bf95-ee') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG os_vif [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1f:4f,bridge_name='br-int',has_traffic_filtering=True,id=19e9bf95-eee7-41e4-95ab-4f18f612d2c5,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e9bf95-ee') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19e9bf95-ee, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b406953-e4c7-4101-96d8-2c1e32f7c871) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:07 user nova-compute[74776]: INFO os_vif [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:1f:4f,bridge_name='br-int',has_traffic_filtering=True,id=19e9bf95-eee7-41e4-95ab-4f18f612d2c5,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19e9bf95-ee')
Nov 22 14:31:07 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Deleting instance files /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf_del
Nov 22 14:31:07 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Deletion of /opt/stack/data/nova/instances/016bf051-9034-4124-948d-995aacf77caf_del complete
Nov 22 14:31:07 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:31:07 user nova-compute[74776]: INFO nova.compute.manager [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: 016bf051-9034-4124-948d-995aacf77caf] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 22 14:31:07 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 016bf051-9034-4124-948d-995aacf77caf] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 016bf051-9034-4124-948d-995aacf77caf] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG nova.network.neutron [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:31:07 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:31:07 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG nova.policy [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1807bb240de749499809fd3dfb520d78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee58d331979425eb9d48d2a52fc1f68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:31:07 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Creating image(s)
Nov 22 14:31:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "/opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "/opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "/opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.188s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk 1073741824" returned: 0 in 0.053s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 016bf051-9034-4124-948d-995aacf77caf] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-cd1a5094-928e-4751-ac2d-e0f38be4ac7d req-70b9b5f5-d82a-41b5-8ee2-af0a2650cce5 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Received event network-vif-deleted-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:31:08 user nova-compute[74776]: INFO nova.compute.manager [req-cd1a5094-928e-4751-ac2d-e0f38be4ac7d req-70b9b5f5-d82a-41b5-8ee2-af0a2650cce5 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Neutron deleted interface 19e9bf95-eee7-41e4-95ab-4f18f612d2c5; detaching it from the instance and deleting it from the info cache
Nov 22 14:31:08 user nova-compute[74776]: DEBUG nova.network.neutron [req-cd1a5094-928e-4751-ac2d-e0f38be4ac7d req-70b9b5f5-d82a-41b5-8ee2-af0a2650cce5 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:31:08 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 016bf051-9034-4124-948d-995aacf77caf] Took 0.80 seconds to deallocate network for instance.
Nov 22 14:31:08 user nova-compute[74776]: DEBUG nova.network.neutron [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Successfully created port: ee7ecf07-d931-49bf-a7a3-289e575911a4 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-cd1a5094-928e-4751-ac2d-e0f38be4ac7d req-70b9b5f5-d82a-41b5-8ee2-af0a2650cce5 service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Detach interface failed, port_id=19e9bf95-eee7-41e4-95ab-4f18f612d2c5, reason: Instance 016bf051-9034-4124-948d-995aacf77caf could not be found. {{(pid=74776) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.204s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Cannot resize image /opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Ensure instance console log exists: /opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:08 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Deleted allocations for instance 016bf051-9034-4124-948d-995aacf77caf
Nov 22 14:31:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-5712f736-4f94-4a38-85c0-5ac8e5b11f55 req-defb66d4-68b1-4860-a710-0a4a50a802ec service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Received event network-vif-plugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5712f736-4f94-4a38-85c0-5ac8e5b11f55 req-defb66d4-68b1-4860-a710-0a4a50a802ec service nova] Acquiring lock "016bf051-9034-4124-948d-995aacf77caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5712f736-4f94-4a38-85c0-5ac8e5b11f55 req-defb66d4-68b1-4860-a710-0a4a50a802ec service nova] Lock "016bf051-9034-4124-948d-995aacf77caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5712f736-4f94-4a38-85c0-5ac8e5b11f55 req-defb66d4-68b1-4860-a710-0a4a50a802ec service nova] Lock "016bf051-9034-4124-948d-995aacf77caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-5712f736-4f94-4a38-85c0-5ac8e5b11f55 req-defb66d4-68b1-4860-a710-0a4a50a802ec service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] No waiting events found dispatching network-vif-plugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:31:08 user nova-compute[74776]: WARNING nova.compute.manager [req-5712f736-4f94-4a38-85c0-5ac8e5b11f55 req-defb66d4-68b1-4860-a710-0a4a50a802ec service nova] [instance: 016bf051-9034-4124-948d-995aacf77caf] Received unexpected event network-vif-plugged-19e9bf95-eee7-41e4-95ab-4f18f612d2c5 for instance with vm_state deleted and task_state None.
Nov 22 14:31:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ca803198-51b0-4191-8650-7cbdeb50ecb8 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "016bf051-9034-4124-948d-995aacf77caf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.412s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG nova.network.neutron [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Successfully updated port: ee7ecf07-d931-49bf-a7a3-289e575911a4 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "refresh_cache-34f85084-64b0-4bfa-b5b7-744e3f26cd91" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquired lock "refresh_cache-34f85084-64b0-4bfa-b5b7-744e3f26cd91" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG nova.network.neutron [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:31:08 user nova-compute[74776]: DEBUG nova.network.neutron [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.network.neutron [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Updating instance_info_cache with network_info: [{"id": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "address": "fa:16:3e:b0:46:dd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7ecf07-d9", "ovs_interfaceid": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Releasing lock "refresh_cache-34f85084-64b0-4bfa-b5b7-744e3f26cd91" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Instance network_info: |[{"id": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "address": "fa:16:3e:b0:46:dd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7ecf07-d9", "ovs_interfaceid": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Start _get_guest_xml network_info=[{"id": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "address": "fa:16:3e:b0:46:dd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7ecf07-d9", "ovs_interfaceid": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:31:09 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:31:09 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:31:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-819098257',display_name='tempest-AttachVolumeNegativeTest-server-819098257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-819098257',id=32,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBI5k/nOgXWA61w55fN3ASYAncoQy3hEQcovBd4YCSbeuV2KLqyZFYosBVNp1nvFut5/VtoX2lJr5MShoxdBRvqgFCOyimGn7MLhiCucqqjIz8Qm9ue8KxoonhOed30oWg==',key_name='tempest-keypair-408663051',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dee58d331979425eb9d48d2a52fc1f68',ramdisk_id='',reservation_id='r-l0t0k2ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-577275639',owner_user_name='tempest-AttachVolumeNegativeTest-577275639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:31:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1807bb240de749499809fd3dfb520d78',uuid=34f85084-64b0-4bfa-b5b7-744e3f26cd91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "address": "fa:16:3e:b0:46:dd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7ecf07-d9", "ovs_interfaceid": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converting VIF {"id": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "address": "fa:16:3e:b0:46:dd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7ecf07-d9", "ovs_interfaceid": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:46:dd,bridge_name='br-int',has_traffic_filtering=True,id=ee7ecf07-d931-49bf-a7a3-289e575911a4,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee7ecf07-d9') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lazy-loading 'pci_devices' on Instance uuid 34f85084-64b0-4bfa-b5b7-744e3f26cd91 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:31:09 user nova-compute[74776]:   <uuid>34f85084-64b0-4bfa-b5b7-744e3f26cd91</uuid>
Nov 22 14:31:09 user nova-compute[74776]:   <name>instance-00000020</name>
Nov 22 14:31:09 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:31:09 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:31:09 user nova-compute[74776]:   <metadata>
Nov 22 14:31:09 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:31:09 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:31:09 user nova-compute[74776]:       <nova:name>tempest-AttachVolumeNegativeTest-server-819098257</nova:name>
Nov 22 14:31:09 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:31:09</nova:creationTime>
Nov 22 14:31:09 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:31:09 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:31:09 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:31:09 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:31:09 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:31:09 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:31:09 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:31:09 user nova-compute[74776]:       <nova:owner>
Nov 22 14:31:09 user nova-compute[74776]:         <nova:user uuid="1807bb240de749499809fd3dfb520d78">tempest-AttachVolumeNegativeTest-577275639-project-member</nova:user>
Nov 22 14:31:09 user nova-compute[74776]:         <nova:project uuid="dee58d331979425eb9d48d2a52fc1f68">tempest-AttachVolumeNegativeTest-577275639</nova:project>
Nov 22 14:31:09 user nova-compute[74776]:       </nova:owner>
Nov 22 14:31:09 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:31:09 user nova-compute[74776]:       <nova:ports>
Nov 22 14:31:09 user nova-compute[74776]:         <nova:port uuid="ee7ecf07-d931-49bf-a7a3-289e575911a4">
Nov 22 14:31:09 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 22 14:31:09 user nova-compute[74776]:         </nova:port>
Nov 22 14:31:09 user nova-compute[74776]:       </nova:ports>
Nov 22 14:31:09 user nova-compute[74776]:     </nova:instance>
Nov 22 14:31:09 user nova-compute[74776]:   </metadata>
Nov 22 14:31:09 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:31:09 user nova-compute[74776]:     <system>
Nov 22 14:31:09 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:31:09 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:31:09 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:31:09 user nova-compute[74776]:       <entry name="serial">34f85084-64b0-4bfa-b5b7-744e3f26cd91</entry>
Nov 22 14:31:09 user nova-compute[74776]:       <entry name="uuid">34f85084-64b0-4bfa-b5b7-744e3f26cd91</entry>
Nov 22 14:31:09 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:31:09 user nova-compute[74776]:     </system>
Nov 22 14:31:09 user nova-compute[74776]:   </sysinfo>
Nov 22 14:31:09 user nova-compute[74776]:   <os>
Nov 22 14:31:09 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:31:09 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:31:09 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:31:09 user nova-compute[74776]:   </os>
Nov 22 14:31:09 user nova-compute[74776]:   <features>
Nov 22 14:31:09 user nova-compute[74776]:     <acpi/>
Nov 22 14:31:09 user nova-compute[74776]:     <apic/>
Nov 22 14:31:09 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:31:09 user nova-compute[74776]:   </features>
Nov 22 14:31:09 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:31:09 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:31:09 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:31:09 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:31:09 user nova-compute[74776]:   </clock>
Nov 22 14:31:09 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:31:09 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:31:09 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:31:09 user nova-compute[74776]:   </cpu>
Nov 22 14:31:09 user nova-compute[74776]:   <devices>
Nov 22 14:31:09 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:31:09 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:31:09 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk"/>
Nov 22 14:31:09 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:31:09 user nova-compute[74776]:     </disk>
Nov 22 14:31:09 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:31:09 user nova-compute[74776]:       <mac address="fa:16:3e:b0:46:dd"/>
Nov 22 14:31:09 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:31:09 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:31:09 user nova-compute[74776]:       <target dev="tapee7ecf07-d9"/>
Nov 22 14:31:09 user nova-compute[74776]:     </interface>
Nov 22 14:31:09 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:31:09 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/console.log" append="off"/>
Nov 22 14:31:09 user nova-compute[74776]:     </serial>
Nov 22 14:31:09 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:31:09 user nova-compute[74776]:     <video>
Nov 22 14:31:09 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:31:09 user nova-compute[74776]:     </video>
Nov 22 14:31:09 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:31:09 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:31:09 user nova-compute[74776]:     </rng>
Nov 22 14:31:09 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:31:09 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:31:09 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:31:09 user nova-compute[74776]:     </memballoon>
Nov 22 14:31:09 user nova-compute[74776]:   </devices>
Nov 22 14:31:09 user nova-compute[74776]: </domain>
Nov 22 14:31:09 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:31:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-819098257',display_name='tempest-AttachVolumeNegativeTest-server-819098257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-819098257',id=32,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBI5k/nOgXWA61w55fN3ASYAncoQy3hEQcovBd4YCSbeuV2KLqyZFYosBVNp1nvFut5/VtoX2lJr5MShoxdBRvqgFCOyimGn7MLhiCucqqjIz8Qm9ue8KxoonhOed30oWg==',key_name='tempest-keypair-408663051',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dee58d331979425eb9d48d2a52fc1f68',ramdisk_id='',reservation_id='r-l0t0k2ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-577275639',owner_user_name='tempest-AttachVolumeNegativeTest-577275639-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:31:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1807bb240de749499809fd3dfb520d78',uuid=34f85084-64b0-4bfa-b5b7-744e3f26cd91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "address": "fa:16:3e:b0:46:dd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7ecf07-d9", "ovs_interfaceid": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converting VIF {"id": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "address": "fa:16:3e:b0:46:dd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7ecf07-d9", "ovs_interfaceid": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:46:dd,bridge_name='br-int',has_traffic_filtering=True,id=ee7ecf07-d931-49bf-a7a3-289e575911a4,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee7ecf07-d9') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG os_vif [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:46:dd,bridge_name='br-int',has_traffic_filtering=True,id=ee7ecf07-d931-49bf-a7a3-289e575911a4,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee7ecf07-d9') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a39eb7d-6acb-51de-994c-a34983a1b3e5', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee7ecf07-d9, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee7ecf07-d9, col_values=(('qos', UUID('63144d4e-0f09-4baa-8e40-680c2ef346b1')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee7ecf07-d9, col_values=(('external_ids', {'iface-id': 'ee7ecf07-d931-49bf-a7a3-289e575911a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:46:dd', 'vm-uuid': '34f85084-64b0-4bfa-b5b7-744e3f26cd91'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:09 user nova-compute[74776]: INFO os_vif [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:46:dd,bridge_name='br-int',has_traffic_filtering=True,id=ee7ecf07-d931-49bf-a7a3-289e575911a4,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee7ecf07-d9')
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:31:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] No VIF found with MAC fa:16:3e:b0:46:dd, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:31:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:10 user nova-compute[74776]: DEBUG nova.compute.manager [req-86243320-bd44-4be9-924b-809f4830152d req-e6d37db4-31d2-4cf4-827c-01aded0a3224 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Received event network-changed-ee7ecf07-d931-49bf-a7a3-289e575911a4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:31:10 user nova-compute[74776]: DEBUG nova.compute.manager [req-86243320-bd44-4be9-924b-809f4830152d req-e6d37db4-31d2-4cf4-827c-01aded0a3224 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Refreshing instance network info cache due to event network-changed-ee7ecf07-d931-49bf-a7a3-289e575911a4. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:31:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-86243320-bd44-4be9-924b-809f4830152d req-e6d37db4-31d2-4cf4-827c-01aded0a3224 service nova] Acquiring lock "refresh_cache-34f85084-64b0-4bfa-b5b7-744e3f26cd91" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:31:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-86243320-bd44-4be9-924b-809f4830152d req-e6d37db4-31d2-4cf4-827c-01aded0a3224 service nova] Acquired lock "refresh_cache-34f85084-64b0-4bfa-b5b7-744e3f26cd91" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:31:10 user nova-compute[74776]: DEBUG nova.network.neutron [req-86243320-bd44-4be9-924b-809f4830152d req-e6d37db4-31d2-4cf4-827c-01aded0a3224 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Refreshing network info cache for port ee7ecf07-d931-49bf-a7a3-289e575911a4 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:31:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:11 user nova-compute[74776]: DEBUG nova.network.neutron [req-86243320-bd44-4be9-924b-809f4830152d req-e6d37db4-31d2-4cf4-827c-01aded0a3224 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Updated VIF entry in instance network info cache for port ee7ecf07-d931-49bf-a7a3-289e575911a4. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:31:11 user nova-compute[74776]: DEBUG nova.network.neutron [req-86243320-bd44-4be9-924b-809f4830152d req-e6d37db4-31d2-4cf4-827c-01aded0a3224 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Updating instance_info_cache with network_info: [{"id": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "address": "fa:16:3e:b0:46:dd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7ecf07-d9", "ovs_interfaceid": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:31:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-86243320-bd44-4be9-924b-809f4830152d req-e6d37db4-31d2-4cf4-827c-01aded0a3224 service nova] Releasing lock "refresh_cache-34f85084-64b0-4bfa-b5b7-744e3f26cd91" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:31:11 user nova-compute[74776]: DEBUG nova.compute.manager [req-86243320-bd44-4be9-924b-809f4830152d req-e6d37db4-31d2-4cf4-827c-01aded0a3224 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Received event network-vif-plugged-ee7ecf07-d931-49bf-a7a3-289e575911a4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:31:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-86243320-bd44-4be9-924b-809f4830152d req-e6d37db4-31d2-4cf4-827c-01aded0a3224 service nova] Acquiring lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-86243320-bd44-4be9-924b-809f4830152d req-e6d37db4-31d2-4cf4-827c-01aded0a3224 service nova] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-86243320-bd44-4be9-924b-809f4830152d req-e6d37db4-31d2-4cf4-827c-01aded0a3224 service nova] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:11 user nova-compute[74776]: DEBUG nova.compute.manager [req-86243320-bd44-4be9-924b-809f4830152d req-e6d37db4-31d2-4cf4-827c-01aded0a3224 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] No waiting events found dispatching network-vif-plugged-ee7ecf07-d931-49bf-a7a3-289e575911a4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:31:11 user nova-compute[74776]: WARNING nova.compute.manager [req-86243320-bd44-4be9-924b-809f4830152d req-e6d37db4-31d2-4cf4-827c-01aded0a3224 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Received unexpected event network-vif-plugged-ee7ecf07-d931-49bf-a7a3-289e575911a4 for instance with vm_state building and task_state spawning.
Nov 22 14:31:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:31:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:31:12 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Instance spawned successfully.
Nov 22 14:31:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:31:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:31:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:31:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:31:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:31:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:31:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:31:12 user nova-compute[74776]: INFO nova.compute.manager [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 22 14:31:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:31:12 user nova-compute[74776]: INFO nova.compute.manager [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Took 6.10 seconds to build instance.
Nov 22 14:31:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2c45c30-427f-424b-9363-fc26cae722c7 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.283s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-f917a54e-e68c-4766-880c-8134ee98e0dd req-02f7949b-78e7-4c51-b1fb-e84251c600d2 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Received event network-vif-plugged-ee7ecf07-d931-49bf-a7a3-289e575911a4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:31:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f917a54e-e68c-4766-880c-8134ee98e0dd req-02f7949b-78e7-4c51-b1fb-e84251c600d2 service nova] Acquiring lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f917a54e-e68c-4766-880c-8134ee98e0dd req-02f7949b-78e7-4c51-b1fb-e84251c600d2 service nova] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f917a54e-e68c-4766-880c-8134ee98e0dd req-02f7949b-78e7-4c51-b1fb-e84251c600d2 service nova] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-f917a54e-e68c-4766-880c-8134ee98e0dd req-02f7949b-78e7-4c51-b1fb-e84251c600d2 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] No waiting events found dispatching network-vif-plugged-ee7ecf07-d931-49bf-a7a3-289e575911a4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:31:12 user nova-compute[74776]: WARNING nova.compute.manager [req-f917a54e-e68c-4766-880c-8134ee98e0dd req-02f7949b-78e7-4c51-b1fb-e84251c600d2 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Received unexpected event network-vif-plugged-ee7ecf07-d931-49bf-a7a3-289e575911a4 for instance with vm_state active and task_state None.
Nov 22 14:31:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:14 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:31:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:15 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:31:16 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:31:18 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:31:18 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:31:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-f4f30fe7-b234-4f81-b081-3214f5ebe789" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:31:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-f4f30fe7-b234-4f81-b081-3214f5ebe789" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:31:18 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:31:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:19 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Updating instance_info_cache with network_info: [{"id": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "address": "fa:16:3e:46:10:91", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669801ba-1e", "ovs_interfaceid": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:31:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-f4f30fe7-b234-4f81-b081-3214f5ebe789" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:31:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:31:19 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:31:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:31:19 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:31:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:19 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:31:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-906db4b7-50eb-4a7e-bebd-f0ef50415c25 req-74c3705d-f2e1-42b8-a87d-3cc01781fa27 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received event network-changed-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-906db4b7-50eb-4a7e-bebd-f0ef50415c25 req-74c3705d-f2e1-42b8-a87d-3cc01781fa27 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Refreshing instance network info cache due to event network-changed-5b603149-0a4f-4aac-890c-fade34245023. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-906db4b7-50eb-4a7e-bebd-f0ef50415c25 req-74c3705d-f2e1-42b8-a87d-3cc01781fa27 service nova] Acquiring lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-906db4b7-50eb-4a7e-bebd-f0ef50415c25 req-74c3705d-f2e1-42b8-a87d-3cc01781fa27 service nova] Acquired lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG nova.network.neutron [req-906db4b7-50eb-4a7e-bebd-f0ef50415c25 req-74c3705d-f2e1-42b8-a87d-3cc01781fa27 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Refreshing network info cache for port 5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquiring lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquiring lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:20 user nova-compute[74776]: INFO nova.compute.manager [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Terminating instance
Nov 22 14:31:20 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-57454fb5-70ab-4fbb-8084-4ba5e2af36d7 req-ede859c6-fe9b-45d6-8459-a0e032f1edec service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received event network-vif-unplugged-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-57454fb5-70ab-4fbb-8084-4ba5e2af36d7 req-ede859c6-fe9b-45d6-8459-a0e032f1edec service nova] Acquiring lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-57454fb5-70ab-4fbb-8084-4ba5e2af36d7 req-ede859c6-fe9b-45d6-8459-a0e032f1edec service nova] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-57454fb5-70ab-4fbb-8084-4ba5e2af36d7 req-ede859c6-fe9b-45d6-8459-a0e032f1edec service nova] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-57454fb5-70ab-4fbb-8084-4ba5e2af36d7 req-ede859c6-fe9b-45d6-8459-a0e032f1edec service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] No waiting events found dispatching network-vif-unplugged-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-57454fb5-70ab-4fbb-8084-4ba5e2af36d7 req-ede859c6-fe9b-45d6-8459-a0e032f1edec service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received event network-vif-unplugged-5b603149-0a4f-4aac-890c-fade34245023 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG nova.network.neutron [req-906db4b7-50eb-4a7e-bebd-f0ef50415c25 req-74c3705d-f2e1-42b8-a87d-3cc01781fa27 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Updated VIF entry in instance network info cache for port 5b603149-0a4f-4aac-890c-fade34245023. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG nova.network.neutron [req-906db4b7-50eb-4a7e-bebd-f0ef50415c25 req-74c3705d-f2e1-42b8-a87d-3cc01781fa27 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Updating instance_info_cache with network_info: [{"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-906db4b7-50eb-4a7e-bebd-f0ef50415c25 req-74c3705d-f2e1-42b8-a87d-3cc01781fa27 service nova] Releasing lock "refresh_cache-b30a5c6b-ea71-4a06-ad03-a02ebd584a80" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:20 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Instance destroyed successfully.
Nov 22 14:31:20 user nova-compute[74776]: DEBUG nova.objects.instance [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lazy-loading 'resources' on Instance uuid b30a5c6b-ea71-4a06-ad03-a02ebd584a80 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T14:25:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-119206767',display_name='tempest-TestShelveInstance-server-119206767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-119206767',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAY6ASuS5HQb0Xhyk8b/r17lDnLrYyVvejz9OGw9Kf2fl3G9OMz9U29Vip6hne9mXyZRC73c3UMqFhEVUf4qdE4RGUmgaMzQe1KU1y7kuHHYBb8TVv/cp8qnXOvkKgma9g==',key_name='tempest-TestShelveInstance-457038765',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:29:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='529b6ffebfe549278c4462796677a969',ramdisk_id='',reservation_id='r-lsktxgb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-853764329',owner_user_name='tempest-TestShelveInstance-853764329-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:29:42Z,user_data=None,user_id='1d42ed53e03c4b6b8989293a3737d2f2',uuid=b30a5c6b-ea71-4a06-ad03-a02ebd584a80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Converting VIF {"id": "5b603149-0a4f-4aac-890c-fade34245023", "address": "fa:16:3e:c6:cc:9b", "network": {"id": "bac4cf3b-8492-4d07-859d-266e1cddf6f0", "bridge": "br-int", "label": "tempest-TestShelveInstance-1850725814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "529b6ffebfe549278c4462796677a969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b603149-0a", "ovs_interfaceid": "5b603149-0a4f-4aac-890c-fade34245023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:cc:9b,bridge_name='br-int',has_traffic_filtering=True,id=5b603149-0a4f-4aac-890c-fade34245023,network=Network(bac4cf3b-8492-4d07-859d-266e1cddf6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b603149-0a') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG os_vif [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:cc:9b,bridge_name='br-int',has_traffic_filtering=True,id=5b603149-0a4f-4aac-890c-fade34245023,network=Network(bac4cf3b-8492-4d07-859d-266e1cddf6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b603149-0a') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b603149-0a, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2928f8a4-f467-4a54-b4b4-dfc816a41eba) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:21 user nova-compute[74776]: INFO os_vif [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:cc:9b,bridge_name='br-int',has_traffic_filtering=True,id=5b603149-0a4f-4aac-890c-fade34245023,network=Network(bac4cf3b-8492-4d07-859d-266e1cddf6f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b603149-0a')
Nov 22 14:31:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeMqQUCF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:31:21 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:31:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a14c076-10cc-48f0-90dc-9b16222ecf64]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:31:21 user nova-compute[74776]: No targets found.
Nov 22 14:31:21 user nova-compute[74776]: iSNS:
Nov 22 14:31:21 user nova-compute[74776]: No targets found.
Nov 22 14:31:21 user nova-compute[74776]: STATIC:
Nov 22 14:31:21 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09
Nov 22 14:31:21 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:31:21 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:31:21 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3
Nov 22 14:31:21 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:31:21 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:31:21 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a
Nov 22 14:31:21 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:31:21 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:31:21 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb
Nov 22 14:31:21 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:31:21 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:31:21 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71
Nov 22 14:31:21 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:31:21 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:31:21 user nova-compute[74776]: FIRMWARE:
Nov 22 14:31:21 user nova-compute[74776]: No targets found.
Nov 22 14:31:21 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:31:21 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:31:21 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fad67b0-7f38-46b0-8226-0c1db8b20fbc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c422dee-a25a-4768-b144-10e3e99d8f10]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:31:21 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:31:21 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:31:21 user nova-compute[74776]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:31:21 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:31:21 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:31:21 user nova-compute[74776]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 (non-flash)
Nov 22 14:31:21 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:31:21 user nova-compute[74776]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:31:21 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:31:21 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c58257c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71'): ({'sdd'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Removing single pathed devices sdd {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bad23b-d48f-4a76-b1c1-fe171f6bdb1c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7fe41d-7ea0-420d-903b-bce03fe4c338]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Flushing IO for device /dev/sdd {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d94c1b-7012-4b13-8e1a-6d6037c0bca8]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ccf061-14de-44d7-bd5b-6a66c98c108d]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] SCSI volumes sdd have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e007b91-2275-4a95-b2cc-10dd1f284163]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b519fbcb-2742-4824-858c-df7fc9aac9ed]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71, portal: 172.16.0.220,3260]
Nov 22 14:31:21 user nova-compute[74776]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71, portal: 172.16.0.220,3260] successful.
Nov 22 14:31:21 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4916cee9-8763-4a88-a0d4-2555e772ec71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[61478f58-7e4c-4f51-b755-0c1f94d29958]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] <== disconnect_volume: return (411ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:31:21 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Deleting instance files /opt/stack/data/nova/instances/b30a5c6b-ea71-4a06-ad03-a02ebd584a80_del
Nov 22 14:31:21 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Deletion of /opt/stack/data/nova/instances/b30a5c6b-ea71-4a06-ad03-a02ebd584a80_del complete
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:21 user nova-compute[74776]: INFO nova.compute.manager [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:21 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:31:21 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Took 0.41 seconds to deallocate network for instance.
Nov 22 14:31:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:31:22 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Error from libvirt while getting description of instance-00000018: [Error Code 42] Domain not found: no domain with matching uuid 'b30a5c6b-ea71-4a06-ad03-a02ebd584a80' (instance-00000018): libvirt.libvirtError: Domain not found: no domain with matching uuid 'b30a5c6b-ea71-4a06-ad03-a02ebd584a80' (instance-00000018)
Nov 22 14:31:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:31:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:22 user nova-compute[74776]: DEBUG nova.compute.manager [req-4b9cdc30-e025-4b5c-be09-4b9ae78bfe07 req-67438ca3-53c8-4447-9a94-24cb7bfb6904 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received event network-vif-plugged-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:31:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4b9cdc30-e025-4b5c-be09-4b9ae78bfe07 req-67438ca3-53c8-4447-9a94-24cb7bfb6904 service nova] Acquiring lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4b9cdc30-e025-4b5c-be09-4b9ae78bfe07 req-67438ca3-53c8-4447-9a94-24cb7bfb6904 service nova] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4b9cdc30-e025-4b5c-be09-4b9ae78bfe07 req-67438ca3-53c8-4447-9a94-24cb7bfb6904 service nova] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:22 user nova-compute[74776]: DEBUG nova.compute.manager [req-4b9cdc30-e025-4b5c-be09-4b9ae78bfe07 req-67438ca3-53c8-4447-9a94-24cb7bfb6904 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] No waiting events found dispatching network-vif-plugged-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:31:22 user nova-compute[74776]: WARNING nova.compute.manager [req-4b9cdc30-e025-4b5c-be09-4b9ae78bfe07 req-67438ca3-53c8-4447-9a94-24cb7bfb6904 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received unexpected event network-vif-plugged-5b603149-0a4f-4aac-890c-fade34245023 for instance with vm_state active and task_state deleting.
Nov 22 14:31:22 user nova-compute[74776]: DEBUG nova.compute.manager [req-4b9cdc30-e025-4b5c-be09-4b9ae78bfe07 req-67438ca3-53c8-4447-9a94-24cb7bfb6904 service nova] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Received event network-vif-deleted-5b603149-0a4f-4aac-890c-fade34245023 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:31:22 user nova-compute[74776]: INFO nova.compute.manager [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Took 0.77 seconds to detach 1 volumes for instance.
Nov 22 14:31:22 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] [instance: b30a5c6b-ea71-4a06-ad03-a02ebd584a80] Deleting volume: 4916cee9-8763-4a88-a0d4-2555e772ec71 {{(pid=74776) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 22 14:31:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:23 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Deleted allocations for instance b30a5c6b-ea71-4a06-ad03-a02ebd584a80
Nov 22 14:31:23 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:31:23 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:31:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=7466MB free_disk=25.03472900390625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c4a87e37-4c21-41ba-a044-5408c967aaf8 tempest-TestShelveInstance-853764329 tempest-TestShelveInstance-853764329-project-member] Lock "b30a5c6b-ea71-4a06-ad03-a02ebd584a80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.652s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Applying migration context for instance 245ff2b1-5e87-4756-b4c1-86a2fea089a5 as it has an incoming, in-progress migration 60b093a3-1b59-4ec2-94fa-f3f9d6307534. Migration status is finished {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 22 14:31:23 user nova-compute[74776]: INFO nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Updating resource usage from migration 60b093a3-1b59-4ec2-94fa-f3f9d6307534
Nov 22 14:31:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4629d82d-fd02-4a58-a535-b362b493e7c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 525baf66-82cc-4e8d-a37a-c92c51d4673d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6f2ce4b2-660c-431f-b951-c6ec5090ef7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f4f30fe7-b234-4f81-b081-3214f5ebe789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance bc98341b-ca28-4097-9887-16c8e8d7f9f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 68b6744f-c29d-4ccd-83ab-fcc31666d69b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance d374cfe8-6d04-4c4e-9055-f46488a76ed8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Migration 60b093a3-1b59-4ec2-94fa-f3f9d6307534 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 245ff2b1-5e87-4756-b4c1-86a2fea089a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 47d7c0f7-8496-4766-8717-5da631f7c94b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 34f85084-64b0-4bfa-b5b7-744e3f26cd91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:31:23 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:31:24 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:31:24 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:31:24 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:31:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-308b3536-b5b8-420c-ae86-d9b998af227e tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-308b3536-b5b8-420c-ae86-d9b998af227e tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:26 user nova-compute[74776]: DEBUG nova.compute.manager [None req-308b3536-b5b8-420c-ae86-d9b998af227e tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Going to confirm migration 2 {{(pid=74776) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 22 14:31:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-308b3536-b5b8-420c-ae86-d9b998af227e tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "refresh_cache-245ff2b1-5e87-4756-b4c1-86a2fea089a5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:31:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-308b3536-b5b8-420c-ae86-d9b998af227e tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquired lock "refresh_cache-245ff2b1-5e87-4756-b4c1-86a2fea089a5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:31:26 user nova-compute[74776]: DEBUG nova.network.neutron [None req-308b3536-b5b8-420c-ae86-d9b998af227e tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:31:26 user nova-compute[74776]: DEBUG nova.objects.instance [None req-308b3536-b5b8-420c-ae86-d9b998af227e tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lazy-loading 'info_cache' on Instance uuid 245ff2b1-5e87-4756-b4c1-86a2fea089a5 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:31:27 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:31:27 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:31:27 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:31:27 user nova-compute[74776]: DEBUG nova.network.neutron [None req-308b3536-b5b8-420c-ae86-d9b998af227e tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Updating instance_info_cache with network_info: [{"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:31:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-308b3536-b5b8-420c-ae86-d9b998af227e tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Releasing lock "refresh_cache-245ff2b1-5e87-4756-b4c1-86a2fea089a5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:31:27 user nova-compute[74776]: DEBUG nova.objects.instance [None req-308b3536-b5b8-420c-ae86-d9b998af227e tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lazy-loading 'migration_context' on Instance uuid 245ff2b1-5e87-4756-b4c1-86a2fea089a5 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:31:27 user nova-compute[74776]: DEBUG nova.objects.base [None req-308b3536-b5b8-420c-ae86-d9b998af227e tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Object Instance<245ff2b1-5e87-4756-b4c1-86a2fea089a5> lazy-loaded attributes: info_cache,migration_context {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:31:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-308b3536-b5b8-420c-ae86-d9b998af227e tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-308b3536-b5b8-420c-ae86-d9b998af227e tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:27 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-308b3536-b5b8-420c-ae86-d9b998af227e tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:31:27 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-308b3536-b5b8-420c-ae86-d9b998af227e tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:31:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-308b3536-b5b8-420c-ae86-d9b998af227e tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.386s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:27 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-308b3536-b5b8-420c-ae86-d9b998af227e tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Deleted allocation for migration 60b093a3-1b59-4ec2-94fa-f3f9d6307534
Nov 22 14:31:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-308b3536-b5b8-420c-ae86-d9b998af227e tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.266s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:31:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:31:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:31:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:31:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG nova.compute.manager [req-ccf0ed44-46bb-40a2-ad67-051fd6d717df req-1d9661df-01ee-4119-8b0f-cc27d69ab8d6 service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Received event network-changed-cfc90514-d813-4c8e-8f0a-2f538ea95e23 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG nova.compute.manager [req-ccf0ed44-46bb-40a2-ad67-051fd6d717df req-1d9661df-01ee-4119-8b0f-cc27d69ab8d6 service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Refreshing instance network info cache due to event network-changed-cfc90514-d813-4c8e-8f0a-2f538ea95e23. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ccf0ed44-46bb-40a2-ad67-051fd6d717df req-1d9661df-01ee-4119-8b0f-cc27d69ab8d6 service nova] Acquiring lock "refresh_cache-47d7c0f7-8496-4766-8717-5da631f7c94b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ccf0ed44-46bb-40a2-ad67-051fd6d717df req-1d9661df-01ee-4119-8b0f-cc27d69ab8d6 service nova] Acquired lock "refresh_cache-47d7c0f7-8496-4766-8717-5da631f7c94b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG nova.network.neutron [req-ccf0ed44-46bb-40a2-ad67-051fd6d717df req-1d9661df-01ee-4119-8b0f-cc27d69ab8d6 service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Refreshing network info cache for port cfc90514-d813-4c8e-8f0a-2f538ea95e23 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "47d7c0f7-8496-4766-8717-5da631f7c94b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "47d7c0f7-8496-4766-8717-5da631f7c94b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG nova.objects.instance [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lazy-loading 'flavor' on Instance uuid 47d7c0f7-8496-4766-8717-5da631f7c94b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:31:59 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Ignoring supplied device name: /dev/vdb
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "47d7c0f7-8496-4766-8717-5da631f7c94b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "47d7c0f7-8496-4766-8717-5da631f7c94b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "47d7c0f7-8496-4766-8717-5da631f7c94b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:31:59 user nova-compute[74776]: INFO nova.compute.manager [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Attaching volume 2eb57bca-9d35-43ca-8e87-467ec5116c12 to /dev/vdb
Nov 22 14:31:59 user nova-compute[74776]: DEBUG os_brick.utils [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5bace1-a897-4ecf-8d2e-dd694fb7bffb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00e8860-b39d-4e62-bf5c-ec5241884a71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e993755-816f-43d4-9a67-971b05baf6c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b46da26-4b19-4ab4-b922-0f633250e675]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:31:59 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:31:59 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[88838e0b-e294-47c5-8445-c12f4e2572fa]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG os_brick.utils [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Updating existing volume attachment record: e7568bc8-227f-4382-8047-842c3c9279d0 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG nova.network.neutron [req-ccf0ed44-46bb-40a2-ad67-051fd6d717df req-1d9661df-01ee-4119-8b0f-cc27d69ab8d6 service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Updated VIF entry in instance network info cache for port cfc90514-d813-4c8e-8f0a-2f538ea95e23. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:31:59 user nova-compute[74776]: DEBUG nova.network.neutron [req-ccf0ed44-46bb-40a2-ad67-051fd6d717df req-1d9661df-01ee-4119-8b0f-cc27d69ab8d6 service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Updating instance_info_cache with network_info: [{"id": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "address": "fa:16:3e:8c:2c:13", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc90514-d8", "ovs_interfaceid": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:32:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ccf0ed44-46bb-40a2-ad67-051fd6d717df req-1d9661df-01ee-4119-8b0f-cc27d69ab8d6 service nova] Releasing lock "refresh_cache-47d7c0f7-8496-4766-8717-5da631f7c94b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:32:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:00 user nova-compute[74776]: DEBUG nova.compute.manager [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:32:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:00 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:32:00 user nova-compute[74776]: INFO nova.compute.claims [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Claim successful on node user
Nov 22 14:32:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:00 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:32:00 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:32:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:00 user nova-compute[74776]: DEBUG nova.compute.manager [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:32:00 user nova-compute[74776]: DEBUG nova.compute.manager [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:32:00 user nova-compute[74776]: DEBUG nova.network.neutron [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:32:00 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:32:00 user nova-compute[74776]: DEBUG nova.compute.manager [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG nova.policy [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c63eae228f99474899ce0620a4affe75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d6da4f9f4149479a779475a69c9110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG nova.compute.manager [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:32:01 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Creating image(s)
Nov 22 14:32:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "/opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "/opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.191s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk 1073741824" returned: 0 in 0.051s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.198s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG nova.network.neutron [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Successfully created port: 9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Cannot resize image /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Ensure instance console log exists: /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.network.neutron [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Successfully updated port: 9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "refresh_cache-ac14ec9b-986a-4fe3-97e3-afbaaca431af" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquired lock "refresh_cache-ac14ec9b-986a-4fe3-97e3-afbaaca431af" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.network.neutron [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.network.neutron [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-46917fb9-cd33-4e29-9484-14d9783e5319 req-cf8b8c32-4c59-4df8-88f7-c01981fa212b service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Received event network-changed-9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-46917fb9-cd33-4e29-9484-14d9783e5319 req-cf8b8c32-4c59-4df8-88f7-c01981fa212b service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Refreshing instance network info cache due to event network-changed-9612ebd1-69ec-436b-b721-5b869e501abe. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-46917fb9-cd33-4e29-9484-14d9783e5319 req-cf8b8c32-4c59-4df8-88f7-c01981fa212b service nova] Acquiring lock "refresh_cache-ac14ec9b-986a-4fe3-97e3-afbaaca431af" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.network.neutron [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Updating instance_info_cache with network_info: [{"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9612ebd1-69", "ovs_interfaceid": "9612ebd1-69ec-436b-b721-5b869e501abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Releasing lock "refresh_cache-ac14ec9b-986a-4fe3-97e3-afbaaca431af" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.compute.manager [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Instance network_info: |[{"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9612ebd1-69", "ovs_interfaceid": "9612ebd1-69ec-436b-b721-5b869e501abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-46917fb9-cd33-4e29-9484-14d9783e5319 req-cf8b8c32-4c59-4df8-88f7-c01981fa212b service nova] Acquired lock "refresh_cache-ac14ec9b-986a-4fe3-97e3-afbaaca431af" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.network.neutron [req-46917fb9-cd33-4e29-9484-14d9783e5319 req-cf8b8c32-4c59-4df8-88f7-c01981fa212b service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Refreshing network info cache for port 9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Start _get_guest_xml network_info=[{"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9612ebd1-69", "ovs_interfaceid": "9612ebd1-69ec-436b-b721-5b869e501abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:32:02 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:32:02 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:32:02 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-760894069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-760894069',id=33,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdVv6ik0x7LTS3T1xKKEQGeVfCF7kChgagVSWlM65HLoyqkv00NkhIQaIYoNFWaBTsZzvGaoREtSwBYGqWRiYq6NdXaQJ6NWlqMyEGRS4eJZ8BDoKPxJuJ060BQc80P9A==',key_name='tempest-keypair-1459052423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1d6da4f9f4149479a779475a69c9110',ramdisk_id='',reservation_id='r-bhjjpdd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1293931160',owner_user_name='tempest-AttachVolumeShelveTestJSON-1293931160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c63eae228f99474899ce0620a4affe75',uuid=ac14ec9b-986a-4fe3-97e3-afbaaca431af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9612ebd1-69", "ovs_interfaceid": "9612ebd1-69ec-436b-b721-5b869e501abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converting VIF {"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9612ebd1-69", "ovs_interfaceid": "9612ebd1-69ec-436b-b721-5b869e501abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c5:4b,bridge_name='br-int',has_traffic_filtering=True,id=9612ebd1-69ec-436b-b721-5b869e501abe,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9612ebd1-69') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG nova.objects.instance [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lazy-loading 'pci_devices' on Instance uuid ac14ec9b-986a-4fe3-97e3-afbaaca431af {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:32:03 user nova-compute[74776]:   <uuid>ac14ec9b-986a-4fe3-97e3-afbaaca431af</uuid>
Nov 22 14:32:03 user nova-compute[74776]:   <name>instance-00000021</name>
Nov 22 14:32:03 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:32:03 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:32:03 user nova-compute[74776]:   <metadata>
Nov 22 14:32:03 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:32:03 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:32:03 user nova-compute[74776]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-760894069</nova:name>
Nov 22 14:32:03 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:32:02</nova:creationTime>
Nov 22 14:32:03 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:32:03 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:32:03 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:32:03 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:32:03 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:32:03 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:32:03 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:32:03 user nova-compute[74776]:       <nova:owner>
Nov 22 14:32:03 user nova-compute[74776]:         <nova:user uuid="c63eae228f99474899ce0620a4affe75">tempest-AttachVolumeShelveTestJSON-1293931160-project-member</nova:user>
Nov 22 14:32:03 user nova-compute[74776]:         <nova:project uuid="b1d6da4f9f4149479a779475a69c9110">tempest-AttachVolumeShelveTestJSON-1293931160</nova:project>
Nov 22 14:32:03 user nova-compute[74776]:       </nova:owner>
Nov 22 14:32:03 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:32:03 user nova-compute[74776]:       <nova:ports>
Nov 22 14:32:03 user nova-compute[74776]:         <nova:port uuid="9612ebd1-69ec-436b-b721-5b869e501abe">
Nov 22 14:32:03 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 14:32:03 user nova-compute[74776]:         </nova:port>
Nov 22 14:32:03 user nova-compute[74776]:       </nova:ports>
Nov 22 14:32:03 user nova-compute[74776]:     </nova:instance>
Nov 22 14:32:03 user nova-compute[74776]:   </metadata>
Nov 22 14:32:03 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:32:03 user nova-compute[74776]:     <system>
Nov 22 14:32:03 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:32:03 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:32:03 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:32:03 user nova-compute[74776]:       <entry name="serial">ac14ec9b-986a-4fe3-97e3-afbaaca431af</entry>
Nov 22 14:32:03 user nova-compute[74776]:       <entry name="uuid">ac14ec9b-986a-4fe3-97e3-afbaaca431af</entry>
Nov 22 14:32:03 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:32:03 user nova-compute[74776]:     </system>
Nov 22 14:32:03 user nova-compute[74776]:   </sysinfo>
Nov 22 14:32:03 user nova-compute[74776]:   <os>
Nov 22 14:32:03 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:32:03 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:32:03 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:32:03 user nova-compute[74776]:   </os>
Nov 22 14:32:03 user nova-compute[74776]:   <features>
Nov 22 14:32:03 user nova-compute[74776]:     <acpi/>
Nov 22 14:32:03 user nova-compute[74776]:     <apic/>
Nov 22 14:32:03 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:32:03 user nova-compute[74776]:   </features>
Nov 22 14:32:03 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:32:03 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:32:03 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:32:03 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:32:03 user nova-compute[74776]:   </clock>
Nov 22 14:32:03 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:32:03 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:32:03 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:32:03 user nova-compute[74776]:   </cpu>
Nov 22 14:32:03 user nova-compute[74776]:   <devices>
Nov 22 14:32:03 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:32:03 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:32:03 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk"/>
Nov 22 14:32:03 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:32:03 user nova-compute[74776]:     </disk>
Nov 22 14:32:03 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:32:03 user nova-compute[74776]:       <mac address="fa:16:3e:3d:c5:4b"/>
Nov 22 14:32:03 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:32:03 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:32:03 user nova-compute[74776]:       <target dev="tap9612ebd1-69"/>
Nov 22 14:32:03 user nova-compute[74776]:     </interface>
Nov 22 14:32:03 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:32:03 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/console.log" append="off"/>
Nov 22 14:32:03 user nova-compute[74776]:     </serial>
Nov 22 14:32:03 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:32:03 user nova-compute[74776]:     <video>
Nov 22 14:32:03 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:32:03 user nova-compute[74776]:     </video>
Nov 22 14:32:03 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:32:03 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:32:03 user nova-compute[74776]:     </rng>
Nov 22 14:32:03 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:32:03 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:32:03 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:32:03 user nova-compute[74776]:     </memballoon>
Nov 22 14:32:03 user nova-compute[74776]:   </devices>
Nov 22 14:32:03 user nova-compute[74776]: </domain>
Nov 22 14:32:03 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-760894069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-760894069',id=33,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdVv6ik0x7LTS3T1xKKEQGeVfCF7kChgagVSWlM65HLoyqkv00NkhIQaIYoNFWaBTsZzvGaoREtSwBYGqWRiYq6NdXaQJ6NWlqMyEGRS4eJZ8BDoKPxJuJ060BQc80P9A==',key_name='tempest-keypair-1459052423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1d6da4f9f4149479a779475a69c9110',ramdisk_id='',reservation_id='r-bhjjpdd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1293931160',owner_user_name='tempest-AttachVolumeShelveTestJSON-1293931160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:32:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c63eae228f99474899ce0620a4affe75',uuid=ac14ec9b-986a-4fe3-97e3-afbaaca431af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9612ebd1-69", "ovs_interfaceid": "9612ebd1-69ec-436b-b721-5b869e501abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converting VIF {"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9612ebd1-69", "ovs_interfaceid": "9612ebd1-69ec-436b-b721-5b869e501abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c5:4b,bridge_name='br-int',has_traffic_filtering=True,id=9612ebd1-69ec-436b-b721-5b869e501abe,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9612ebd1-69') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG os_vif [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c5:4b,bridge_name='br-int',has_traffic_filtering=True,id=9612ebd1-69ec-436b-b721-5b869e501abe,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9612ebd1-69') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f7f87a85-5b69-5cdf-889b-e6c92e02abe3', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9612ebd1-69, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9612ebd1-69, col_values=(('qos', UUID('a25f48bb-b048-48b3-b305-4331c2f4bff6')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9612ebd1-69, col_values=(('external_ids', {'iface-id': '9612ebd1-69ec-436b-b721-5b869e501abe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:c5:4b', 'vm-uuid': 'ac14ec9b-986a-4fe3-97e3-afbaaca431af'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:03 user nova-compute[74776]: INFO os_vif [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c5:4b,bridge_name='br-int',has_traffic_filtering=True,id=9612ebd1-69ec-436b-b721-5b869e501abe,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9612ebd1-69')
Nov 22 14:32:03 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] No VIF found with MAC fa:16:3e:3d:c5:4b, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG nova.network.neutron [req-46917fb9-cd33-4e29-9484-14d9783e5319 req-cf8b8c32-4c59-4df8-88f7-c01981fa212b service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Updated VIF entry in instance network info cache for port 9612ebd1-69ec-436b-b721-5b869e501abe. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG nova.network.neutron [req-46917fb9-cd33-4e29-9484-14d9783e5319 req-cf8b8c32-4c59-4df8-88f7-c01981fa212b service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Updating instance_info_cache with network_info: [{"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9612ebd1-69", "ovs_interfaceid": "9612ebd1-69ec-436b-b721-5b869e501abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:32:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-46917fb9-cd33-4e29-9484-14d9783e5319 req-cf8b8c32-4c59-4df8-88f7-c01981fa212b service nova] Releasing lock "refresh_cache-ac14ec9b-986a-4fe3-97e3-afbaaca431af" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:32:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:04 user nova-compute[74776]: DEBUG nova.compute.manager [req-529d3b29-ba05-4e73-990d-89f1fe0c69ec req-9987be52-6c7c-4700-bfb1-e76b85256c7c service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Received event network-vif-plugged-9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:32:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-529d3b29-ba05-4e73-990d-89f1fe0c69ec req-9987be52-6c7c-4700-bfb1-e76b85256c7c service nova] Acquiring lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-529d3b29-ba05-4e73-990d-89f1fe0c69ec req-9987be52-6c7c-4700-bfb1-e76b85256c7c service nova] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-529d3b29-ba05-4e73-990d-89f1fe0c69ec req-9987be52-6c7c-4700-bfb1-e76b85256c7c service nova] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:04 user nova-compute[74776]: DEBUG nova.compute.manager [req-529d3b29-ba05-4e73-990d-89f1fe0c69ec req-9987be52-6c7c-4700-bfb1-e76b85256c7c service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] No waiting events found dispatching network-vif-plugged-9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:32:04 user nova-compute[74776]: WARNING nova.compute.manager [req-529d3b29-ba05-4e73-990d-89f1fe0c69ec req-9987be52-6c7c-4700-bfb1-e76b85256c7c service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Received unexpected event network-vif-plugged-9612ebd1-69ec-436b-b721-5b869e501abe for instance with vm_state building and task_state spawning.
Nov 22 14:32:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "7819c3bf-bf3e-4012-8fcc-19226486de8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "7819c3bf-bf3e-4012-8fcc-19226486de8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:05 user nova-compute[74776]: DEBUG nova.compute.manager [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:32:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:05 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:32:05 user nova-compute[74776]: INFO nova.compute.claims [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Claim successful on node user
Nov 22 14:32:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AeronJDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:32:06 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:32:06 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:32:06 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[80db8007-eb2f-4eec-bd0d-353c28242612]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:32:06 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca7680e-0c84-46c1-b2e9-9280eba4ecf4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12] added
Nov 22 14:32:06 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[335f164e-9229-4f4a-989b-b50d7f734614]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac18ea3-16cf-4ae7-9fca-68ceaf29da21]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AeronJDu {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AeronJDu" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[269c4a17-6e22-4623-8029-00b0e0caf3e0]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AeronJDu'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d8693a-4062-45ee-9b43-6577c0f5a87f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4d2d54-29b7-4de4-8449-f498d00fddf9]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG nova.network.neutron [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:32:06 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:32:06 user nova-compute[74776]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:32:06 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:32:06 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:32:06 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:32:06 user nova-compute[74776]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:32:06 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:32:06 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:06 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:32:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb7e1d9-1071-4733-a0b0-52a65c71c73a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12, portal: 172.16.0.220,3260]
Nov 22 14:32:06 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12, portal: 172.16.0.220,3260] successful.
Nov 22 14:32:06 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[849fb100-76b4-4e3f-aca6-5a4f2b960e7b]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG nova.policy [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dea876275c70471d9cba1c3158bd63e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359aba8e95e4090a02fb0a46012f20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a23a9bb-fca5-4b58-af01-3e30ebfb4373]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:32:06 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:32:06 user nova-compute[74776]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:32:06 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:32:06 user nova-compute[74776]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 (non-flash)
Nov 22 14:32:06 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:32:06 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:32:06 user nova-compute[74776]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:32:06 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:32:06 user nova-compute[74776]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 (non-flash)
Nov 22 14:32:06 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd093fdd-6d7a-4bef-829c-895afa0f3a98]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AeronJDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:32:06 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Creating image(s)
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "/opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "/opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "/opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.179s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.168s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-f3ef1bdd-3e19-437b-a34e-942b3716c5ea req-3532638c-e0e6-4138-acce-0fa024eeb89e service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Received event network-vif-plugged-9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f3ef1bdd-3e19-437b-a34e-942b3716c5ea req-3532638c-e0e6-4138-acce-0fa024eeb89e service nova] Acquiring lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f3ef1bdd-3e19-437b-a34e-942b3716c5ea req-3532638c-e0e6-4138-acce-0fa024eeb89e service nova] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f3ef1bdd-3e19-437b-a34e-942b3716c5ea req-3532638c-e0e6-4138-acce-0fa024eeb89e service nova] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-f3ef1bdd-3e19-437b-a34e-942b3716c5ea req-3532638c-e0e6-4138-acce-0fa024eeb89e service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] No waiting events found dispatching network-vif-plugged-9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:32:06 user nova-compute[74776]: WARNING nova.compute.manager [req-f3ef1bdd-3e19-437b-a34e-942b3716c5ea req-3532638c-e0e6-4138-acce-0fa024eeb89e service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Received unexpected event network-vif-plugged-9612ebd1-69ec-436b-b721-5b869e501abe for instance with vm_state building and task_state spawning.
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk 1073741824" returned: 0 in 0.054s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:06 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Instance spawned successfully.
Nov 22 14:32:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:32:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:32:07 user nova-compute[74776]: INFO nova.compute.manager [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 22 14:32:07 user nova-compute[74776]: DEBUG nova.compute.manager [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG nova.network.neutron [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Successfully created port: 09b0593b-ed06-4e2b-b80e-cf70bad2366c {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.189s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:07 user nova-compute[74776]: INFO nova.compute.manager [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Took 6.78 seconds to build instance.
Nov 22 14:32:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-61bf00a5-df40-489a-ae9f-61ff475b5e40 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.888s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Cannot resize image /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Ensure instance console log exists: /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23432333133663136', 'path': '/dev/sdd'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432333133663136', 'path': '/dev/sdd'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG nova.objects.instance [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lazy-loading 'flavor' on Instance uuid 47d7c0f7-8496-4766-8717-5da631f7c94b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:32:07 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:32:07 user nova-compute[74776]:   <source dev="/dev/sdd"/>
Nov 22 14:32:07 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:32:07 user nova-compute[74776]:   <serial>2eb57bca-9d35-43ca-8e87-467ec5116c12</serial>
Nov 22 14:32:07 user nova-compute[74776]: </disk>
Nov 22 14:32:07 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG nova.network.neutron [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Successfully updated port: 09b0593b-ed06-4e2b-b80e-cf70bad2366c {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "refresh_cache-7819c3bf-bf3e-4012-8fcc-19226486de8e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquired lock "refresh_cache-7819c3bf-bf3e-4012-8fcc-19226486de8e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG nova.network.neutron [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG nova.network.neutron [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:32:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] No VIF found with MAC fa:16:3e:8c:2c:13, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.network.neutron [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Updating instance_info_cache with network_info: [{"id": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "address": "fa:16:3e:55:20:d3", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b0593b-ed", "ovs_interfaceid": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Releasing lock "refresh_cache-7819c3bf-bf3e-4012-8fcc-19226486de8e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.compute.manager [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Instance network_info: |[{"id": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "address": "fa:16:3e:55:20:d3", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b0593b-ed", "ovs_interfaceid": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Start _get_guest_xml network_info=[{"id": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "address": "fa:16:3e:55:20:d3", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b0593b-ed", "ovs_interfaceid": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:32:08 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:32:08 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1282310158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1282310158',id=34,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d359aba8e95e4090a02fb0a46012f20b',ramdisk_id='',reservation_id='r-ejo1vh10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-202976361',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:32:06Z,user_data=None,user_id='dea876275c70471d9cba1c3158bd63e2',uuid=7819c3bf-bf3e-4012-8fcc-19226486de8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "address": "fa:16:3e:55:20:d3", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b0593b-ed", "ovs_interfaceid": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converting VIF {"id": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "address": "fa:16:3e:55:20:d3", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b0593b-ed", "ovs_interfaceid": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:20:d3,bridge_name='br-int',has_traffic_filtering=True,id=09b0593b-ed06-4e2b-b80e-cf70bad2366c,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b0593b-ed') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.objects.instance [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'pci_devices' on Instance uuid 7819c3bf-bf3e-4012-8fcc-19226486de8e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-32f4f28c-b2d3-48b4-826e-f6e5b5cac823 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "47d7c0f7-8496-4766-8717-5da631f7c94b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.628s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:32:08 user nova-compute[74776]:   <uuid>7819c3bf-bf3e-4012-8fcc-19226486de8e</uuid>
Nov 22 14:32:08 user nova-compute[74776]:   <name>instance-00000022</name>
Nov 22 14:32:08 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:32:08 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:32:08 user nova-compute[74776]:   <metadata>
Nov 22 14:32:08 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:32:08 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:32:08 user nova-compute[74776]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1282310158</nova:name>
Nov 22 14:32:08 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:32:08</nova:creationTime>
Nov 22 14:32:08 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:32:08 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:32:08 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:32:08 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:32:08 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:32:08 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:32:08 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:32:08 user nova-compute[74776]:       <nova:owner>
Nov 22 14:32:08 user nova-compute[74776]:         <nova:user uuid="dea876275c70471d9cba1c3158bd63e2">tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member</nova:user>
Nov 22 14:32:08 user nova-compute[74776]:         <nova:project uuid="d359aba8e95e4090a02fb0a46012f20b">tempest-ServerBootFromVolumeStableRescueTest-202976361</nova:project>
Nov 22 14:32:08 user nova-compute[74776]:       </nova:owner>
Nov 22 14:32:08 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:32:08 user nova-compute[74776]:       <nova:ports>
Nov 22 14:32:08 user nova-compute[74776]:         <nova:port uuid="09b0593b-ed06-4e2b-b80e-cf70bad2366c">
Nov 22 14:32:08 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 14:32:08 user nova-compute[74776]:         </nova:port>
Nov 22 14:32:08 user nova-compute[74776]:       </nova:ports>
Nov 22 14:32:08 user nova-compute[74776]:     </nova:instance>
Nov 22 14:32:08 user nova-compute[74776]:   </metadata>
Nov 22 14:32:08 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:32:08 user nova-compute[74776]:     <system>
Nov 22 14:32:08 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:32:08 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:32:08 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:32:08 user nova-compute[74776]:       <entry name="serial">7819c3bf-bf3e-4012-8fcc-19226486de8e</entry>
Nov 22 14:32:08 user nova-compute[74776]:       <entry name="uuid">7819c3bf-bf3e-4012-8fcc-19226486de8e</entry>
Nov 22 14:32:08 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:32:08 user nova-compute[74776]:     </system>
Nov 22 14:32:08 user nova-compute[74776]:   </sysinfo>
Nov 22 14:32:08 user nova-compute[74776]:   <os>
Nov 22 14:32:08 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:32:08 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:32:08 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:32:08 user nova-compute[74776]:   </os>
Nov 22 14:32:08 user nova-compute[74776]:   <features>
Nov 22 14:32:08 user nova-compute[74776]:     <acpi/>
Nov 22 14:32:08 user nova-compute[74776]:     <apic/>
Nov 22 14:32:08 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:32:08 user nova-compute[74776]:   </features>
Nov 22 14:32:08 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:32:08 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:32:08 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:32:08 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:32:08 user nova-compute[74776]:   </clock>
Nov 22 14:32:08 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:32:08 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:32:08 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:32:08 user nova-compute[74776]:   </cpu>
Nov 22 14:32:08 user nova-compute[74776]:   <devices>
Nov 22 14:32:08 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:32:08 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:32:08 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk"/>
Nov 22 14:32:08 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:32:08 user nova-compute[74776]:     </disk>
Nov 22 14:32:08 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:32:08 user nova-compute[74776]:       <mac address="fa:16:3e:55:20:d3"/>
Nov 22 14:32:08 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:32:08 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:32:08 user nova-compute[74776]:       <target dev="tap09b0593b-ed"/>
Nov 22 14:32:08 user nova-compute[74776]:     </interface>
Nov 22 14:32:08 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:32:08 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/console.log" append="off"/>
Nov 22 14:32:08 user nova-compute[74776]:     </serial>
Nov 22 14:32:08 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:32:08 user nova-compute[74776]:     <video>
Nov 22 14:32:08 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:32:08 user nova-compute[74776]:     </video>
Nov 22 14:32:08 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:32:08 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:32:08 user nova-compute[74776]:     </rng>
Nov 22 14:32:08 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:32:08 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:32:08 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:32:08 user nova-compute[74776]:     </memballoon>
Nov 22 14:32:08 user nova-compute[74776]:   </devices>
Nov 22 14:32:08 user nova-compute[74776]: </domain>
Nov 22 14:32:08 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1282310158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1282310158',id=34,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d359aba8e95e4090a02fb0a46012f20b',ramdisk_id='',reservation_id='r-ejo1vh10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-202976361',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:32:06Z,user_data=None,user_id='dea876275c70471d9cba1c3158bd63e2',uuid=7819c3bf-bf3e-4012-8fcc-19226486de8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "address": "fa:16:3e:55:20:d3", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b0593b-ed", "ovs_interfaceid": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converting VIF {"id": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "address": "fa:16:3e:55:20:d3", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b0593b-ed", "ovs_interfaceid": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:20:d3,bridge_name='br-int',has_traffic_filtering=True,id=09b0593b-ed06-4e2b-b80e-cf70bad2366c,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b0593b-ed') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG os_vif [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:20:d3,bridge_name='br-int',has_traffic_filtering=True,id=09b0593b-ed06-4e2b-b80e-cf70bad2366c,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b0593b-ed') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd303a93-ba6c-55d4-b172-66a9a8567bff', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09b0593b-ed, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09b0593b-ed, col_values=(('qos', UUID('ea7dc58b-5c91-4664-8cd9-d8ecdd61ab69')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09b0593b-ed, col_values=(('external_ids', {'iface-id': '09b0593b-ed06-4e2b-b80e-cf70bad2366c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:20:d3', 'vm-uuid': '7819c3bf-bf3e-4012-8fcc-19226486de8e'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:08 user nova-compute[74776]: INFO os_vif [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:20:d3,bridge_name='br-int',has_traffic_filtering=True,id=09b0593b-ed06-4e2b-b80e-cf70bad2366c,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b0593b-ed')
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] No VIF found with MAC fa:16:3e:55:20:d3, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-2316b427-efb9-4086-96d3-8d2671ea8d07 req-95888563-34a4-4aab-a285-0fe609f642b8 service nova] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Received event network-changed-09b0593b-ed06-4e2b-b80e-cf70bad2366c {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-2316b427-efb9-4086-96d3-8d2671ea8d07 req-95888563-34a4-4aab-a285-0fe609f642b8 service nova] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Refreshing instance network info cache due to event network-changed-09b0593b-ed06-4e2b-b80e-cf70bad2366c. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2316b427-efb9-4086-96d3-8d2671ea8d07 req-95888563-34a4-4aab-a285-0fe609f642b8 service nova] Acquiring lock "refresh_cache-7819c3bf-bf3e-4012-8fcc-19226486de8e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2316b427-efb9-4086-96d3-8d2671ea8d07 req-95888563-34a4-4aab-a285-0fe609f642b8 service nova] Acquired lock "refresh_cache-7819c3bf-bf3e-4012-8fcc-19226486de8e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:32:08 user nova-compute[74776]: DEBUG nova.network.neutron [req-2316b427-efb9-4086-96d3-8d2671ea8d07 req-95888563-34a4-4aab-a285-0fe609f642b8 service nova] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Refreshing network info cache for port 09b0593b-ed06-4e2b-b80e-cf70bad2366c {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:32:09 user nova-compute[74776]: DEBUG nova.network.neutron [req-2316b427-efb9-4086-96d3-8d2671ea8d07 req-95888563-34a4-4aab-a285-0fe609f642b8 service nova] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Updated VIF entry in instance network info cache for port 09b0593b-ed06-4e2b-b80e-cf70bad2366c. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:32:09 user nova-compute[74776]: DEBUG nova.network.neutron [req-2316b427-efb9-4086-96d3-8d2671ea8d07 req-95888563-34a4-4aab-a285-0fe609f642b8 service nova] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Updating instance_info_cache with network_info: [{"id": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "address": "fa:16:3e:55:20:d3", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b0593b-ed", "ovs_interfaceid": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:32:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2316b427-efb9-4086-96d3-8d2671ea8d07 req-95888563-34a4-4aab-a285-0fe609f642b8 service nova] Releasing lock "refresh_cache-7819c3bf-bf3e-4012-8fcc-19226486de8e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:32:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-b6859e1a-1e60-434c-9ec7-6445ab6c4a00 req-59c67e83-b9a6-4055-96f2-62d5ee487661 service nova] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Received event network-vif-plugged-09b0593b-ed06-4e2b-b80e-cf70bad2366c {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:32:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b6859e1a-1e60-434c-9ec7-6445ab6c4a00 req-59c67e83-b9a6-4055-96f2-62d5ee487661 service nova] Acquiring lock "7819c3bf-bf3e-4012-8fcc-19226486de8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b6859e1a-1e60-434c-9ec7-6445ab6c4a00 req-59c67e83-b9a6-4055-96f2-62d5ee487661 service nova] Lock "7819c3bf-bf3e-4012-8fcc-19226486de8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b6859e1a-1e60-434c-9ec7-6445ab6c4a00 req-59c67e83-b9a6-4055-96f2-62d5ee487661 service nova] Lock "7819c3bf-bf3e-4012-8fcc-19226486de8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-b6859e1a-1e60-434c-9ec7-6445ab6c4a00 req-59c67e83-b9a6-4055-96f2-62d5ee487661 service nova] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] No waiting events found dispatching network-vif-plugged-09b0593b-ed06-4e2b-b80e-cf70bad2366c {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:32:09 user nova-compute[74776]: WARNING nova.compute.manager [req-b6859e1a-1e60-434c-9ec7-6445ab6c4a00 req-59c67e83-b9a6-4055-96f2-62d5ee487661 service nova] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Received unexpected event network-vif-plugged-09b0593b-ed06-4e2b-b80e-cf70bad2366c for instance with vm_state building and task_state spawning.
Nov 22 14:32:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:11 user nova-compute[74776]: DEBUG nova.compute.manager [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:32:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:32:11 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Instance spawned successfully.
Nov 22 14:32:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:32:11 user nova-compute[74776]: DEBUG nova.compute.manager [req-26aa63b4-0afb-4fba-8381-011264f25b2f req-9acbe470-3544-4241-aceb-9e9477165bec service nova] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Received event network-vif-plugged-09b0593b-ed06-4e2b-b80e-cf70bad2366c {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:32:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-26aa63b4-0afb-4fba-8381-011264f25b2f req-9acbe470-3544-4241-aceb-9e9477165bec service nova] Acquiring lock "7819c3bf-bf3e-4012-8fcc-19226486de8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-26aa63b4-0afb-4fba-8381-011264f25b2f req-9acbe470-3544-4241-aceb-9e9477165bec service nova] Lock "7819c3bf-bf3e-4012-8fcc-19226486de8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-26aa63b4-0afb-4fba-8381-011264f25b2f req-9acbe470-3544-4241-aceb-9e9477165bec service nova] Lock "7819c3bf-bf3e-4012-8fcc-19226486de8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:11 user nova-compute[74776]: DEBUG nova.compute.manager [req-26aa63b4-0afb-4fba-8381-011264f25b2f req-9acbe470-3544-4241-aceb-9e9477165bec service nova] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] No waiting events found dispatching network-vif-plugged-09b0593b-ed06-4e2b-b80e-cf70bad2366c {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:32:11 user nova-compute[74776]: WARNING nova.compute.manager [req-26aa63b4-0afb-4fba-8381-011264f25b2f req-9acbe470-3544-4241-aceb-9e9477165bec service nova] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Received unexpected event network-vif-plugged-09b0593b-ed06-4e2b-b80e-cf70bad2366c for instance with vm_state building and task_state spawning.
Nov 22 14:32:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:32:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:32:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:32:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:32:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:32:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:32:11 user nova-compute[74776]: INFO nova.compute.manager [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 22 14:32:11 user nova-compute[74776]: DEBUG nova.compute.manager [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:32:12 user nova-compute[74776]: INFO nova.compute.manager [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Took 6.24 seconds to build instance.
Nov 22 14:32:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-dd5e7c00-fb84-4708-8297-243fbc82cb73 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "7819c3bf-bf3e-4012-8fcc-19226486de8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.404s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:15 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:32:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:15 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:32:16 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:32:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:17 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:32:17 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74776) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 14:32:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:19 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:32:20 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:32:20 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:32:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-bc98341b-ca28-4097-9887-16c8e8d7f9f7" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:32:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-bc98341b-ca28-4097-9887-16c8e8d7f9f7" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:32:20 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:32:21 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Updating instance_info_cache with network_info: [{"id": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "address": "fa:16:3e:5f:fc:12", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cec0cf0-89", "ovs_interfaceid": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:32:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-bc98341b-ca28-4097-9887-16c8e8d7f9f7" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:32:21 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:32:21 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:32:21 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:32:21 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:32:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:21 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:32:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:32:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:32:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:32:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:32:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "47d7c0f7-8496-4766-8717-5da631f7c94b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "47d7c0f7-8496-4766-8717-5da631f7c94b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:24 user nova-compute[74776]: INFO nova.compute.manager [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Detaching volume 2eb57bca-9d35-43ca-8e87-467ec5116c12
Nov 22 14:32:24 user nova-compute[74776]: INFO nova.virt.block_device [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Attempting to driver detach volume 2eb57bca-9d35-43ca-8e87-467ec5116c12 from mountpoint /dev/vdb
Nov 22 14:32:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Attempting to detach device vdb from instance 47d7c0f7-8496-4766-8717-5da631f7c94b from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:32:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:32:24 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:32:24 user nova-compute[74776]:   <source dev="/dev/sdd"/>
Nov 22 14:32:24 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:32:24 user nova-compute[74776]:   <serial>2eb57bca-9d35-43ca-8e87-467ec5116c12</serial>
Nov 22 14:32:24 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:32:24 user nova-compute[74776]: </disk>
Nov 22 14:32:24 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:32:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:24 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Successfully detached device vdb from instance 47d7c0f7-8496-4766-8717-5da631f7c94b from the persistent domain config.
Nov 22 14:32:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 47d7c0f7-8496-4766-8717-5da631f7c94b from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:32:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:32:24 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:32:24 user nova-compute[74776]:   <source dev="/dev/sdd"/>
Nov 22 14:32:24 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:32:24 user nova-compute[74776]:   <serial>2eb57bca-9d35-43ca-8e87-467ec5116c12</serial>
Nov 22 14:32:24 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:32:24 user nova-compute[74776]: </disk>
Nov 22 14:32:24 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:32:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "47d7c0f7-8496-4766-8717-5da631f7c94b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 47d7c0f7-8496-4766-8717-5da631f7c94b {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:32:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:32:26 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:32:26 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:32:26 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=7364MB free_disk=24.97616195678711GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:32:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:26 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4629d82d-fd02-4a58-a535-b362b493e7c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:32:26 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 525baf66-82cc-4e8d-a37a-c92c51d4673d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:32:26 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6f2ce4b2-660c-431f-b951-c6ec5090ef7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:32:26 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f4f30fe7-b234-4f81-b081-3214f5ebe789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:32:26 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance bc98341b-ca28-4097-9887-16c8e8d7f9f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:32:26 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 68b6744f-c29d-4ccd-83ab-fcc31666d69b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:32:26 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance d374cfe8-6d04-4c4e-9055-f46488a76ed8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:32:26 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 245ff2b1-5e87-4756-b4c1-86a2fea089a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:32:26 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 47d7c0f7-8496-4766-8717-5da631f7c94b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:32:26 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 34f85084-64b0-4bfa-b5b7-744e3f26cd91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:32:26 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance ac14ec9b-986a-4fe3-97e3-afbaaca431af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:32:26 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 7819c3bf-bf3e-4012-8fcc-19226486de8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:32:26 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:32:26 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:32:26 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing inventories for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 14:32:26 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating ProviderTree inventory for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 14:32:26 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating inventory in ProviderTree for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 14:32:26 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing aggregate associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, aggregates: None {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 14:32:26 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing trait associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 14:32:27 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:32:27 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:32:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:32:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.838s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:27 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:32:27 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:32:27 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:32:27 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:32:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 14:32:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] There are 0 instances to clean {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 14:32:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:29 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:32:30 user nova-compute[74776]: DEBUG nova.compute.manager [req-965337d9-5b75-4e24-ad42-131a93f07420 req-f8ef720f-3032-4a24-b771-32e70acf2883 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received event network-changed-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:32:30 user nova-compute[74776]: DEBUG nova.compute.manager [req-965337d9-5b75-4e24-ad42-131a93f07420 req-f8ef720f-3032-4a24-b771-32e70acf2883 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Refreshing instance network info cache due to event network-changed-3c7c3d69-1226-4906-b2cb-bedf570f40ee. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:32:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-965337d9-5b75-4e24-ad42-131a93f07420 req-f8ef720f-3032-4a24-b771-32e70acf2883 service nova] Acquiring lock "refresh_cache-68b6744f-c29d-4ccd-83ab-fcc31666d69b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:32:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-965337d9-5b75-4e24-ad42-131a93f07420 req-f8ef720f-3032-4a24-b771-32e70acf2883 service nova] Acquired lock "refresh_cache-68b6744f-c29d-4ccd-83ab-fcc31666d69b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:32:30 user nova-compute[74776]: DEBUG nova.network.neutron [req-965337d9-5b75-4e24-ad42-131a93f07420 req-f8ef720f-3032-4a24-b771-32e70acf2883 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Refreshing network info cache for port 3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:32:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:31 user nova-compute[74776]: DEBUG nova.network.neutron [req-965337d9-5b75-4e24-ad42-131a93f07420 req-f8ef720f-3032-4a24-b771-32e70acf2883 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Updated VIF entry in instance network info cache for port 3c7c3d69-1226-4906-b2cb-bedf570f40ee. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:32:31 user nova-compute[74776]: DEBUG nova.network.neutron [req-965337d9-5b75-4e24-ad42-131a93f07420 req-f8ef720f-3032-4a24-b771-32e70acf2883 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Updating instance_info_cache with network_info: [{"id": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "address": "fa:16:3e:e9:fc:41", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7c3d69-12", "ovs_interfaceid": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:32:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-965337d9-5b75-4e24-ad42-131a93f07420 req-f8ef720f-3032-4a24-b771-32e70acf2883 service nova] Releasing lock "refresh_cache-68b6744f-c29d-4ccd-83ab-fcc31666d69b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:32:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:31 user nova-compute[74776]: INFO nova.compute.manager [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Detaching volume d96ea52c-e306-43bc-b529-8a1b47ebfecb
Nov 22 14:32:31 user nova-compute[74776]: INFO nova.virt.block_device [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Attempting to driver detach volume d96ea52c-e306-43bc-b529-8a1b47ebfecb from mountpoint /dev/vdb
Nov 22 14:32:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Attempting to detach device vdb from instance 68b6744f-c29d-4ccd-83ab-fcc31666d69b from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:32:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:32:31 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:32:31 user nova-compute[74776]:   <source dev="/dev/sde"/>
Nov 22 14:32:31 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:32:31 user nova-compute[74776]:   <serial>d96ea52c-e306-43bc-b529-8a1b47ebfecb</serial>
Nov 22 14:32:31 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 14:32:31 user nova-compute[74776]: </disk>
Nov 22 14:32:31 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:32:31 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Successfully detached device vdb from instance 68b6744f-c29d-4ccd-83ab-fcc31666d69b from the persistent domain config.
Nov 22 14:32:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 68b6744f-c29d-4ccd-83ab-fcc31666d69b from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:32:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:32:31 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:32:31 user nova-compute[74776]:   <source dev="/dev/sde"/>
Nov 22 14:32:31 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:32:31 user nova-compute[74776]:   <serial>d96ea52c-e306-43bc-b529-8a1b47ebfecb</serial>
Nov 22 14:32:31 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 14:32:31 user nova-compute[74776]: </disk>
Nov 22 14:32:31 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:32:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 68b6744f-c29d-4ccd-83ab-fcc31666d69b {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:32:32 user nova-compute[74776]: DEBUG nova.compute.manager [req-2c722293-b229-464d-98bd-793d18091af3 req-838c122c-c8fb-4f08-a190-e5cee4d2fe21 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received event network-changed-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:32:32 user nova-compute[74776]: DEBUG nova.compute.manager [req-2c722293-b229-464d-98bd-793d18091af3 req-838c122c-c8fb-4f08-a190-e5cee4d2fe21 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Refreshing instance network info cache due to event network-changed-3c7c3d69-1226-4906-b2cb-bedf570f40ee. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:32:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2c722293-b229-464d-98bd-793d18091af3 req-838c122c-c8fb-4f08-a190-e5cee4d2fe21 service nova] Acquiring lock "refresh_cache-68b6744f-c29d-4ccd-83ab-fcc31666d69b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:32:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2c722293-b229-464d-98bd-793d18091af3 req-838c122c-c8fb-4f08-a190-e5cee4d2fe21 service nova] Acquired lock "refresh_cache-68b6744f-c29d-4ccd-83ab-fcc31666d69b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:32:32 user nova-compute[74776]: DEBUG nova.network.neutron [req-2c722293-b229-464d-98bd-793d18091af3 req-838c122c-c8fb-4f08-a190-e5cee4d2fe21 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Refreshing network info cache for port 3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:32:33 user nova-compute[74776]: DEBUG nova.network.neutron [req-2c722293-b229-464d-98bd-793d18091af3 req-838c122c-c8fb-4f08-a190-e5cee4d2fe21 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Updated VIF entry in instance network info cache for port 3c7c3d69-1226-4906-b2cb-bedf570f40ee. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:32:33 user nova-compute[74776]: DEBUG nova.network.neutron [req-2c722293-b229-464d-98bd-793d18091af3 req-838c122c-c8fb-4f08-a190-e5cee4d2fe21 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Updating instance_info_cache with network_info: [{"id": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "address": "fa:16:3e:e9:fc:41", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7c3d69-12", "ovs_interfaceid": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:32:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2c722293-b229-464d-98bd-793d18091af3 req-838c122c-c8fb-4f08-a190-e5cee4d2fe21 service nova] Releasing lock "refresh_cache-68b6744f-c29d-4ccd-83ab-fcc31666d69b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:32:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:45 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 47d7c0f7-8496-4766-8717-5da631f7c94b is timed out.
Nov 22 14:32:45 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Successfully detached device vdb from instance 47d7c0f7-8496-4766-8717-5da631f7c94b from the live domain config.
Nov 22 14:32:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AeronJDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:32:45 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:32:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb449f2-f6e9-4047-8e62-fcb2f5629d56]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:32:45 user nova-compute[74776]: No targets found.
Nov 22 14:32:45 user nova-compute[74776]: iSNS:
Nov 22 14:32:45 user nova-compute[74776]: No targets found.
Nov 22 14:32:45 user nova-compute[74776]: STATIC:
Nov 22 14:32:45 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09
Nov 22 14:32:45 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:32:45 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:32:45 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3
Nov 22 14:32:45 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:32:45 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:32:45 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a
Nov 22 14:32:45 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:32:45 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:32:45 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb
Nov 22 14:32:45 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:32:45 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:32:45 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12
Nov 22 14:32:45 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:32:45 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:32:45 user nova-compute[74776]: FIRMWARE:
Nov 22 14:32:45 user nova-compute[74776]: No targets found.
Nov 22 14:32:45 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:32:45 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:32:45 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fe6420-c6b5-41e1-90ec-9a235777bddd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c045d78-2050-4d2b-bfed-64cbf7b5f5af]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:32:45 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:32:45 user nova-compute[74776]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:32:45 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:32:45 user nova-compute[74776]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 (non-flash)
Nov 22 14:32:45 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:32:45 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:32:45 user nova-compute[74776]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:32:45 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:32:45 user nova-compute[74776]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 (non-flash)
Nov 22 14:32:45 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c781b1a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12'): ({'sdd'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Removing single pathed devices sdd {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2403d8f-c2d7-4c13-8a55-cab0dcbbbb4d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea1d31c-dd70-4ed8-bd60-d3bf8abf2c7c]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Flushing IO for device /dev/sdd {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef7f97e-97c1-41c3-a99e-3fffbfc0fca5]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d57cdb5-dceb-44ff-8444-191f6531518c]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] SCSI volumes sdd have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[225c28c5-022d-436e-b0f9-5973332be440]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[93977672-5fd0-4326-af83-0154690ec78e]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12, portal: 172.16.0.220,3260]
Nov 22 14:32:45 user nova-compute[74776]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12, portal: 172.16.0.220,3260] successful.
Nov 22 14:32:45 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b190561a-ff88-414d-8f4e-1e485769371e]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] <== disconnect_volume: return (294ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:32:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:46 user nova-compute[74776]: DEBUG nova.objects.instance [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lazy-loading 'flavor' on Instance uuid 47d7c0f7-8496-4766-8717-5da631f7c94b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:32:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3db27ff4-4ec6-4f4c-ba55-d35a435ced20 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "47d7c0f7-8496-4766-8717-5da631f7c94b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.712s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "47d7c0f7-8496-4766-8717-5da631f7c94b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.553s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "47d7c0f7-8496-4766-8717-5da631f7c94b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "47d7c0f7-8496-4766-8717-5da631f7c94b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "47d7c0f7-8496-4766-8717-5da631f7c94b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:46 user nova-compute[74776]: INFO nova.compute.manager [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Terminating instance
Nov 22 14:32:46 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:32:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:46 user nova-compute[74776]: DEBUG nova.compute.manager [req-8fc5f5c4-1e37-403a-b017-f881cadcb3ad req-ac9c606e-b33b-4bba-95d8-40d6d6efe99c service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Received event network-vif-unplugged-cfc90514-d813-4c8e-8f0a-2f538ea95e23 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:32:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8fc5f5c4-1e37-403a-b017-f881cadcb3ad req-ac9c606e-b33b-4bba-95d8-40d6d6efe99c service nova] Acquiring lock "47d7c0f7-8496-4766-8717-5da631f7c94b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8fc5f5c4-1e37-403a-b017-f881cadcb3ad req-ac9c606e-b33b-4bba-95d8-40d6d6efe99c service nova] Lock "47d7c0f7-8496-4766-8717-5da631f7c94b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8fc5f5c4-1e37-403a-b017-f881cadcb3ad req-ac9c606e-b33b-4bba-95d8-40d6d6efe99c service nova] Lock "47d7c0f7-8496-4766-8717-5da631f7c94b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:46 user nova-compute[74776]: DEBUG nova.compute.manager [req-8fc5f5c4-1e37-403a-b017-f881cadcb3ad req-ac9c606e-b33b-4bba-95d8-40d6d6efe99c service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] No waiting events found dispatching network-vif-unplugged-cfc90514-d813-4c8e-8f0a-2f538ea95e23 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:32:46 user nova-compute[74776]: DEBUG nova.compute.manager [req-8fc5f5c4-1e37-403a-b017-f881cadcb3ad req-ac9c606e-b33b-4bba-95d8-40d6d6efe99c service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Received event network-vif-unplugged-cfc90514-d813-4c8e-8f0a-2f538ea95e23 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:32:47 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Instance destroyed successfully.
Nov 22 14:32:47 user nova-compute[74776]: DEBUG nova.objects.instance [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lazy-loading 'resources' on Instance uuid 47d7c0f7-8496-4766-8717-5da631f7c94b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-598607464',display_name='tempest-VolumesSnapshotTestJSON-instance-598607464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-598607464',id=31,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDljD+FSmdMWcx1E6rLDkjQR+9RokL1HmEtebKXkYwxnY89g6UJHOC+gycAJB4jMzVrFb6ZPCtAqKj4Q/G9X3o/T3iQoUdghdtexny+PwvEN7ucEyG3fxmvbnzjcBCPMaQ==',key_name='tempest-keypair-1324158616',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:30:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ae8f6ccdd1d4762945614272ca75a1c',ramdisk_id='',reservation_id='r-ypo4oxmw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1416311759',owner_user_name='tempest-VolumesSnapshotTestJSON-1416311759-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:30:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd5bd7dac415438898e5773c1722f633',uuid=47d7c0f7-8496-4766-8717-5da631f7c94b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "address": "fa:16:3e:8c:2c:13", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc90514-d8", "ovs_interfaceid": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Converting VIF {"id": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "address": "fa:16:3e:8c:2c:13", "network": {"id": "e38b6baa-4dea-488c-ad93-634cb26fdb5f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1530935473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae8f6ccdd1d4762945614272ca75a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfc90514-d8", "ovs_interfaceid": "cfc90514-d813-4c8e-8f0a-2f538ea95e23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:2c:13,bridge_name='br-int',has_traffic_filtering=True,id=cfc90514-d813-4c8e-8f0a-2f538ea95e23,network=Network(e38b6baa-4dea-488c-ad93-634cb26fdb5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfc90514-d8') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG os_vif [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:2c:13,bridge_name='br-int',has_traffic_filtering=True,id=cfc90514-d813-4c8e-8f0a-2f538ea95e23,network=Network(e38b6baa-4dea-488c-ad93-634cb26fdb5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfc90514-d8') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfc90514-d8, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4813da50-d104-4d68-b571-2f2904bb16f6) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:47 user nova-compute[74776]: INFO os_vif [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:2c:13,bridge_name='br-int',has_traffic_filtering=True,id=cfc90514-d813-4c8e-8f0a-2f538ea95e23,network=Network(e38b6baa-4dea-488c-ad93-634cb26fdb5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfc90514-d8')
Nov 22 14:32:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AeronJDu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:32:47 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:32:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f1347d-1101-4389-ae25-7dc648ba6946]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:32:47 user nova-compute[74776]: No targets found.
Nov 22 14:32:47 user nova-compute[74776]: iSNS:
Nov 22 14:32:47 user nova-compute[74776]: No targets found.
Nov 22 14:32:47 user nova-compute[74776]: STATIC:
Nov 22 14:32:47 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09
Nov 22 14:32:47 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:32:47 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:32:47 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3
Nov 22 14:32:47 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:32:47 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:32:47 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a
Nov 22 14:32:47 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:32:47 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:32:47 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb
Nov 22 14:32:47 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:32:47 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:32:47 user nova-compute[74776]: FIRMWARE:
Nov 22 14:32:47 user nova-compute[74776]: No targets found.
Nov 22 14:32:47 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:32:47 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:32:47 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eb57bca-9d35-43ca-8e87-467ec5116c12', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f37e175-69df-423e-9adb-b40b1c2ee225]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d884ccc7-3231-4a71-86f6-481b17e30615]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:32:47 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:32:47 user nova-compute[74776]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:32:47 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:32:47 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:32:47 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:32:47 user nova-compute[74776]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:32:47 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:32:47 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c387b88b0>, {}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Disconnecting from: [] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] <== disconnect_volume: return (74ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:32:47 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Deleting instance files /opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b_del
Nov 22 14:32:47 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Deletion of /opt/stack/data/nova/instances/47d7c0f7-8496-4766-8717-5da631f7c94b_del complete
Nov 22 14:32:47 user nova-compute[74776]: INFO nova.compute.manager [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 22 14:32:47 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:32:47 user nova-compute[74776]: INFO nova.compute.manager [None req-4575c2ce-64da-468d-b617-f77291ec7a25 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Unrescuing
Nov 22 14:32:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4575c2ce-64da-468d-b617-f77291ec7a25 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "refresh_cache-d374cfe8-6d04-4c4e-9055-f46488a76ed8" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4575c2ce-64da-468d-b617-f77291ec7a25 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquired lock "refresh_cache-d374cfe8-6d04-4c4e-9055-f46488a76ed8" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4575c2ce-64da-468d-b617-f77291ec7a25 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4575c2ce-64da-468d-b617-f77291ec7a25 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Updating instance_info_cache with network_info: [{"id": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "address": "fa:16:3e:1b:64:9b", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8edc986-df", "ovs_interfaceid": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4575c2ce-64da-468d-b617-f77291ec7a25 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Releasing lock "refresh_cache-d374cfe8-6d04-4c4e-9055-f46488a76ed8" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG nova.objects.instance [None req-4575c2ce-64da-468d-b617-f77291ec7a25 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'flavor' on Instance uuid d374cfe8-6d04-4c4e-9055-f46488a76ed8 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:48 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Instance destroyed successfully.
Nov 22 14:32:48 user nova-compute[74776]: DEBUG nova.compute.manager [req-3c060209-1866-4919-9890-08188aef5ba8 req-b64e28f1-4c76-4dbc-826c-070d061bdfdc service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Received event network-vif-plugged-cfc90514-d813-4c8e-8f0a-2f538ea95e23 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:32:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3c060209-1866-4919-9890-08188aef5ba8 req-b64e28f1-4c76-4dbc-826c-070d061bdfdc service nova] Acquiring lock "47d7c0f7-8496-4766-8717-5da631f7c94b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3c060209-1866-4919-9890-08188aef5ba8 req-b64e28f1-4c76-4dbc-826c-070d061bdfdc service nova] Lock "47d7c0f7-8496-4766-8717-5da631f7c94b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3c060209-1866-4919-9890-08188aef5ba8 req-b64e28f1-4c76-4dbc-826c-070d061bdfdc service nova] Lock "47d7c0f7-8496-4766-8717-5da631f7c94b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:48 user nova-compute[74776]: DEBUG nova.compute.manager [req-3c060209-1866-4919-9890-08188aef5ba8 req-b64e28f1-4c76-4dbc-826c-070d061bdfdc service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] No waiting events found dispatching network-vif-plugged-cfc90514-d813-4c8e-8f0a-2f538ea95e23 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:32:48 user nova-compute[74776]: WARNING nova.compute.manager [req-3c060209-1866-4919-9890-08188aef5ba8 req-b64e28f1-4c76-4dbc-826c-070d061bdfdc service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Received unexpected event network-vif-plugged-cfc90514-d813-4c8e-8f0a-2f538ea95e23 for instance with vm_state active and task_state deleting.
Nov 22 14:32:48 user nova-compute[74776]: DEBUG nova.compute.manager [req-3c060209-1866-4919-9890-08188aef5ba8 req-b64e28f1-4c76-4dbc-826c-070d061bdfdc service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received event network-vif-unplugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:32:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3c060209-1866-4919-9890-08188aef5ba8 req-b64e28f1-4c76-4dbc-826c-070d061bdfdc service nova] Acquiring lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3c060209-1866-4919-9890-08188aef5ba8 req-b64e28f1-4c76-4dbc-826c-070d061bdfdc service nova] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3c060209-1866-4919-9890-08188aef5ba8 req-b64e28f1-4c76-4dbc-826c-070d061bdfdc service nova] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:48 user nova-compute[74776]: DEBUG nova.compute.manager [req-3c060209-1866-4919-9890-08188aef5ba8 req-b64e28f1-4c76-4dbc-826c-070d061bdfdc service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] No waiting events found dispatching network-vif-unplugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:32:48 user nova-compute[74776]: WARNING nova.compute.manager [req-3c060209-1866-4919-9890-08188aef5ba8 req-b64e28f1-4c76-4dbc-826c-070d061bdfdc service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received unexpected event network-vif-unplugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 for instance with vm_state rescued and task_state unrescuing.
Nov 22 14:32:48 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:32:48 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Took 1.52 seconds to deallocate network for instance.
Nov 22 14:32:48 user nova-compute[74776]: WARNING nova.volume.cinder [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Attachment e7568bc8-227f-4382-8047-842c3c9279d0 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e7568bc8-227f-4382-8047-842c3c9279d0. (HTTP 404) (Request-ID: req-d530ef62-a238-4e38-890a-b5c3cf6e7c21)
Nov 22 14:32:48 user nova-compute[74776]: INFO nova.compute.manager [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Took 0.02 seconds to detach 1 volumes for instance.
Nov 22 14:32:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:49 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:32:49 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:32:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:49 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Deleted allocations for instance 47d7c0f7-8496-4766-8717-5da631f7c94b
Nov 22 14:32:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1cd5461b-f4bf-4d17-aee8-af8c5094e442 tempest-VolumesSnapshotTestJSON-1416311759 tempest-VolumesSnapshotTestJSON-1416311759-project-member] Lock "47d7c0f7-8496-4766-8717-5da631f7c94b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.040s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-0fd7802c-07d7-4275-9d2c-8200dec9766b req-ff14b21b-c031-4443-91c4-210c399e5180 service nova] [instance: 47d7c0f7-8496-4766-8717-5da631f7c94b] Received event network-vif-deleted-cfc90514-d813-4c8e-8f0a-2f538ea95e23 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:32:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-0fd7802c-07d7-4275-9d2c-8200dec9766b req-ff14b21b-c031-4443-91c4-210c399e5180 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received event network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:32:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0fd7802c-07d7-4275-9d2c-8200dec9766b req-ff14b21b-c031-4443-91c4-210c399e5180 service nova] Acquiring lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0fd7802c-07d7-4275-9d2c-8200dec9766b req-ff14b21b-c031-4443-91c4-210c399e5180 service nova] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0fd7802c-07d7-4275-9d2c-8200dec9766b req-ff14b21b-c031-4443-91c4-210c399e5180 service nova] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-0fd7802c-07d7-4275-9d2c-8200dec9766b req-ff14b21b-c031-4443-91c4-210c399e5180 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] No waiting events found dispatching network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:32:50 user nova-compute[74776]: WARNING nova.compute.manager [req-0fd7802c-07d7-4275-9d2c-8200dec9766b req-ff14b21b-c031-4443-91c4-210c399e5180 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received unexpected event network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 for instance with vm_state rescued and task_state unrescuing.
Nov 22 14:32:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-0fd7802c-07d7-4275-9d2c-8200dec9766b req-ff14b21b-c031-4443-91c4-210c399e5180 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received event network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:32:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0fd7802c-07d7-4275-9d2c-8200dec9766b req-ff14b21b-c031-4443-91c4-210c399e5180 service nova] Acquiring lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0fd7802c-07d7-4275-9d2c-8200dec9766b req-ff14b21b-c031-4443-91c4-210c399e5180 service nova] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0fd7802c-07d7-4275-9d2c-8200dec9766b req-ff14b21b-c031-4443-91c4-210c399e5180 service nova] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-0fd7802c-07d7-4275-9d2c-8200dec9766b req-ff14b21b-c031-4443-91c4-210c399e5180 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] No waiting events found dispatching network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:32:50 user nova-compute[74776]: WARNING nova.compute.manager [req-0fd7802c-07d7-4275-9d2c-8200dec9766b req-ff14b21b-c031-4443-91c4-210c399e5180 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received unexpected event network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 for instance with vm_state rescued and task_state unrescuing.
Nov 22 14:32:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-0fd7802c-07d7-4275-9d2c-8200dec9766b req-ff14b21b-c031-4443-91c4-210c399e5180 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received event network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:32:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0fd7802c-07d7-4275-9d2c-8200dec9766b req-ff14b21b-c031-4443-91c4-210c399e5180 service nova] Acquiring lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:32:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0fd7802c-07d7-4275-9d2c-8200dec9766b req-ff14b21b-c031-4443-91c4-210c399e5180 service nova] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:32:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0fd7802c-07d7-4275-9d2c-8200dec9766b req-ff14b21b-c031-4443-91c4-210c399e5180 service nova] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-0fd7802c-07d7-4275-9d2c-8200dec9766b req-ff14b21b-c031-4443-91c4-210c399e5180 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] No waiting events found dispatching network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:32:50 user nova-compute[74776]: WARNING nova.compute.manager [req-0fd7802c-07d7-4275-9d2c-8200dec9766b req-ff14b21b-c031-4443-91c4-210c399e5180 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received unexpected event network-vif-plugged-d8edc986-df1e-4de5-9926-4cbb5b4ec280 for instance with vm_state rescued and task_state unrescuing.
Nov 22 14:32:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:51 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 68b6744f-c29d-4ccd-83ab-fcc31666d69b is timed out.
Nov 22 14:32:51 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Successfully detached device vdb from instance 68b6744f-c29d-4ccd-83ab-fcc31666d69b from the live domain config.
Nov 22 14:32:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDefcdCE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:32:51 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:32:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a199a8b9-d504-475b-a560-ec79e8ca0005]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:32:51 user nova-compute[74776]: No targets found.
Nov 22 14:32:51 user nova-compute[74776]: iSNS:
Nov 22 14:32:51 user nova-compute[74776]: No targets found.
Nov 22 14:32:51 user nova-compute[74776]: STATIC:
Nov 22 14:32:51 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09
Nov 22 14:32:51 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:32:51 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:32:51 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3
Nov 22 14:32:51 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:32:51 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:32:51 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a
Nov 22 14:32:51 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:32:51 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:32:51 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb
Nov 22 14:32:51 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:32:51 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:32:51 user nova-compute[74776]: FIRMWARE:
Nov 22 14:32:51 user nova-compute[74776]: No targets found.
Nov 22 14:32:51 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:32:51 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:32:51 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7aab9da-bedc-489e-b9f1-7341992fc7db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5071194c-a015-4426-9880-1459458d8de9]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:32:51 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:32:51 user nova-compute[74776]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:32:51 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:32:51 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:32:51 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:32:51 user nova-compute[74776]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb (non-flash)
Nov 22 14:32:51 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:32:51 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c387b8940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb'): ({'sde'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Removing single pathed devices sde {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd38551-b841-41e2-aa74-14c4a63fbf5f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ff63d9-db93-433f-a536-781aa2aad16a]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Flushing IO for device /dev/sde {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f04e0ec-4e2d-42d5-9c29-2951e3f2cc6b]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:51 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0cf85b-1f70-45e5-b5b9-c64e5afa9a68]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] SCSI volumes sde have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4575c2ce-64da-468d-b617-f77291ec7a25 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f205c3-9567-4cc4-ac2c-d910ca07ec5d]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93a9e3e-a59e-49ea-b942-ba0bc534c8e8]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb, portal: 172.16.0.220,3260]
Nov 22 14:32:52 user nova-compute[74776]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb, portal: 172.16.0.220,3260] successful.
Nov 22 14:32:52 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96ea52c-e306-43bc-b529-8a1b47ebfecb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9a6cdf-7e9e-4e03-993d-0a6fc39f9766]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] <== disconnect_volume: return (309ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG nova.objects.instance [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lazy-loading 'flavor' on Instance uuid 68b6744f-c29d-4ccd-83ab-fcc31666d69b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:32:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-37eefa1c-8c44-4a12-b5ea-1554eb0c40f1 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.678s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:32:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:32:57 user nova-compute[74776]: DEBUG nova.compute.manager [req-bf234086-f02e-413f-8d14-1208ccc5cbbd req-f12a9338-82ef-4f0e-ad2c-38ae1e7fdef3 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Received event network-changed-ee7ecf07-d931-49bf-a7a3-289e575911a4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:32:57 user nova-compute[74776]: DEBUG nova.compute.manager [req-bf234086-f02e-413f-8d14-1208ccc5cbbd req-f12a9338-82ef-4f0e-ad2c-38ae1e7fdef3 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Refreshing instance network info cache due to event network-changed-ee7ecf07-d931-49bf-a7a3-289e575911a4. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:32:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-bf234086-f02e-413f-8d14-1208ccc5cbbd req-f12a9338-82ef-4f0e-ad2c-38ae1e7fdef3 service nova] Acquiring lock "refresh_cache-34f85084-64b0-4bfa-b5b7-744e3f26cd91" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:32:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-bf234086-f02e-413f-8d14-1208ccc5cbbd req-f12a9338-82ef-4f0e-ad2c-38ae1e7fdef3 service nova] Acquired lock "refresh_cache-34f85084-64b0-4bfa-b5b7-744e3f26cd91" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:32:57 user nova-compute[74776]: DEBUG nova.network.neutron [req-bf234086-f02e-413f-8d14-1208ccc5cbbd req-f12a9338-82ef-4f0e-ad2c-38ae1e7fdef3 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Refreshing network info cache for port ee7ecf07-d931-49bf-a7a3-289e575911a4 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:32:57 user nova-compute[74776]: DEBUG nova.network.neutron [req-bf234086-f02e-413f-8d14-1208ccc5cbbd req-f12a9338-82ef-4f0e-ad2c-38ae1e7fdef3 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Updated VIF entry in instance network info cache for port ee7ecf07-d931-49bf-a7a3-289e575911a4. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:32:57 user nova-compute[74776]: DEBUG nova.network.neutron [req-bf234086-f02e-413f-8d14-1208ccc5cbbd req-f12a9338-82ef-4f0e-ad2c-38ae1e7fdef3 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Updating instance_info_cache with network_info: [{"id": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "address": "fa:16:3e:b0:46:dd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7ecf07-d9", "ovs_interfaceid": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:32:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-bf234086-f02e-413f-8d14-1208ccc5cbbd req-f12a9338-82ef-4f0e-ad2c-38ae1e7fdef3 service nova] Releasing lock "refresh_cache-34f85084-64b0-4bfa-b5b7-744e3f26cd91" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG nova.objects.instance [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lazy-loading 'flavor' on Instance uuid 34f85084-64b0-4bfa-b5b7-744e3f26cd91 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:00 user nova-compute[74776]: INFO nova.compute.manager [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Attaching volume 16dcf80f-a2b8-4c35-970b-65f08a677523 to /dev/vdb
Nov 22 14:33:00 user nova-compute[74776]: DEBUG os_brick.utils [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b5c42d-1e28-4d93-a9f3-3c5fc8e35839]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[717443c7-89d5-4df1-b6e0-ded10cfc7534]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[701b49e2-5626-4beb-8276-1c67ad63073c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0468a3-bdfd-42fa-995c-e7d43349bfc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:33:00 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:33:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[445816aa-11a9-43b2-b01c-bcb4a2e7460b]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG os_brick.utils [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Updating existing volume attachment record: ef5c516f-3e2b-4564-8569-32e78f1ae252 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:33:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRYluWxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:33:06 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:33:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:33:06 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:33:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:33:06 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ce25fb-d730-4831-a9aa-25adaa0a0877]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:33:06 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d2c793-6d35-49be-b3c0-c9819a86756d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523] added
Nov 22 14:33:06 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1175aa-1123-4210-b6cd-7663bdc56e38]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c5be04-f3fe-429c-9514-77b65442c919]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GRYluWxZ {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GRYluWxZ" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f7c3c1-4101-4ed4-b26c-14828d29117f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GRYluWxZ'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b621efd2-792c-4ec6-aaaa-1d9877e57ae4]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73e8244-5e4c-4fd4-858e-58df1f9ea952]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:33:06 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:33:06 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:33:06 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:33:06 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:33:06 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:33:06 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:33:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b7a5ae-9549-4b3e-959c-6d0d4a8db2ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523, portal: 172.16.0.220,3260]
Nov 22 14:33:07 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523, portal: 172.16.0.220,3260] successful.
Nov 22 14:33:07 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:33:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5295e0a2-9d0f-48a6-8819-9dfbc50f61f7]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:33:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[627024a7-7b00-4d2d-9ed9-24b94feaaffb]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:33:07 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:33:07 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:33:07 user nova-compute[74776]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 (non-flash)
Nov 22 14:33:07 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:33:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:33:07 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:33:07 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:33:07 user nova-compute[74776]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 (non-flash)
Nov 22 14:33:07 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:33:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:33:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:33:07 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:33:07 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:33:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6910a25d-4ce0-4a52-b04d-fbd74cdfec07]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:07 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: None {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:33:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:08 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:33:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRYluWxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:33:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:33:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26539356131643666', 'path': '/dev/sdd'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:33:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539356131643666', 'path': '/dev/sdd'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:33:08 user nova-compute[74776]: DEBUG nova.objects.instance [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lazy-loading 'flavor' on Instance uuid 34f85084-64b0-4bfa-b5b7-744e3f26cd91 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:33:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:33:08 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:33:08 user nova-compute[74776]:   <source dev="/dev/sdd"/>
Nov 22 14:33:08 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:33:08 user nova-compute[74776]:   <serial>16dcf80f-a2b8-4c35-970b-65f08a677523</serial>
Nov 22 14:33:08 user nova-compute[74776]: </disk>
Nov 22 14:33:08 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:33:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:33:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:33:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] No VIF found with MAC fa:16:3e:b0:46:dd, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:33:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-84fd20aa-f861-4420-945b-983ff90feb45 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.387s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:09 user nova-compute[74776]: INFO nova.compute.manager [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Detaching volume 16dcf80f-a2b8-4c35-970b-65f08a677523
Nov 22 14:33:09 user nova-compute[74776]: INFO nova.virt.block_device [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Attempting to driver detach volume 16dcf80f-a2b8-4c35-970b-65f08a677523 from mountpoint /dev/vdb
Nov 22 14:33:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Attempting to detach device vdb from instance 34f85084-64b0-4bfa-b5b7-744e3f26cd91 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:33:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:33:09 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:33:09 user nova-compute[74776]:   <source dev="/dev/sdd"/>
Nov 22 14:33:09 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:33:09 user nova-compute[74776]:   <serial>16dcf80f-a2b8-4c35-970b-65f08a677523</serial>
Nov 22 14:33:09 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:33:09 user nova-compute[74776]: </disk>
Nov 22 14:33:09 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:33:09 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Successfully detached device vdb from instance 34f85084-64b0-4bfa-b5b7-744e3f26cd91 from the persistent domain config.
Nov 22 14:33:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 34f85084-64b0-4bfa-b5b7-744e3f26cd91 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:33:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:33:09 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:33:09 user nova-compute[74776]:   <source dev="/dev/sdd"/>
Nov 22 14:33:09 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:33:09 user nova-compute[74776]:   <serial>16dcf80f-a2b8-4c35-970b-65f08a677523</serial>
Nov 22 14:33:09 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:33:09 user nova-compute[74776]: </disk>
Nov 22 14:33:09 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:33:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 34f85084-64b0-4bfa-b5b7-744e3f26cd91 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:33:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:16 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:33:16 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:33:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:17 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:33:17 user nova-compute[74776]: INFO nova.compute.manager [None req-9dac8f91-2c6f-4b1e-ace0-af4bdfebd783 tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Get console output
Nov 22 14:33:17 user nova-compute[74776]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 22 14:33:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:21 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:33:21 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:33:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-245ff2b1-5e87-4756-b4c1-86a2fea089a5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:33:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-245ff2b1-5e87-4756-b4c1-86a2fea089a5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:33:21 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:33:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:22 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Updating instance_info_cache with network_info: [{"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:33:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-245ff2b1-5e87-4756-b4c1-86a2fea089a5" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:33:22 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:33:22 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:33:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:22 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:33:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:33:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:33:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:25 user nova-compute[74776]: INFO nova.compute.manager [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Terminating instance
Nov 22 14:33:25 user nova-compute[74776]: DEBUG nova.compute.manager [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-57ae1849-d3ff-4176-a4a5-0f845278e3f3 req-2c8e1e4c-9c7b-4ca5-9c8c-728672c70e70 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received event network-vif-unplugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-57ae1849-d3ff-4176-a4a5-0f845278e3f3 req-2c8e1e4c-9c7b-4ca5-9c8c-728672c70e70 service nova] Acquiring lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-57ae1849-d3ff-4176-a4a5-0f845278e3f3 req-2c8e1e4c-9c7b-4ca5-9c8c-728672c70e70 service nova] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-57ae1849-d3ff-4176-a4a5-0f845278e3f3 req-2c8e1e4c-9c7b-4ca5-9c8c-728672c70e70 service nova] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-57ae1849-d3ff-4176-a4a5-0f845278e3f3 req-2c8e1e4c-9c7b-4ca5-9c8c-728672c70e70 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] No waiting events found dispatching network-vif-unplugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-57ae1849-d3ff-4176-a4a5-0f845278e3f3 req-2c8e1e4c-9c7b-4ca5-9c8c-728672c70e70 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received event network-vif-unplugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:25 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Instance destroyed successfully.
Nov 22 14:33:25 user nova-compute[74776]: DEBUG nova.objects.instance [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lazy-loading 'resources' on Instance uuid 68b6744f-c29d-4ccd-83ab-fcc31666d69b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:28:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-567453205',display_name='tempest-TestMinimumBasicScenario-server-567453205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-567453205',id=29,image_ref='410e18af-5ee2-4e1a-b884-991a4118fa51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeQ5l9gobrcB3GfFb8hElj7leJSJuwdi8KEucPTmUQGpAyFzhk+F3QsYUbzmVfcbUg0T9z6vSzM3sLT40eKIk3iKPtU/szyGW0f6KEHPn7TV4/Y4vJcTWqN8K0b2V6kYA==',key_name='tempest-TestMinimumBasicScenario-536055884',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:28:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2602b8e7e2414a3d88d18f9f0c973ab5',ramdisk_id='',reservation_id='r-lecfrx5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='410e18af-5ee2-4e1a-b884-991a4118fa51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1122910147',owner_user_name='tempest-TestMinimumBasicScenario-1122910147-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:30:46Z,user_data=None,user_id='aac47c7fc2fc4380a5673117151dbdb0',uuid=68b6744f-c29d-4ccd-83ab-fcc31666d69b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "address": "fa:16:3e:e9:fc:41", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7c3d69-12", "ovs_interfaceid": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Converting VIF {"id": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "address": "fa:16:3e:e9:fc:41", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c7c3d69-12", "ovs_interfaceid": "3c7c3d69-1226-4906-b2cb-bedf570f40ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:fc:41,bridge_name='br-int',has_traffic_filtering=True,id=3c7c3d69-1226-4906-b2cb-bedf570f40ee,network=Network(9ede03a9-ae5e-43f2-9865-595667d6d899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7c3d69-12') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG os_vif [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:fc:41,bridge_name='br-int',has_traffic_filtering=True,id=3c7c3d69-1226-4906-b2cb-bedf570f40ee,network=Network(9ede03a9-ae5e-43f2-9865-595667d6d899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7c3d69-12') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c7c3d69-12, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=146f5e7c-178c-4114-88f6-fc9beb4c3fb1) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:25 user nova-compute[74776]: INFO os_vif [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:fc:41,bridge_name='br-int',has_traffic_filtering=True,id=3c7c3d69-1226-4906-b2cb-bedf570f40ee,network=Network(9ede03a9-ae5e-43f2-9865-595667d6d899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c7c3d69-12')
Nov 22 14:33:25 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Deleting instance files /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b_del
Nov 22 14:33:25 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Deletion of /opt/stack/data/nova/instances/68b6744f-c29d-4ccd-83ab-fcc31666d69b_del complete
Nov 22 14:33:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:26 user nova-compute[74776]: INFO nova.compute.manager [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 22 14:33:26 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:33:26 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:33:26 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:33:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:26 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:33:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-e7982f6c-ceb5-4280-98ff-c66b29dce187 req-1b6af886-140e-480f-8721-3b954f7babb5 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received event network-vif-deleted-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:33:26 user nova-compute[74776]: INFO nova.compute.manager [req-e7982f6c-ceb5-4280-98ff-c66b29dce187 req-1b6af886-140e-480f-8721-3b954f7babb5 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Neutron deleted interface 3c7c3d69-1226-4906-b2cb-bedf570f40ee; detaching it from the instance and deleting it from the info cache
Nov 22 14:33:26 user nova-compute[74776]: DEBUG nova.network.neutron [req-e7982f6c-ceb5-4280-98ff-c66b29dce187 req-1b6af886-140e-480f-8721-3b954f7babb5 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:33:26 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:33:26 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:33:26 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:33:26 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=7504MB free_disk=24.964160919189453GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:33:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:26 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Took 0.90 seconds to deallocate network for instance.
Nov 22 14:33:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-e7982f6c-ceb5-4280-98ff-c66b29dce187 req-1b6af886-140e-480f-8721-3b954f7babb5 service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Detach interface failed, port_id=3c7c3d69-1226-4906-b2cb-bedf570f40ee, reason: Instance 68b6744f-c29d-4ccd-83ab-fcc31666d69b could not be found. {{(pid=74776) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 14:33:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4629d82d-fd02-4a58-a535-b362b493e7c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 525baf66-82cc-4e8d-a37a-c92c51d4673d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6f2ce4b2-660c-431f-b951-c6ec5090ef7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f4f30fe7-b234-4f81-b081-3214f5ebe789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance bc98341b-ca28-4097-9887-16c8e8d7f9f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 68b6744f-c29d-4ccd-83ab-fcc31666d69b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance d374cfe8-6d04-4c4e-9055-f46488a76ed8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 245ff2b1-5e87-4756-b4c1-86a2fea089a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 34f85084-64b0-4bfa-b5b7-744e3f26cd91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance ac14ec9b-986a-4fe3-97e3-afbaaca431af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 7819c3bf-bf3e-4012-8fcc-19226486de8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.manager [req-267c0232-491e-4159-90d1-daaaf41b28d8 req-d873da6f-3f33-47f9-ad4e-51faad65a1ea service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received event network-vif-plugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-267c0232-491e-4159-90d1-daaaf41b28d8 req-d873da6f-3f33-47f9-ad4e-51faad65a1ea service nova] Acquiring lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-267c0232-491e-4159-90d1-daaaf41b28d8 req-d873da6f-3f33-47f9-ad4e-51faad65a1ea service nova] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-267c0232-491e-4159-90d1-daaaf41b28d8 req-d873da6f-3f33-47f9-ad4e-51faad65a1ea service nova] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.manager [req-267c0232-491e-4159-90d1-daaaf41b28d8 req-d873da6f-3f33-47f9-ad4e-51faad65a1ea service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] No waiting events found dispatching network-vif-plugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:33:27 user nova-compute[74776]: WARNING nova.compute.manager [req-267c0232-491e-4159-90d1-daaaf41b28d8 req-d873da6f-3f33-47f9-ad4e-51faad65a1ea service nova] [instance: 68b6744f-c29d-4ccd-83ab-fcc31666d69b] Received unexpected event network-vif-plugged-3c7c3d69-1226-4906-b2cb-bedf570f40ee for instance with vm_state deleted and task_state None.
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.565s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.489s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:33:27 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Deleted allocations for instance 68b6744f-c29d-4ccd-83ab-fcc31666d69b
Nov 22 14:33:27 user nova-compute[74776]: WARNING nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 4629d82d-fd02-4a58-a535-b362b493e7c0 {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 525baf66-82cc-4e8d-a37a-c92c51d4673d {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 6f2ce4b2-660c-431f-b951-c6ec5090ef7e {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid f4f30fe7-b234-4f81-b081-3214f5ebe789 {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid bc98341b-ca28-4097-9887-16c8e8d7f9f7 {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 245ff2b1-5e87-4756-b4c1-86a2fea089a5 {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid d374cfe8-6d04-4c4e-9055-f46488a76ed8 {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 34f85084-64b0-4bfa-b5b7-744e3f26cd91 {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid ac14ec9b-986a-4fe3-97e3-afbaaca431af {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 7819c3bf-bf3e-4012-8fcc-19226486de8e {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 68b6744f-c29d-4ccd-83ab-fcc31666d69b {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "4629d82d-fd02-4a58-a535-b362b493e7c0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "525baf66-82cc-4e8d-a37a-c92c51d4673d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "f4f30fe7-b234-4f81-b081-3214f5ebe789" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "f4f30fe7-b234-4f81-b081-3214f5ebe789" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "7819c3bf-bf3e-4012-8fcc-19226486de8e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "7819c3bf-bf3e-4012-8fcc-19226486de8e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:33:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:33:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-851ce5a5-5516-4364-abab-eba219bbf6a0 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.928s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.045s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "f4f30fe7-b234-4f81-b081-3214f5ebe789" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "68b6744f-c29d-4ccd-83ab-fcc31666d69b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "7819c3bf-bf3e-4012-8fcc-19226486de8e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:29 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 34f85084-64b0-4bfa-b5b7-744e3f26cd91 is timed out.
Nov 22 14:33:29 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Successfully detached device vdb from instance 34f85084-64b0-4bfa-b5b7-744e3f26cd91 from the live domain config.
Nov 22 14:33:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRYluWxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:33:29 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:33:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[46028f0d-089d-4316-ae44-fb0ac822fb90]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:33:29 user nova-compute[74776]: No targets found.
Nov 22 14:33:29 user nova-compute[74776]: iSNS:
Nov 22 14:33:29 user nova-compute[74776]: No targets found.
Nov 22 14:33:29 user nova-compute[74776]: STATIC:
Nov 22 14:33:29 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09
Nov 22 14:33:29 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:33:29 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:33:29 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523
Nov 22 14:33:29 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:33:29 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:33:29 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3
Nov 22 14:33:29 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:33:29 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:33:29 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a
Nov 22 14:33:29 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:33:29 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:33:29 user nova-compute[74776]: FIRMWARE:
Nov 22 14:33:29 user nova-compute[74776]: No targets found.
Nov 22 14:33:29 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:33:29 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:33:29 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ce1f91-5c2c-47b9-9f40-662be0722985]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9b5b6b-6972-4fbd-9b37-23d44ab5e16b]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:33:29 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:33:29 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:33:29 user nova-compute[74776]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 (non-flash)
Nov 22 14:33:29 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:33:29 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:33:29 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:33:29 user nova-compute[74776]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 (non-flash)
Nov 22 14:33:29 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c387bb250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523'): ({'sdd'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Removing single pathed devices sdd {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a0c77e-2b0d-4101-9648-d325cd062bf0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e40b3fe-da59-4e9c-ad4a-767717c17d30]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Flushing IO for device /dev/sdd {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[017e0a76-dde0-414b-a464-d785be1e9408]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.031s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bf05c2-1122-4981-8010-509cb5b22f21]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] SCSI volumes sdd have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1713193-e7b6-476c-8045-80f0ff6146c7]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:33:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f623c021-ec5c-4949-b42b-cffd3350800a]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523, portal: 172.16.0.220,3260]
Nov 22 14:33:30 user nova-compute[74776]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523, portal: 172.16.0.220,3260] successful.
Nov 22 14:33:30 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:33:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16dcf80f-a2b8-4c35-970b-65f08a677523 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[449b1354-4c80-423f-a508-91a0c9d9cd66]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:33:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:33:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:33:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] <== disconnect_volume: return (293ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:33:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:33:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:30 user nova-compute[74776]: DEBUG nova.objects.instance [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lazy-loading 'flavor' on Instance uuid 34f85084-64b0-4bfa-b5b7-744e3f26cd91 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:33:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a44f762c-c247-4dc4-be3f-c8f53b51725e tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.655s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.938s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:33:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:33:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:33:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:33:51 user nova-compute[74776]: DEBUG nova.compute.manager [req-e8de49dc-f4a4-43e0-925d-88610f3ca686 req-9392959f-1df0-48c8-902b-1ddbf612454c service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Received event network-changed-9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:33:51 user nova-compute[74776]: DEBUG nova.compute.manager [req-e8de49dc-f4a4-43e0-925d-88610f3ca686 req-9392959f-1df0-48c8-902b-1ddbf612454c service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Refreshing instance network info cache due to event network-changed-9612ebd1-69ec-436b-b721-5b869e501abe. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:33:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e8de49dc-f4a4-43e0-925d-88610f3ca686 req-9392959f-1df0-48c8-902b-1ddbf612454c service nova] Acquiring lock "refresh_cache-ac14ec9b-986a-4fe3-97e3-afbaaca431af" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:33:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e8de49dc-f4a4-43e0-925d-88610f3ca686 req-9392959f-1df0-48c8-902b-1ddbf612454c service nova] Acquired lock "refresh_cache-ac14ec9b-986a-4fe3-97e3-afbaaca431af" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:33:51 user nova-compute[74776]: DEBUG nova.network.neutron [req-e8de49dc-f4a4-43e0-925d-88610f3ca686 req-9392959f-1df0-48c8-902b-1ddbf612454c service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Refreshing network info cache for port 9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:33:51 user nova-compute[74776]: DEBUG nova.network.neutron [req-e8de49dc-f4a4-43e0-925d-88610f3ca686 req-9392959f-1df0-48c8-902b-1ddbf612454c service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Updated VIF entry in instance network info cache for port 9612ebd1-69ec-436b-b721-5b869e501abe. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:33:51 user nova-compute[74776]: DEBUG nova.network.neutron [req-e8de49dc-f4a4-43e0-925d-88610f3ca686 req-9392959f-1df0-48c8-902b-1ddbf612454c service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Updating instance_info_cache with network_info: [{"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9612ebd1-69", "ovs_interfaceid": "9612ebd1-69ec-436b-b721-5b869e501abe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:33:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e8de49dc-f4a4-43e0-925d-88610f3ca686 req-9392959f-1df0-48c8-902b-1ddbf612454c service nova] Releasing lock "refresh_cache-ac14ec9b-986a-4fe3-97e3-afbaaca431af" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:33:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:56 user nova-compute[74776]: INFO nova.compute.manager [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Shelving
Nov 22 14:33:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-44cfc136-db81-4232-8335-cd63d9f57bcd req-f70ae964-0248-43e7-920d-d45d7dd3f057 service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Received event network-vif-unplugged-9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:33:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-44cfc136-db81-4232-8335-cd63d9f57bcd req-f70ae964-0248-43e7-920d-d45d7dd3f057 service nova] Acquiring lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-44cfc136-db81-4232-8335-cd63d9f57bcd req-f70ae964-0248-43e7-920d-d45d7dd3f057 service nova] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-44cfc136-db81-4232-8335-cd63d9f57bcd req-f70ae964-0248-43e7-920d-d45d7dd3f057 service nova] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-44cfc136-db81-4232-8335-cd63d9f57bcd req-f70ae964-0248-43e7-920d-d45d7dd3f057 service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] No waiting events found dispatching network-vif-unplugged-9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:33:56 user nova-compute[74776]: WARNING nova.compute.manager [req-44cfc136-db81-4232-8335-cd63d9f57bcd req-f70ae964-0248-43e7-920d-d45d7dd3f057 service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Received unexpected event network-vif-unplugged-9612ebd1-69ec-436b-b721-5b869e501abe for instance with vm_state active and task_state shelving.
Nov 22 14:33:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:56 user nova-compute[74776]: DEBUG nova.compute.manager [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:33:56 user nova-compute[74776]: INFO nova.compute.manager [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] instance snapshotting
Nov 22 14:33:56 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Instance destroyed successfully.
Nov 22 14:33:56 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Beginning live snapshot process
Nov 22 14:33:56 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Beginning cold snapshot process
Nov 22 14:33:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json -f qcow2 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:57 user nova-compute[74776]: DEBUG nova.privsep.utils [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74776) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 14:33:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk /opt/stack/data/nova/instances/snapshots/tmp3lqn4hil/f840a2b33e094e7db0489dcf5e6939e6 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json -f qcow2 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.211s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwfmn_wbs/de48845672054086bb98c9028e7692a4.delta 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwfmn_wbs/de48845672054086bb98c9028e7692a4.delta 1073741824" returned: 0 in 0.135s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:57 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 22 14:33:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk /opt/stack/data/nova/instances/snapshots/tmp3lqn4hil/f840a2b33e094e7db0489dcf5e6939e6" returned: 0 in 0.865s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:33:57 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Snapshot extracted, beginning image upload
Nov 22 14:33:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:33:58 user nova-compute[74776]: DEBUG nova.compute.manager [req-069ffec5-51fc-45d7-b932-30f40f25e051 req-c39a4812-424b-4d89-bfe5-41a332475fc6 service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Received event network-vif-plugged-9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:33:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-069ffec5-51fc-45d7-b932-30f40f25e051 req-c39a4812-424b-4d89-bfe5-41a332475fc6 service nova] Acquiring lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-069ffec5-51fc-45d7-b932-30f40f25e051 req-c39a4812-424b-4d89-bfe5-41a332475fc6 service nova] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-069ffec5-51fc-45d7-b932-30f40f25e051 req-c39a4812-424b-4d89-bfe5-41a332475fc6 service nova] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:58 user nova-compute[74776]: DEBUG nova.compute.manager [req-069ffec5-51fc-45d7-b932-30f40f25e051 req-c39a4812-424b-4d89-bfe5-41a332475fc6 service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] No waiting events found dispatching network-vif-plugged-9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:33:58 user nova-compute[74776]: WARNING nova.compute.manager [req-069ffec5-51fc-45d7-b932-30f40f25e051 req-c39a4812-424b-4d89-bfe5-41a332475fc6 service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Received unexpected event network-vif-plugged-9612ebd1-69ec-436b-b721-5b869e501abe for instance with vm_state active and task_state shelving_image_uploading.
Nov 22 14:33:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] COPY block job progress, current cursor: 47775744 final cursor: 75497472 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:33:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74776) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 22 14:33:59 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 22 14:33:59 user nova-compute[74776]: DEBUG nova.privsep.utils [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74776) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 14:33:59 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwfmn_wbs/de48845672054086bb98c9028e7692a4.delta /opt/stack/data/nova/instances/snapshots/tmpwfmn_wbs/de48845672054086bb98c9028e7692a4 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:33:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:33:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:33:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:33:59 user nova-compute[74776]: INFO nova.compute.manager [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Terminating instance
Nov 22 14:33:59 user nova-compute[74776]: DEBUG nova.compute.manager [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:33:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:33:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwfmn_wbs/de48845672054086bb98c9028e7692a4.delta /opt/stack/data/nova/instances/snapshots/tmpwfmn_wbs/de48845672054086bb98c9028e7692a4" returned: 0 in 0.446s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:00 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Snapshot extracted, beginning image upload
Nov 22 14:34:00 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Instance destroyed successfully.
Nov 22 14:34:00 user nova-compute[74776]: DEBUG nova.objects.instance [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lazy-loading 'resources' on Instance uuid 34f85084-64b0-4bfa-b5b7-744e3f26cd91 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:31:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-819098257',display_name='tempest-AttachVolumeNegativeTest-server-819098257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-819098257',id=32,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBI5k/nOgXWA61w55fN3ASYAncoQy3hEQcovBd4YCSbeuV2KLqyZFYosBVNp1nvFut5/VtoX2lJr5MShoxdBRvqgFCOyimGn7MLhiCucqqjIz8Qm9ue8KxoonhOed30oWg==',key_name='tempest-keypair-408663051',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:31:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dee58d331979425eb9d48d2a52fc1f68',ramdisk_id='',reservation_id='r-l0t0k2ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-577275639',owner_user_name='tempest-AttachVolumeNegativeTest-577275639-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:31:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1807bb240de749499809fd3dfb520d78',uuid=34f85084-64b0-4bfa-b5b7-744e3f26cd91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "address": "fa:16:3e:b0:46:dd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7ecf07-d9", "ovs_interfaceid": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converting VIF {"id": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "address": "fa:16:3e:b0:46:dd", "network": {"id": "0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-37510645-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee58d331979425eb9d48d2a52fc1f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee7ecf07-d9", "ovs_interfaceid": "ee7ecf07-d931-49bf-a7a3-289e575911a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:46:dd,bridge_name='br-int',has_traffic_filtering=True,id=ee7ecf07-d931-49bf-a7a3-289e575911a4,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee7ecf07-d9') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG os_vif [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:46:dd,bridge_name='br-int',has_traffic_filtering=True,id=ee7ecf07-d931-49bf-a7a3-289e575911a4,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee7ecf07-d9') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee7ecf07-d9, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63144d4e-0f09-4baa-8e40-680c2ef346b1) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-e8ec64aa-6b2e-4614-8c98-06fba57047d8 req-d8cf29a5-a4f2-44df-a8d1-986ccbd7d930 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Received event network-vif-unplugged-ee7ecf07-d931-49bf-a7a3-289e575911a4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e8ec64aa-6b2e-4614-8c98-06fba57047d8 req-d8cf29a5-a4f2-44df-a8d1-986ccbd7d930 service nova] Acquiring lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e8ec64aa-6b2e-4614-8c98-06fba57047d8 req-d8cf29a5-a4f2-44df-a8d1-986ccbd7d930 service nova] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e8ec64aa-6b2e-4614-8c98-06fba57047d8 req-d8cf29a5-a4f2-44df-a8d1-986ccbd7d930 service nova] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-e8ec64aa-6b2e-4614-8c98-06fba57047d8 req-d8cf29a5-a4f2-44df-a8d1-986ccbd7d930 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] No waiting events found dispatching network-vif-unplugged-ee7ecf07-d931-49bf-a7a3-289e575911a4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-e8ec64aa-6b2e-4614-8c98-06fba57047d8 req-d8cf29a5-a4f2-44df-a8d1-986ccbd7d930 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Received event network-vif-unplugged-ee7ecf07-d931-49bf-a7a3-289e575911a4 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-e8ec64aa-6b2e-4614-8c98-06fba57047d8 req-d8cf29a5-a4f2-44df-a8d1-986ccbd7d930 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Received event network-vif-plugged-ee7ecf07-d931-49bf-a7a3-289e575911a4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e8ec64aa-6b2e-4614-8c98-06fba57047d8 req-d8cf29a5-a4f2-44df-a8d1-986ccbd7d930 service nova] Acquiring lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e8ec64aa-6b2e-4614-8c98-06fba57047d8 req-d8cf29a5-a4f2-44df-a8d1-986ccbd7d930 service nova] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e8ec64aa-6b2e-4614-8c98-06fba57047d8 req-d8cf29a5-a4f2-44df-a8d1-986ccbd7d930 service nova] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-e8ec64aa-6b2e-4614-8c98-06fba57047d8 req-d8cf29a5-a4f2-44df-a8d1-986ccbd7d930 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] No waiting events found dispatching network-vif-plugged-ee7ecf07-d931-49bf-a7a3-289e575911a4 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:34:00 user nova-compute[74776]: WARNING nova.compute.manager [req-e8ec64aa-6b2e-4614-8c98-06fba57047d8 req-d8cf29a5-a4f2-44df-a8d1-986ccbd7d930 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Received unexpected event network-vif-plugged-ee7ecf07-d931-49bf-a7a3-289e575911a4 for instance with vm_state active and task_state deleting.
Nov 22 14:34:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:00 user nova-compute[74776]: INFO os_vif [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:46:dd,bridge_name='br-int',has_traffic_filtering=True,id=ee7ecf07-d931-49bf-a7a3-289e575911a4,network=Network(0a7ee471-b5f2-44d4-9ebd-e8d22d9776d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee7ecf07-d9')
Nov 22 14:34:00 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Deleting instance files /opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91_del
Nov 22 14:34:00 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Deletion of /opt/stack/data/nova/instances/34f85084-64b0-4bfa-b5b7-744e3f26cd91_del complete
Nov 22 14:34:00 user nova-compute[74776]: INFO nova.compute.manager [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 22 14:34:00 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:00 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Snapshot image upload complete
Nov 22 14:34:00 user nova-compute[74776]: DEBUG nova.compute.manager [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:34:00 user nova-compute[74776]: INFO nova.compute.manager [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Shelve offloading
Nov 22 14:34:00 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Instance destroyed successfully.
Nov 22 14:34:00 user nova-compute[74776]: DEBUG nova.compute.manager [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "refresh_cache-ac14ec9b-986a-4fe3-97e3-afbaaca431af" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquired lock "refresh_cache-ac14ec9b-986a-4fe3-97e3-afbaaca431af" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:34:00 user nova-compute[74776]: DEBUG nova.network.neutron [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:34:01 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:34:01 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Took 0.74 seconds to deallocate network for instance.
Nov 22 14:34:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:34:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:34:01 user nova-compute[74776]: DEBUG nova.network.neutron [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Updating instance_info_cache with network_info: [{"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9612ebd1-69", "ovs_interfaceid": "9612ebd1-69ec-436b-b721-5b869e501abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:34:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Releasing lock "refresh_cache-ac14ec9b-986a-4fe3-97e3-afbaaca431af" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:34:01 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:34:01 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:34:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:34:01 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Deleted allocations for instance 34f85084-64b0-4bfa-b5b7-744e3f26cd91
Nov 22 14:34:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e6e90cf-569d-4175-93f2-f2479946c0e6 tempest-AttachVolumeNegativeTest-577275639 tempest-AttachVolumeNegativeTest-577275639-project-member] Lock "34f85084-64b0-4bfa-b5b7-744e3f26cd91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.164s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:34:02 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Instance destroyed successfully.
Nov 22 14:34:02 user nova-compute[74776]: DEBUG nova.objects.instance [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lazy-loading 'resources' on Instance uuid ac14ec9b-986a-4fe3-97e3-afbaaca431af {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-760894069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-760894069',id=33,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdVv6ik0x7LTS3T1xKKEQGeVfCF7kChgagVSWlM65HLoyqkv00NkhIQaIYoNFWaBTsZzvGaoREtSwBYGqWRiYq6NdXaQJ6NWlqMyEGRS4eJZ8BDoKPxJuJ060BQc80P9A==',key_name='tempest-keypair-1459052423',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:32:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b1d6da4f9f4149479a779475a69c9110',ramdisk_id='',reservation_id='r-bhjjpdd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1293931160',owner_user_name='tempest-AttachVolumeShelveTestJSON-1293931160-project-member',shelved_at='2023-11-22T14:34:00.861555',shelved_host='user',shelved_image_id='0d5af90e-a4a3-42b0-af2f-68ada88c1e6d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:33:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c63eae228f99474899ce0620a4affe75',uuid=ac14ec9b-986a-4fe3-97e3-afbaaca431af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9612ebd1-69", "ovs_interfaceid": "9612ebd1-69ec-436b-b721-5b869e501abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converting VIF {"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9612ebd1-69", "ovs_interfaceid": "9612ebd1-69ec-436b-b721-5b869e501abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c5:4b,bridge_name='br-int',has_traffic_filtering=True,id=9612ebd1-69ec-436b-b721-5b869e501abe,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9612ebd1-69') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG os_vif [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c5:4b,bridge_name='br-int',has_traffic_filtering=True,id=9612ebd1-69ec-436b-b721-5b869e501abe,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9612ebd1-69') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9612ebd1-69, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a25f48bb-b048-48b3-b305-4331c2f4bff6) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-c6f51196-7a2b-44fa-a972-fccf37eac47d req-56f0b71c-2274-4f1a-b99c-a2b80752486d service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Received event network-changed-9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-c6f51196-7a2b-44fa-a972-fccf37eac47d req-56f0b71c-2274-4f1a-b99c-a2b80752486d service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Refreshing instance network info cache due to event network-changed-9612ebd1-69ec-436b-b721-5b869e501abe. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c6f51196-7a2b-44fa-a972-fccf37eac47d req-56f0b71c-2274-4f1a-b99c-a2b80752486d service nova] Acquiring lock "refresh_cache-ac14ec9b-986a-4fe3-97e3-afbaaca431af" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c6f51196-7a2b-44fa-a972-fccf37eac47d req-56f0b71c-2274-4f1a-b99c-a2b80752486d service nova] Acquired lock "refresh_cache-ac14ec9b-986a-4fe3-97e3-afbaaca431af" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG nova.network.neutron [req-c6f51196-7a2b-44fa-a972-fccf37eac47d req-56f0b71c-2274-4f1a-b99c-a2b80752486d service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Refreshing network info cache for port 9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:34:02 user nova-compute[74776]: INFO os_vif [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c5:4b,bridge_name='br-int',has_traffic_filtering=True,id=9612ebd1-69ec-436b-b721-5b869e501abe,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9612ebd1-69')
Nov 22 14:34:02 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Deleting instance files /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af_del
Nov 22 14:34:02 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Deletion of /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af_del complete
Nov 22 14:34:02 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Deleted allocations for instance ac14ec9b-986a-4fe3-97e3-afbaaca431af
Nov 22 14:34:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG nova.objects.instance [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lazy-loading 'numa_topology' on Instance uuid ac14ec9b-986a-4fe3-97e3-afbaaca431af {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG nova.objects.base [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Object Instance<ac14ec9b-986a-4fe3-97e3-afbaaca431af> lazy-loaded attributes: resources,numa_topology {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-69390761-ca53-43a5-8835-80ee3b070eb2 req-bda27d4b-4555-4aa1-a0c5-2e81330368c1 service nova] [instance: 34f85084-64b0-4bfa-b5b7-744e3f26cd91] Received event network-vif-deleted-ee7ecf07-d931-49bf-a7a3-289e575911a4 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG nova.network.neutron [req-c6f51196-7a2b-44fa-a972-fccf37eac47d req-56f0b71c-2274-4f1a-b99c-a2b80752486d service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Updated VIF entry in instance network info cache for port 9612ebd1-69ec-436b-b721-5b869e501abe. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG nova.network.neutron [req-c6f51196-7a2b-44fa-a972-fccf37eac47d req-56f0b71c-2274-4f1a-b99c-a2b80752486d service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Updating instance_info_cache with network_info: [{"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9612ebd1-69", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c6f51196-7a2b-44fa-a972-fccf37eac47d req-56f0b71c-2274-4f1a-b99c-a2b80752486d service nova] Releasing lock "refresh_cache-ac14ec9b-986a-4fe3-97e3-afbaaca431af" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:34:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:34:02 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Snapshot image upload complete
Nov 22 14:34:02 user nova-compute[74776]: INFO nova.compute.manager [None req-e0a04043-d024-4c07-b0cd-50c2deec0030 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Took 6.24 seconds to snapshot the instance on the hypervisor.
Nov 22 14:34:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8a035e17-f99e-4c4b-af89-3f79aaa9e079 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.908s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:34:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:16 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:34:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:17 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:34:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:34:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:34:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:34:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:34:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:34:18 user nova-compute[74776]: INFO nova.compute.manager [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Terminating instance
Nov 22 14:34:18 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:34:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:34:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:34:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-46e2d7b9-baa8-4e74-a82b-1f0643d10779 req-bd5e8e1d-8b4a-45e8-9fef-2b086e9a1683 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received event network-vif-unplugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:34:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-46e2d7b9-baa8-4e74-a82b-1f0643d10779 req-bd5e8e1d-8b4a-45e8-9fef-2b086e9a1683 service nova] Acquiring lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:34:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-46e2d7b9-baa8-4e74-a82b-1f0643d10779 req-bd5e8e1d-8b4a-45e8-9fef-2b086e9a1683 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:34:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-46e2d7b9-baa8-4e74-a82b-1f0643d10779 req-bd5e8e1d-8b4a-45e8-9fef-2b086e9a1683 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:34:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-46e2d7b9-baa8-4e74-a82b-1f0643d10779 req-bd5e8e1d-8b4a-45e8-9fef-2b086e9a1683 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] No waiting events found dispatching network-vif-unplugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:34:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-46e2d7b9-baa8-4e74-a82b-1f0643d10779 req-bd5e8e1d-8b4a-45e8-9fef-2b086e9a1683 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received event network-vif-unplugged-414f82bf-343b-4e38-bc14-6af797152ea5 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:34:18 user nova-compute[74776]: DEBUG nova.compute.manager [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:34:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:34:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:34:18 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:34:18 user nova-compute[74776]: INFO nova.compute.claims [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Claim successful on node user
Nov 22 14:34:19 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:34:19 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Instance destroyed successfully.
Nov 22 14:34:19 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lazy-loading 'resources' on Instance uuid 245ff2b1-5e87-4756-b4c1-86a2fea089a5 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-10125610',display_name='tempest-ServerActionsTestOtherA-server-10125610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-10125610',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+0/ONa93QEWt5XODlWdDhT3U9g8+KkiNeYX5RdCfVnODI9hDpQVCexgtOudugmxzZAzaK3M5HeFwSkQ11sjSni+XdF+kkALoXukp/BrvBbOU8ZVGgWEOMKJnkhO9ZxRw==',key_name='tempest-keypair-1736172995',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:29:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3958d7be91b4bb1b9e314d8867cd8f5',ramdisk_id='',reservation_id='r-n2u0p23v',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-109524404',owner_user_name='tempest-ServerActionsTestOtherA-109524404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:31:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f703bfbe762447778429bda22b74505c',uuid=245ff2b1-5e87-4756-b4c1-86a2fea089a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converting VIF {"id": "414f82bf-343b-4e38-bc14-6af797152ea5", "address": "fa:16:3e:c0:9f:55", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap414f82bf-34", "ovs_interfaceid": "414f82bf-343b-4e38-bc14-6af797152ea5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:9f:55,bridge_name='br-int',has_traffic_filtering=True,id=414f82bf-343b-4e38-bc14-6af797152ea5,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap414f82bf-34') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG os_vif [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:9f:55,bridge_name='br-int',has_traffic_filtering=True,id=414f82bf-343b-4e38-bc14-6af797152ea5,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap414f82bf-34') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap414f82bf-34, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9093efe6-77d6-4cd4-bb97-883d89eccc11) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:19 user nova-compute[74776]: INFO os_vif [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:9f:55,bridge_name='br-int',has_traffic_filtering=True,id=414f82bf-343b-4e38-bc14-6af797152ea5,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap414f82bf-34')
Nov 22 14:34:19 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XxWHJsVr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:34:19 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:34:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c5c3fd-3d37-4261-8064-5e35daedfa2b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:34:19 user nova-compute[74776]: No targets found.
Nov 22 14:34:19 user nova-compute[74776]: iSNS:
Nov 22 14:34:19 user nova-compute[74776]: No targets found.
Nov 22 14:34:19 user nova-compute[74776]: STATIC:
Nov 22 14:34:19 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09
Nov 22 14:34:19 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:34:19 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:34:19 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3
Nov 22 14:34:19 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:34:19 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:34:19 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a
Nov 22 14:34:19 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:34:19 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:34:19 user nova-compute[74776]: FIRMWARE:
Nov 22 14:34:19 user nova-compute[74776]: No targets found.
Nov 22 14:34:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:34:19 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:34:19 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfa5a2b-74e0-4de4-a1ea-b97c86729037]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6171d0de-07b4-45c8-9487-187a5b50aae3]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:34:19 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:34:19 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:34:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:34:19 user nova-compute[74776]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 (non-flash)
Nov 22 14:34:19 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:34:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c582f3eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3'): ({'sdc'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Removing single pathed devices sdc {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG nova.network.neutron [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:34:19 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee48f021-43c1-47de-be47-6253905d6dda]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1aff0f-399a-4590-92b5-00a279229f08]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Flushing IO for device /dev/sdc {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8da5c7-3c04-4fd1-a923-446affb8fe81]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG nova.policy [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aac47c7fc2fc4380a5673117151dbdb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2602b8e7e2414a3d88d18f9f0c973ab5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7359b28b-e400-44dd-8b61-848d88ce0b24]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23831366538313961', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5b538194', '/dev/disk/by-id/scsi-1SCST_BIO5b538194-816e819ababeade6') {{(pid=85789) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d00250-fdb7-45dc-97b5-040c81c2de89]: (4, None) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16b304d-5dd8-4813-8aee-fc9a37cd63b2]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:34:19 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Creating image(s)
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "/opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "/opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "/opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "377f7131191ddcc203bf5fef71bb96fa43329a13" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "377f7131191ddcc203bf5fef71bb96fa43329a13" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bad1169-c3ec-4a76-8d26-0668210a4d5b]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3, portal: 172.16.0.220,3260]
Nov 22 14:34:19 user nova-compute[74776]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3, portal: 172.16.0.220,3260] successful.
Nov 22 14:34:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:19 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/377f7131191ddcc203bf5fef71bb96fa43329a13.part --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG nova.network.neutron [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Successfully created port: e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c89fa9-05e4-4cca-a2eb-8611a9bc668d]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.775s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] <== disconnect_volume: return (776ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:34:20 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Deleting instance files /opt/stack/data/nova/instances/245ff2b1-5e87-4756-b4c1-86a2fea089a5_del
Nov 22 14:34:20 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Deletion of /opt/stack/data/nova/instances/245ff2b1-5e87-4756-b4c1-86a2fea089a5_del complete
Nov 22 14:34:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/377f7131191ddcc203bf5fef71bb96fa43329a13.part --force-share --output=json" returned: 0 in 0.459s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG nova.virt.images [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] b123b10e-b6aa-4ea6-a79b-d2575d9b405a was qcow2, converting to raw {{(pid=74776) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG nova.privsep.utils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74776) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/377f7131191ddcc203bf5fef71bb96fa43329a13.part /opt/stack/data/nova/instances/_base/377f7131191ddcc203bf5fef71bb96fa43329a13.converted {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:20 user nova-compute[74776]: INFO nova.compute.manager [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Took 2.02 seconds to destroy the instance on the hypervisor.
Nov 22 14:34:20 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG nova.network.neutron [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Successfully updated port: e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/377f7131191ddcc203bf5fef71bb96fa43329a13.part /opt/stack/data/nova/instances/_base/377f7131191ddcc203bf5fef71bb96fa43329a13.converted" returned: 0 in 0.287s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/377f7131191ddcc203bf5fef71bb96fa43329a13.converted --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "refresh_cache-25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquired lock "refresh_cache-25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG nova.network.neutron [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-48822299-3e27-4c79-830a-74dcb3337824 req-42447082-547d-49a0-a9de-2ea523ca7423 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received event network-changed-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-48822299-3e27-4c79-830a-74dcb3337824 req-42447082-547d-49a0-a9de-2ea523ca7423 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Refreshing instance network info cache due to event network-changed-e73b0b93-8497-4bf9-8149-c5c640ff6253. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-48822299-3e27-4c79-830a-74dcb3337824 req-42447082-547d-49a0-a9de-2ea523ca7423 service nova] Acquiring lock "refresh_cache-25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:34:20 user nova-compute[74776]: DEBUG nova.network.neutron [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/377f7131191ddcc203bf5fef71bb96fa43329a13.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "377f7131191ddcc203bf5fef71bb96fa43329a13" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.390s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/377f7131191ddcc203bf5fef71bb96fa43329a13 --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/377f7131191ddcc203bf5fef71bb96fa43329a13 --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "377f7131191ddcc203bf5fef71bb96fa43329a13" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "377f7131191ddcc203bf5fef71bb96fa43329a13" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/377f7131191ddcc203bf5fef71bb96fa43329a13 --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.network.neutron [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Updating instance_info_cache with network_info: [{"id": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "address": "fa:16:3e:68:f0:28", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73b0b93-84", "ovs_interfaceid": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Releasing lock "refresh_cache-25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.compute.manager [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Instance network_info: |[{"id": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "address": "fa:16:3e:68:f0:28", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73b0b93-84", "ovs_interfaceid": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-48822299-3e27-4c79-830a-74dcb3337824 req-42447082-547d-49a0-a9de-2ea523ca7423 service nova] Acquired lock "refresh_cache-25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.network.neutron [req-48822299-3e27-4c79-830a-74dcb3337824 req-42447082-547d-49a0-a9de-2ea523ca7423 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Refreshing network info cache for port e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-58990242-96e4-4aed-8e07-cd25acf83a50 req-d3ddcf63-ff44-4d9a-b2b3-f6428fad3b05 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received event network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-58990242-96e4-4aed-8e07-cd25acf83a50 req-d3ddcf63-ff44-4d9a-b2b3-f6428fad3b05 service nova] Acquiring lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-58990242-96e4-4aed-8e07-cd25acf83a50 req-d3ddcf63-ff44-4d9a-b2b3-f6428fad3b05 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-58990242-96e4-4aed-8e07-cd25acf83a50 req-d3ddcf63-ff44-4d9a-b2b3-f6428fad3b05 service nova] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-58990242-96e4-4aed-8e07-cd25acf83a50 req-d3ddcf63-ff44-4d9a-b2b3-f6428fad3b05 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] No waiting events found dispatching network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:34:21 user nova-compute[74776]: WARNING nova.compute.manager [req-58990242-96e4-4aed-8e07-cd25acf83a50 req-d3ddcf63-ff44-4d9a-b2b3-f6428fad3b05 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received unexpected event network-vif-plugged-414f82bf-343b-4e38-bc14-6af797152ea5 for instance with vm_state active and task_state deleting.
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/377f7131191ddcc203bf5fef71bb96fa43329a13 --force-share --output=json" returned: 0 in 0.181s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/377f7131191ddcc203bf5fef71bb96fa43329a13,backing_fmt=raw /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/377f7131191ddcc203bf5fef71bb96fa43329a13,backing_fmt=raw /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk 1073741824" returned: 0 in 0.048s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "377f7131191ddcc203bf5fef71bb96fa43329a13" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/377f7131191ddcc203bf5fef71bb96fa43329a13 --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/377f7131191ddcc203bf5fef71bb96fa43329a13 --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Skipping network cache update for instance because it is Building. {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Skipping network cache update for instance because it is being deleted. {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.network.neutron [req-48822299-3e27-4c79-830a-74dcb3337824 req-42447082-547d-49a0-a9de-2ea523ca7423 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Updated VIF entry in instance network info cache for port e73b0b93-8497-4bf9-8149-c5c640ff6253. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.network.neutron [req-48822299-3e27-4c79-830a-74dcb3337824 req-42447082-547d-49a0-a9de-2ea523ca7423 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Updating instance_info_cache with network_info: [{"id": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "address": "fa:16:3e:68:f0:28", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73b0b93-84", "ovs_interfaceid": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-48822299-3e27-4c79-830a-74dcb3337824 req-42447082-547d-49a0-a9de-2ea523ca7423 service nova] Releasing lock "refresh_cache-25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid 4629d82d-fd02-4a58-a535-b362b493e7c0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Cannot resize image /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Ensure instance console log exists: /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Start _get_guest_xml network_info=[{"id": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "address": "fa:16:3e:68:f0:28", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73b0b93-84", "ovs_interfaceid": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:34:16Z,direct_url=<?>,disk_format='qcow2',id=b123b10e-b6aa-4ea6-a79b-d2575d9b405a,min_disk=0,min_ram=0,name='tempest-scenario-img--3402522',owner='2602b8e7e2414a3d88d18f9f0c973ab5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:34:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'b123b10e-b6aa-4ea6-a79b-d2575d9b405a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:34:21 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:34:21 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:34:16Z,direct_url=<?>,disk_format='qcow2',id=b123b10e-b6aa-4ea6-a79b-d2575d9b405a,min_disk=0,min_ram=0,name='tempest-scenario-img--3402522',owner='2602b8e7e2414a3d88d18f9f0c973ab5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:34:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:34:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1228269153',display_name='tempest-TestMinimumBasicScenario-server-1228269153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1228269153',id=35,image_ref='b123b10e-b6aa-4ea6-a79b-d2575d9b405a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTCF9EILD4y6IxcYrKKP5EsDB3J0Ac9qEcBJ1MGNXhPb9I02DjoR2D/ekN6rgAkY7TQh7As7M1I3eax87VWaSOCBTNo7YLLObmL4ktL9UrqROnSdIC1Boo2itlj4OTSDg==',key_name='tempest-TestMinimumBasicScenario-1238686472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2602b8e7e2414a3d88d18f9f0c973ab5',ramdisk_id='',reservation_id='r-t0tas7za',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b123b10e-b6aa-4ea6-a79b-d2575d9b405a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1122910147',owner_user_name='tempest-TestMinimumBasicScenario-1122910147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:34:20Z,user_data=None,user_id='aac47c7fc2fc4380a5673117151dbdb0',uuid=25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "address": "fa:16:3e:68:f0:28", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73b0b93-84", "ovs_interfaceid": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Converting VIF {"id": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "address": "fa:16:3e:68:f0:28", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73b0b93-84", "ovs_interfaceid": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:f0:28,bridge_name='br-int',has_traffic_filtering=True,id=e73b0b93-8497-4bf9-8149-c5c640ff6253,network=Network(9ede03a9-ae5e-43f2-9865-595667d6d899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73b0b93-84') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.objects.instance [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lazy-loading 'pci_devices' on Instance uuid 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:34:21 user nova-compute[74776]:   <uuid>25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f</uuid>
Nov 22 14:34:21 user nova-compute[74776]:   <name>instance-00000023</name>
Nov 22 14:34:21 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:34:21 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:34:21 user nova-compute[74776]:   <metadata>
Nov 22 14:34:21 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:34:21 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:34:21 user nova-compute[74776]:       <nova:name>tempest-TestMinimumBasicScenario-server-1228269153</nova:name>
Nov 22 14:34:21 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:34:21</nova:creationTime>
Nov 22 14:34:21 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:34:21 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:34:21 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:34:21 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:34:21 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:34:21 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:34:21 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:34:21 user nova-compute[74776]:       <nova:owner>
Nov 22 14:34:21 user nova-compute[74776]:         <nova:user uuid="aac47c7fc2fc4380a5673117151dbdb0">tempest-TestMinimumBasicScenario-1122910147-project-member</nova:user>
Nov 22 14:34:21 user nova-compute[74776]:         <nova:project uuid="2602b8e7e2414a3d88d18f9f0c973ab5">tempest-TestMinimumBasicScenario-1122910147</nova:project>
Nov 22 14:34:21 user nova-compute[74776]:       </nova:owner>
Nov 22 14:34:21 user nova-compute[74776]:       <nova:root type="image" uuid="b123b10e-b6aa-4ea6-a79b-d2575d9b405a"/>
Nov 22 14:34:21 user nova-compute[74776]:       <nova:ports>
Nov 22 14:34:21 user nova-compute[74776]:         <nova:port uuid="e73b0b93-8497-4bf9-8149-c5c640ff6253">
Nov 22 14:34:21 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 22 14:34:21 user nova-compute[74776]:         </nova:port>
Nov 22 14:34:21 user nova-compute[74776]:       </nova:ports>
Nov 22 14:34:21 user nova-compute[74776]:     </nova:instance>
Nov 22 14:34:21 user nova-compute[74776]:   </metadata>
Nov 22 14:34:21 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:34:21 user nova-compute[74776]:     <system>
Nov 22 14:34:21 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:34:21 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:34:21 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:34:21 user nova-compute[74776]:       <entry name="serial">25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f</entry>
Nov 22 14:34:21 user nova-compute[74776]:       <entry name="uuid">25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f</entry>
Nov 22 14:34:21 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:34:21 user nova-compute[74776]:     </system>
Nov 22 14:34:21 user nova-compute[74776]:   </sysinfo>
Nov 22 14:34:21 user nova-compute[74776]:   <os>
Nov 22 14:34:21 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:34:21 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:34:21 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:34:21 user nova-compute[74776]:   </os>
Nov 22 14:34:21 user nova-compute[74776]:   <features>
Nov 22 14:34:21 user nova-compute[74776]:     <acpi/>
Nov 22 14:34:21 user nova-compute[74776]:     <apic/>
Nov 22 14:34:21 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:34:21 user nova-compute[74776]:   </features>
Nov 22 14:34:21 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:34:21 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:34:21 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:34:21 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:34:21 user nova-compute[74776]:   </clock>
Nov 22 14:34:21 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:34:21 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:34:21 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:34:21 user nova-compute[74776]:   </cpu>
Nov 22 14:34:21 user nova-compute[74776]:   <devices>
Nov 22 14:34:21 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:34:21 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:34:21 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk"/>
Nov 22 14:34:21 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:34:21 user nova-compute[74776]:     </disk>
Nov 22 14:34:21 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:34:21 user nova-compute[74776]:       <mac address="fa:16:3e:68:f0:28"/>
Nov 22 14:34:21 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:34:21 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:34:21 user nova-compute[74776]:       <target dev="tape73b0b93-84"/>
Nov 22 14:34:21 user nova-compute[74776]:     </interface>
Nov 22 14:34:21 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:34:21 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/console.log" append="off"/>
Nov 22 14:34:21 user nova-compute[74776]:     </serial>
Nov 22 14:34:21 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:34:21 user nova-compute[74776]:     <video>
Nov 22 14:34:21 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:34:21 user nova-compute[74776]:     </video>
Nov 22 14:34:21 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:34:21 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:34:21 user nova-compute[74776]:     </rng>
Nov 22 14:34:21 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:34:21 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:34:21 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:34:21 user nova-compute[74776]:     </memballoon>
Nov 22 14:34:21 user nova-compute[74776]:   </devices>
Nov 22 14:34:21 user nova-compute[74776]: </domain>
Nov 22 14:34:21 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:34:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1228269153',display_name='tempest-TestMinimumBasicScenario-server-1228269153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1228269153',id=35,image_ref='b123b10e-b6aa-4ea6-a79b-d2575d9b405a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTCF9EILD4y6IxcYrKKP5EsDB3J0Ac9qEcBJ1MGNXhPb9I02DjoR2D/ekN6rgAkY7TQh7As7M1I3eax87VWaSOCBTNo7YLLObmL4ktL9UrqROnSdIC1Boo2itlj4OTSDg==',key_name='tempest-TestMinimumBasicScenario-1238686472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2602b8e7e2414a3d88d18f9f0c973ab5',ramdisk_id='',reservation_id='r-t0tas7za',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b123b10e-b6aa-4ea6-a79b-d2575d9b405a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1122910147',owner_user_name='tempest-TestMinimumBasicScenario-1122910147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:34:20Z,user_data=None,user_id='aac47c7fc2fc4380a5673117151dbdb0',uuid=25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "address": "fa:16:3e:68:f0:28", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73b0b93-84", "ovs_interfaceid": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Converting VIF {"id": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "address": "fa:16:3e:68:f0:28", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73b0b93-84", "ovs_interfaceid": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:f0:28,bridge_name='br-int',has_traffic_filtering=True,id=e73b0b93-8497-4bf9-8149-c5c640ff6253,network=Network(9ede03a9-ae5e-43f2-9865-595667d6d899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73b0b93-84') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG os_vif [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:f0:28,bridge_name='br-int',has_traffic_filtering=True,id=e73b0b93-8497-4bf9-8149-c5c640ff6253,network=Network(9ede03a9-ae5e-43f2-9865-595667d6d899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73b0b93-84') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69446214-139a-5343-bba1-cf6493fc3e10', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape73b0b93-84, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape73b0b93-84, col_values=(('qos', UUID('e26ec9b4-085d-4eb9-bcb2-18f65c77aaf4')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape73b0b93-84, col_values=(('external_ids', {'iface-id': 'e73b0b93-8497-4bf9-8149-c5c640ff6253', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:f0:28', 'vm-uuid': '25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:21 user nova-compute[74776]: INFO os_vif [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:f0:28,bridge_name='br-int',has_traffic_filtering=True,id=e73b0b93-8497-4bf9-8149-c5c640ff6253,network=Network(9ede03a9-ae5e-43f2-9865-595667d6d899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73b0b93-84')
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:34:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] No VIF found with MAC fa:16:3e:68:f0:28, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:34:21 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Took 1.42 seconds to deallocate network for instance.
Nov 22 14:34:22 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Updating instance_info_cache with network_info: [{"id": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "address": "fa:16:3e:a5:87:db", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabaa3c9b-98", "ovs_interfaceid": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:34:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-4629d82d-fd02-4a58-a535-b362b493e7c0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:34:22 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:34:22 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:34:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:34:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:34:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:34:22 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:34:22 user nova-compute[74776]: INFO nova.compute.manager [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Took 0.78 seconds to detach 1 volumes for instance.
Nov 22 14:34:22 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Deleting volume: 7f52d07d-c6d2-4bdb-995a-6d8cfa40aed3 {{(pid=74776) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 22 14:34:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:34:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:34:23 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:34:23 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:34:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:34:23 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Deleted allocations for instance 245ff2b1-5e87-4756-b4c1-86a2fea089a5
Nov 22 14:34:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d06d11e1-666e-4e5b-8bd1-ad81af3c330c tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "245ff2b1-5e87-4756-b4c1-86a2fea089a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.788s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:34:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-ed256009-0869-4bf9-b0cf-5fa8e4bf0135 req-76716abc-459e-4f50-aac7-202b2d075739 service nova] [instance: 245ff2b1-5e87-4756-b4c1-86a2fea089a5] Received event network-vif-deleted-414f82bf-343b-4e38-bc14-6af797152ea5 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:34:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-3eb9df2f-f061-4808-bc1d-0001470d6607 req-9bddebbc-8709-4448-90e6-e3b626e47af9 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received event network-vif-plugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:34:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3eb9df2f-f061-4808-bc1d-0001470d6607 req-9bddebbc-8709-4448-90e6-e3b626e47af9 service nova] Acquiring lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:34:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3eb9df2f-f061-4808-bc1d-0001470d6607 req-9bddebbc-8709-4448-90e6-e3b626e47af9 service nova] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:34:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3eb9df2f-f061-4808-bc1d-0001470d6607 req-9bddebbc-8709-4448-90e6-e3b626e47af9 service nova] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:34:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-3eb9df2f-f061-4808-bc1d-0001470d6607 req-9bddebbc-8709-4448-90e6-e3b626e47af9 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] No waiting events found dispatching network-vif-plugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:34:23 user nova-compute[74776]: WARNING nova.compute.manager [req-3eb9df2f-f061-4808-bc1d-0001470d6607 req-9bddebbc-8709-4448-90e6-e3b626e47af9 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received unexpected event network-vif-plugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 for instance with vm_state building and task_state spawning.
Nov 22 14:34:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-99d886cb-e3df-443d-a7a2-f33c9d54cad7 req-b069bc35-6638-4c8f-8ad7-867c40a845b7 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received event network-vif-plugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-99d886cb-e3df-443d-a7a2-f33c9d54cad7 req-b069bc35-6638-4c8f-8ad7-867c40a845b7 service nova] Acquiring lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-99d886cb-e3df-443d-a7a2-f33c9d54cad7 req-b069bc35-6638-4c8f-8ad7-867c40a845b7 service nova] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-99d886cb-e3df-443d-a7a2-f33c9d54cad7 req-b069bc35-6638-4c8f-8ad7-867c40a845b7 service nova] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-99d886cb-e3df-443d-a7a2-f33c9d54cad7 req-b069bc35-6638-4c8f-8ad7-867c40a845b7 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] No waiting events found dispatching network-vif-plugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:34:25 user nova-compute[74776]: WARNING nova.compute.manager [req-99d886cb-e3df-443d-a7a2-f33c9d54cad7 req-b069bc35-6638-4c8f-8ad7-867c40a845b7 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received unexpected event network-vif-plugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 for instance with vm_state building and task_state spawning.
Nov 22 14:34:25 user nova-compute[74776]: DEBUG nova.compute.manager [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:34:25 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Instance spawned successfully.
Nov 22 14:34:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:25 user nova-compute[74776]: INFO nova.compute.manager [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Took 6.26 seconds to spawn the instance on the hypervisor.
Nov 22 14:34:25 user nova-compute[74776]: DEBUG nova.compute.manager [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:34:26 user nova-compute[74776]: INFO nova.compute.manager [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Took 7.07 seconds to build instance.
Nov 22 14:34:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49a418c1-5630-4aa2-8564-1721d93bfdea tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.203s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:34:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:34:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:34:27 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:34:27 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:34:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8187MB free_disk=24.92645263671875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:34:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:34:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:34:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 4629d82d-fd02-4a58-a535-b362b493e7c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:34:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 525baf66-82cc-4e8d-a37a-c92c51d4673d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:34:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6f2ce4b2-660c-431f-b951-c6ec5090ef7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:34:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f4f30fe7-b234-4f81-b081-3214f5ebe789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:34:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance bc98341b-ca28-4097-9887-16c8e8d7f9f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:34:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance d374cfe8-6d04-4c4e-9055-f46488a76ed8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:34:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 7819c3bf-bf3e-4012-8fcc-19226486de8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:34:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:34:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:34:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:34:27 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:34:27 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:34:28 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:34:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:34:30 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:34:30 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:34:30 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:34:30 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:34:30 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:34:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:33 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:34:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-f8df9be3-09b3-4a1a-b9eb-989c435e4c4f req-9efaa89b-1b74-412b-aa3b-e33a2772fdc1 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received event network-changed-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:34:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-f8df9be3-09b3-4a1a-b9eb-989c435e4c4f req-9efaa89b-1b74-412b-aa3b-e33a2772fdc1 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Refreshing instance network info cache due to event network-changed-d8edc986-df1e-4de5-9926-4cbb5b4ec280. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:34:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f8df9be3-09b3-4a1a-b9eb-989c435e4c4f req-9efaa89b-1b74-412b-aa3b-e33a2772fdc1 service nova] Acquiring lock "refresh_cache-d374cfe8-6d04-4c4e-9055-f46488a76ed8" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:34:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f8df9be3-09b3-4a1a-b9eb-989c435e4c4f req-9efaa89b-1b74-412b-aa3b-e33a2772fdc1 service nova] Acquired lock "refresh_cache-d374cfe8-6d04-4c4e-9055-f46488a76ed8" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:34:39 user nova-compute[74776]: DEBUG nova.network.neutron [req-f8df9be3-09b3-4a1a-b9eb-989c435e4c4f req-9efaa89b-1b74-412b-aa3b-e33a2772fdc1 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Refreshing network info cache for port d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:34:39 user nova-compute[74776]: DEBUG nova.network.neutron [req-f8df9be3-09b3-4a1a-b9eb-989c435e4c4f req-9efaa89b-1b74-412b-aa3b-e33a2772fdc1 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Updated VIF entry in instance network info cache for port d8edc986-df1e-4de5-9926-4cbb5b4ec280. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:34:39 user nova-compute[74776]: DEBUG nova.network.neutron [req-f8df9be3-09b3-4a1a-b9eb-989c435e4c4f req-9efaa89b-1b74-412b-aa3b-e33a2772fdc1 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Updating instance_info_cache with network_info: [{"id": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "address": "fa:16:3e:1b:64:9b", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8edc986-df", "ovs_interfaceid": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:34:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f8df9be3-09b3-4a1a-b9eb-989c435e4c4f req-9efaa89b-1b74-412b-aa3b-e33a2772fdc1 service nova] Releasing lock "refresh_cache-d374cfe8-6d04-4c4e-9055-f46488a76ed8" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:34:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:34:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:34:39 user nova-compute[74776]: INFO nova.compute.manager [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Detaching volume bf3345cf-179f-42e9-b81c-523f1043ed09
Nov 22 14:34:39 user nova-compute[74776]: INFO nova.virt.block_device [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Attempting to driver detach volume bf3345cf-179f-42e9-b81c-523f1043ed09 from mountpoint /dev/vdb
Nov 22 14:34:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Attempting to detach device vdb from instance d374cfe8-6d04-4c4e-9055-f46488a76ed8 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:34:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:34:39 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:34:39 user nova-compute[74776]:   <source dev="/dev/sdf"/>
Nov 22 14:34:39 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:34:39 user nova-compute[74776]:   <serial>bf3345cf-179f-42e9-b81c-523f1043ed09</serial>
Nov 22 14:34:39 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:34:39 user nova-compute[74776]: </disk>
Nov 22 14:34:39 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:34:39 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Successfully detached device vdb from instance d374cfe8-6d04-4c4e-9055-f46488a76ed8 from the persistent domain config.
Nov 22 14:34:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d374cfe8-6d04-4c4e-9055-f46488a76ed8 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:34:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:34:39 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:34:39 user nova-compute[74776]:   <source dev="/dev/sdf"/>
Nov 22 14:34:39 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:34:39 user nova-compute[74776]:   <serial>bf3345cf-179f-42e9-b81c-523f1043ed09</serial>
Nov 22 14:34:39 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:34:39 user nova-compute[74776]: </disk>
Nov 22 14:34:39 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:34:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d374cfe8-6d04-4c4e-9055-f46488a76ed8 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:34:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-84d0cc69-4a58-4aaa-89bd-f048d608d015 req-5a37dd63-1f35-40a1-bfe7-3013a81bc9bb service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received event network-changed-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:34:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-84d0cc69-4a58-4aaa-89bd-f048d608d015 req-5a37dd63-1f35-40a1-bfe7-3013a81bc9bb service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Refreshing instance network info cache due to event network-changed-d8edc986-df1e-4de5-9926-4cbb5b4ec280. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:34:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-84d0cc69-4a58-4aaa-89bd-f048d608d015 req-5a37dd63-1f35-40a1-bfe7-3013a81bc9bb service nova] Acquiring lock "refresh_cache-d374cfe8-6d04-4c4e-9055-f46488a76ed8" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:34:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-84d0cc69-4a58-4aaa-89bd-f048d608d015 req-5a37dd63-1f35-40a1-bfe7-3013a81bc9bb service nova] Acquired lock "refresh_cache-d374cfe8-6d04-4c4e-9055-f46488a76ed8" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:34:41 user nova-compute[74776]: DEBUG nova.network.neutron [req-84d0cc69-4a58-4aaa-89bd-f048d608d015 req-5a37dd63-1f35-40a1-bfe7-3013a81bc9bb service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Refreshing network info cache for port d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:34:41 user nova-compute[74776]: DEBUG nova.network.neutron [req-84d0cc69-4a58-4aaa-89bd-f048d608d015 req-5a37dd63-1f35-40a1-bfe7-3013a81bc9bb service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Updated VIF entry in instance network info cache for port d8edc986-df1e-4de5-9926-4cbb5b4ec280. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:34:41 user nova-compute[74776]: DEBUG nova.network.neutron [req-84d0cc69-4a58-4aaa-89bd-f048d608d015 req-5a37dd63-1f35-40a1-bfe7-3013a81bc9bb service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Updating instance_info_cache with network_info: [{"id": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "address": "fa:16:3e:1b:64:9b", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8edc986-df", "ovs_interfaceid": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:34:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-84d0cc69-4a58-4aaa-89bd-f048d608d015 req-5a37dd63-1f35-40a1-bfe7-3013a81bc9bb service nova] Releasing lock "refresh_cache-d374cfe8-6d04-4c4e-9055-f46488a76ed8" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:34:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:34:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:00 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d374cfe8-6d04-4c4e-9055-f46488a76ed8 is timed out.
Nov 22 14:35:00 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Successfully detached device vdb from instance d374cfe8-6d04-4c4e-9055-f46488a76ed8 from the live domain config.
Nov 22 14:35:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rGcdPnwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:35:00 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:35:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d352f49-5856-436d-ae36-aacdc57af919]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:35:00 user nova-compute[74776]: No targets found.
Nov 22 14:35:00 user nova-compute[74776]: iSNS:
Nov 22 14:35:00 user nova-compute[74776]: No targets found.
Nov 22 14:35:00 user nova-compute[74776]: STATIC:
Nov 22 14:35:00 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09
Nov 22 14:35:00 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:35:00 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:35:00 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a
Nov 22 14:35:00 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:35:00 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:35:00 user nova-compute[74776]: FIRMWARE:
Nov 22 14:35:00 user nova-compute[74776]: No targets found.
Nov 22 14:35:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:35:00 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:35:00 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd729e0-2a66-4731-95f0-0cb622623b92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2824932-1e1e-47ef-9d23-010f66a42664]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:35:00 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:35:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:35:00 user nova-compute[74776]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 (non-flash)
Nov 22 14:35:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c7820c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09'): ({'sdf'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Removing single pathed devices sdf {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d93537d-5e77-455d-87d9-a5691ca8ffd1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a7c98d-639f-4559-a95b-94317228b1a7]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Flushing IO for device /dev/sdf {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea10f64b-fe28-4460-a53b-3c53a124c9cb]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[257c33d8-8ee6-4cfa-b87a-68f81d5e4b90]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] SCSI volumes sdf have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c4914a-0769-477c-a771-b2785a7f948b]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01b80f9-4d3e-4851-baf2-378d786091c1]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09, portal: 172.16.0.220,3260]
Nov 22 14:35:00 user nova-compute[74776]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09, portal: 172.16.0.220,3260] successful.
Nov 22 14:35:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3345cf-179f-42e9-b81c-523f1043ed09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb40d6c-682c-4c43-a762-e6ffbe009712]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] <== disconnect_volume: return (314ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:35:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:01 user nova-compute[74776]: DEBUG nova.objects.instance [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'flavor' on Instance uuid d374cfe8-6d04-4c4e-9055-f46488a76ed8 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:35:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-056703d2-f0f2-4c41-ab3f-0f5538b6985c tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.685s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "4629d82d-fd02-4a58-a535-b362b493e7c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:12 user nova-compute[74776]: INFO nova.compute.manager [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Terminating instance
Nov 22 14:35:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-b2ab2aff-a890-43f6-832b-f1b0c6d90f6c req-0172de98-bd57-49e9-b021-90cb894b9da5 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Received event network-vif-unplugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b2ab2aff-a890-43f6-832b-f1b0c6d90f6c req-0172de98-bd57-49e9-b021-90cb894b9da5 service nova] Acquiring lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b2ab2aff-a890-43f6-832b-f1b0c6d90f6c req-0172de98-bd57-49e9-b021-90cb894b9da5 service nova] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b2ab2aff-a890-43f6-832b-f1b0c6d90f6c req-0172de98-bd57-49e9-b021-90cb894b9da5 service nova] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-b2ab2aff-a890-43f6-832b-f1b0c6d90f6c req-0172de98-bd57-49e9-b021-90cb894b9da5 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] No waiting events found dispatching network-vif-unplugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-b2ab2aff-a890-43f6-832b-f1b0c6d90f6c req-0172de98-bd57-49e9-b021-90cb894b9da5 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Received event network-vif-unplugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:12 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Instance destroyed successfully.
Nov 22 14:35:12 user nova-compute[74776]: DEBUG nova.objects.instance [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lazy-loading 'resources' on Instance uuid 4629d82d-fd02-4a58-a535-b362b493e7c0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1566459201',display_name='tempest-ServerActionsTestOtherA-server-1566459201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1566459201',id=3,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+0/ONa93QEWt5XODlWdDhT3U9g8+KkiNeYX5RdCfVnODI9hDpQVCexgtOudugmxzZAzaK3M5HeFwSkQ11sjSni+XdF+kkALoXukp/BrvBbOU8ZVGgWEOMKJnkhO9ZxRw==',key_name='tempest-keypair-1736172995',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:16:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3958d7be91b4bb1b9e314d8867cd8f5',ramdisk_id='',reservation_id='r-mvhea8kj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-109524404',owner_user_name='tempest-ServerActionsTestOtherA-109524404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:16:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f703bfbe762447778429bda22b74505c',uuid=4629d82d-fd02-4a58-a535-b362b493e7c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "address": "fa:16:3e:a5:87:db", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabaa3c9b-98", "ovs_interfaceid": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converting VIF {"id": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "address": "fa:16:3e:a5:87:db", "network": {"id": "0d29410c-c4ee-459e-ae3c-9a1f0ac27c18", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2027168286-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3958d7be91b4bb1b9e314d8867cd8f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabaa3c9b-98", "ovs_interfaceid": "abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:87:db,bridge_name='br-int',has_traffic_filtering=True,id=abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabaa3c9b-98') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG os_vif [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:87:db,bridge_name='br-int',has_traffic_filtering=True,id=abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabaa3c9b-98') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabaa3c9b-98, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0264a8d2-4325-46f8-a14c-e8bd42e324fc) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:35:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:35:12 user nova-compute[74776]: INFO os_vif [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:87:db,bridge_name='br-int',has_traffic_filtering=True,id=abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a,network=Network(0d29410c-c4ee-459e-ae3c-9a1f0ac27c18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabaa3c9b-98')
Nov 22 14:35:12 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Deleting instance files /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0_del
Nov 22 14:35:12 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Deletion of /opt/stack/data/nova/instances/4629d82d-fd02-4a58-a535-b362b493e7c0_del complete
Nov 22 14:35:13 user nova-compute[74776]: INFO nova.compute.manager [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Took 0.76 seconds to destroy the instance on the hypervisor.
Nov 22 14:35:13 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:35:13 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:35:13 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:35:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:13 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:35:13 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Took 0.80 seconds to deallocate network for instance.
Nov 22 14:35:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:14 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Deleted allocations for instance 4629d82d-fd02-4a58-a535-b362b493e7c0
Nov 22 14:35:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5846fdd8-27f3-4241-89d0-ab534305ec5b tempest-ServerActionsTestOtherA-109524404 tempest-ServerActionsTestOtherA-109524404-project-member] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.043s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Received event network-vif-plugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] Acquiring lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] No waiting events found dispatching network-vif-plugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:35:14 user nova-compute[74776]: WARNING nova.compute.manager [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Received unexpected event network-vif-plugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a for instance with vm_state deleted and task_state None.
Nov 22 14:35:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Received event network-vif-plugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] Acquiring lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] No waiting events found dispatching network-vif-plugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:35:14 user nova-compute[74776]: WARNING nova.compute.manager [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Received unexpected event network-vif-plugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a for instance with vm_state deleted and task_state None.
Nov 22 14:35:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Received event network-vif-plugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] Acquiring lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] No waiting events found dispatching network-vif-plugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:35:14 user nova-compute[74776]: WARNING nova.compute.manager [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Received unexpected event network-vif-plugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a for instance with vm_state deleted and task_state None.
Nov 22 14:35:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Received event network-vif-unplugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] Acquiring lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] No waiting events found dispatching network-vif-unplugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:35:14 user nova-compute[74776]: WARNING nova.compute.manager [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Received unexpected event network-vif-unplugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a for instance with vm_state deleted and task_state None.
Nov 22 14:35:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Received event network-vif-deleted-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Received event network-vif-plugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] Acquiring lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] Lock "4629d82d-fd02-4a58-a535-b362b493e7c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] No waiting events found dispatching network-vif-plugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:35:14 user nova-compute[74776]: WARNING nova.compute.manager [req-29bc100f-66f6-4a7f-897a-0306b7891a49 req-84c28470-3bd9-4cfd-aab2-6d35be1ddda7 service nova] [instance: 4629d82d-fd02-4a58-a535-b362b493e7c0] Received unexpected event network-vif-plugged-abaa3c9b-9850-4ca8-a9aa-7b9e68f5dd1a for instance with vm_state deleted and task_state None.
Nov 22 14:35:17 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:35:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:19 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:35:20 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:35:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:35:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:35:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:35:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:35:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:23 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:35:23 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:35:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-525baf66-82cc-4e8d-a37a-c92c51d4673d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:35:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-525baf66-82cc-4e8d-a37a-c92c51d4673d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:35:23 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:35:24 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Updating instance_info_cache with network_info: [{"id": "ac898a82-d482-4299-b86b-db6aacf8175a", "address": "fa:16:3e:38:af:39", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac898a82-d4", "ovs_interfaceid": "ac898a82-d482-4299-b86b-db6aacf8175a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:35:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-525baf66-82cc-4e8d-a37a-c92c51d4673d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:35:24 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:35:24 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:35:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:24 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:35:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:35:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:27 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:35:27 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:35:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8213MB free_disk=24.907787322998047GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:35:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 525baf66-82cc-4e8d-a37a-c92c51d4673d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:35:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6f2ce4b2-660c-431f-b951-c6ec5090ef7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:35:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f4f30fe7-b234-4f81-b081-3214f5ebe789 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:35:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance bc98341b-ca28-4097-9887-16c8e8d7f9f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:35:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance d374cfe8-6d04-4c4e-9055-f46488a76ed8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:35:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 7819c3bf-bf3e-4012-8fcc-19226486de8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:35:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:35:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:35:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:35:27 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:35:27 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:35:27 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:35:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:29 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:35:29 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:35:29 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:35:29 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:35:29 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:35:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:29 user nova-compute[74776]: INFO nova.compute.manager [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Terminating instance
Nov 22 14:35:29 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:35:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:30 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Instance destroyed successfully.
Nov 22 14:35:30 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'resources' on Instance uuid d374cfe8-6d04-4c4e-9055-f46488a76ed8 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:35:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:28:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1107406588',display_name='tempest-ServerRescueNegativeTestJSON-server-1107406588',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1107406588',id=30,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1EyvTUUIuL6MgjFwn8DE49EjeyaQMzjJ84mYADLNQzIT3JkXlfY5dJuarBt9fszAfaeI4YT8kZ6F8q9hJdZViGfNftC06XGNEwinXrNa81UMAylnLx5vkvB9ePotD5ng==',key_name='tempest-keypair-1510487701',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:31:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36f36a88fd7b403d9c2dd29bcd64aac6',ramdisk_id='',reservation_id='r-7iylxjz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1360515217',owner_user_name='tempest-ServerRescueNegativeTestJSON-1360515217-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:32:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d686d08dc36a49fa80192546c4f68940',uuid=d374cfe8-6d04-4c4e-9055-f46488a76ed8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "address": "fa:16:3e:1b:64:9b", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8edc986-df", "ovs_interfaceid": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:35:30 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converting VIF {"id": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "address": "fa:16:3e:1b:64:9b", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8edc986-df", "ovs_interfaceid": "d8edc986-df1e-4de5-9926-4cbb5b4ec280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:35:30 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:64:9b,bridge_name='br-int',has_traffic_filtering=True,id=d8edc986-df1e-4de5-9926-4cbb5b4ec280,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8edc986-df') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:35:30 user nova-compute[74776]: DEBUG os_vif [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:64:9b,bridge_name='br-int',has_traffic_filtering=True,id=d8edc986-df1e-4de5-9926-4cbb5b4ec280,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8edc986-df') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:35:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8edc986-df, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:35:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:35:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3127384-ca3a-4efa-9e20-4f3a9b9bf67a) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:35:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:35:30 user nova-compute[74776]: INFO os_vif [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:64:9b,bridge_name='br-int',has_traffic_filtering=True,id=d8edc986-df1e-4de5-9926-4cbb5b4ec280,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8edc986-df')
Nov 22 14:35:30 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Deleting instance files /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8_del
Nov 22 14:35:30 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Deletion of /opt/stack/data/nova/instances/d374cfe8-6d04-4c4e-9055-f46488a76ed8_del complete
Nov 22 14:35:30 user nova-compute[74776]: INFO nova.compute.manager [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 22 14:35:30 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:35:30 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:35:30 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:35:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:31 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:35:31 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Took 1.15 seconds to deallocate network for instance.
Nov 22 14:35:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-2785bd2a-9549-4103-9b93-b89f997ec8a3 req-61253c0d-8f2f-45d8-bb40-2427827499b5 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Received event network-vif-deleted-d8edc986-df1e-4de5-9926-4cbb5b4ec280 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:35:31 user nova-compute[74776]: INFO nova.compute.manager [req-2785bd2a-9549-4103-9b93-b89f997ec8a3 req-61253c0d-8f2f-45d8-bb40-2427827499b5 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Neutron deleted interface d8edc986-df1e-4de5-9926-4cbb5b4ec280; detaching it from the instance and deleting it from the info cache
Nov 22 14:35:31 user nova-compute[74776]: DEBUG nova.network.neutron [req-2785bd2a-9549-4103-9b93-b89f997ec8a3 req-61253c0d-8f2f-45d8-bb40-2427827499b5 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:35:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-2785bd2a-9549-4103-9b93-b89f997ec8a3 req-61253c0d-8f2f-45d8-bb40-2427827499b5 service nova] [instance: d374cfe8-6d04-4c4e-9055-f46488a76ed8] Detach interface failed, port_id=d8edc986-df1e-4de5-9926-4cbb5b4ec280, reason: Instance d374cfe8-6d04-4c4e-9055-f46488a76ed8 could not be found. {{(pid=74776) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 14:35:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:32 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:35:32 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:35:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:32 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Deleted allocations for instance d374cfe8-6d04-4c4e-9055-f46488a76ed8
Nov 22 14:35:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d7cc27e7-b6b5-476a-9cdd-c8f2cbb3d25f tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "d374cfe8-6d04-4c4e-9055-f46488a76ed8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.483s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Acquiring lock "2b57c3c6-2b63-4caf-af83-c5d026a5e157" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Lock "2b57c3c6-2b63-4caf-af83-c5d026a5e157" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:34 user nova-compute[74776]: DEBUG nova.compute.manager [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:35:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:34 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:35:34 user nova-compute[74776]: INFO nova.compute.claims [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Claim successful on node user
Nov 22 14:35:34 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:35:34 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:35:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:34 user nova-compute[74776]: DEBUG nova.compute.manager [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:35:34 user nova-compute[74776]: DEBUG nova.compute.manager [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:35:34 user nova-compute[74776]: DEBUG nova.network.neutron [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:35:34 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:35:34 user nova-compute[74776]: DEBUG nova.compute.manager [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:35:34 user nova-compute[74776]: DEBUG nova.policy [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0eeea2b5eb8a496c8e7b880f76267845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8080925d46054d36a78044f741861425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:35:34 user nova-compute[74776]: DEBUG nova.compute.manager [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:35:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:35:34 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Creating image(s)
Nov 22 14:35:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Lock "/opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Lock "/opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.182s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.179s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG nova.network.neutron [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Successfully created port: aa68b905-ddee-44c5-936a-310de3d906c9 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157/disk 1073741824" returned: 0 in 0.050s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.204s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Cannot resize image /opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Ensure instance console log exists: /opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG nova.network.neutron [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Successfully updated port: aa68b905-ddee-44c5-936a-310de3d906c9 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Acquiring lock "refresh_cache-2b57c3c6-2b63-4caf-af83-c5d026a5e157" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Acquired lock "refresh_cache-2b57c3c6-2b63-4caf-af83-c5d026a5e157" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG nova.network.neutron [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG nova.compute.manager [req-97ed2d50-b707-4a7a-974a-357336034e71 req-c326887e-bec4-4f12-8181-5980a8cc858a service nova] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Received event network-changed-aa68b905-ddee-44c5-936a-310de3d906c9 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG nova.compute.manager [req-97ed2d50-b707-4a7a-974a-357336034e71 req-c326887e-bec4-4f12-8181-5980a8cc858a service nova] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Refreshing instance network info cache due to event network-changed-aa68b905-ddee-44c5-936a-310de3d906c9. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-97ed2d50-b707-4a7a-974a-357336034e71 req-c326887e-bec4-4f12-8181-5980a8cc858a service nova] Acquiring lock "refresh_cache-2b57c3c6-2b63-4caf-af83-c5d026a5e157" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG nova.network.neutron [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:35:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.network.neutron [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Updating instance_info_cache with network_info: [{"id": "aa68b905-ddee-44c5-936a-310de3d906c9", "address": "fa:16:3e:5d:4b:a4", "network": {"id": "e15e5de2-0012-46fe-a5ea-61ee7b59688b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1110547767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8080925d46054d36a78044f741861425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa68b905-dd", "ovs_interfaceid": "aa68b905-ddee-44c5-936a-310de3d906c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Releasing lock "refresh_cache-2b57c3c6-2b63-4caf-af83-c5d026a5e157" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Instance network_info: |[{"id": "aa68b905-ddee-44c5-936a-310de3d906c9", "address": "fa:16:3e:5d:4b:a4", "network": {"id": "e15e5de2-0012-46fe-a5ea-61ee7b59688b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1110547767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8080925d46054d36a78044f741861425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa68b905-dd", "ovs_interfaceid": "aa68b905-ddee-44c5-936a-310de3d906c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-97ed2d50-b707-4a7a-974a-357336034e71 req-c326887e-bec4-4f12-8181-5980a8cc858a service nova] Acquired lock "refresh_cache-2b57c3c6-2b63-4caf-af83-c5d026a5e157" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.network.neutron [req-97ed2d50-b707-4a7a-974a-357336034e71 req-c326887e-bec4-4f12-8181-5980a8cc858a service nova] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Refreshing network info cache for port aa68b905-ddee-44c5-936a-310de3d906c9 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Start _get_guest_xml network_info=[{"id": "aa68b905-ddee-44c5-936a-310de3d906c9", "address": "fa:16:3e:5d:4b:a4", "network": {"id": "e15e5de2-0012-46fe-a5ea-61ee7b59688b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1110547767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8080925d46054d36a78044f741861425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa68b905-dd", "ovs_interfaceid": "aa68b905-ddee-44c5-936a-310de3d906c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:35:36 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:35:36 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1401728127',display_name='tempest-VolumesActionsTest-instance-1401728127',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1401728127',id=36,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8080925d46054d36a78044f741861425',ramdisk_id='',reservation_id='r-e3t8nuuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-250386743',owner_user_name='tempest-VolumesActionsTest-250386743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:35:35Z,user_data=None,user_id='0eeea2b5eb8a496c8e7b880f76267845',uuid=2b57c3c6-2b63-4caf-af83-c5d026a5e157,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa68b905-ddee-44c5-936a-310de3d906c9", "address": "fa:16:3e:5d:4b:a4", "network": {"id": "e15e5de2-0012-46fe-a5ea-61ee7b59688b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1110547767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8080925d46054d36a78044f741861425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa68b905-dd", "ovs_interfaceid": "aa68b905-ddee-44c5-936a-310de3d906c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Converting VIF {"id": "aa68b905-ddee-44c5-936a-310de3d906c9", "address": "fa:16:3e:5d:4b:a4", "network": {"id": "e15e5de2-0012-46fe-a5ea-61ee7b59688b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1110547767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8080925d46054d36a78044f741861425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa68b905-dd", "ovs_interfaceid": "aa68b905-ddee-44c5-936a-310de3d906c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4b:a4,bridge_name='br-int',has_traffic_filtering=True,id=aa68b905-ddee-44c5-936a-310de3d906c9,network=Network(e15e5de2-0012-46fe-a5ea-61ee7b59688b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa68b905-dd') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.objects.instance [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b57c3c6-2b63-4caf-af83-c5d026a5e157 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:35:36 user nova-compute[74776]:   <uuid>2b57c3c6-2b63-4caf-af83-c5d026a5e157</uuid>
Nov 22 14:35:36 user nova-compute[74776]:   <name>instance-00000024</name>
Nov 22 14:35:36 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:35:36 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:35:36 user nova-compute[74776]:   <metadata>
Nov 22 14:35:36 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:35:36 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:35:36 user nova-compute[74776]:       <nova:name>tempest-VolumesActionsTest-instance-1401728127</nova:name>
Nov 22 14:35:36 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:35:36</nova:creationTime>
Nov 22 14:35:36 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:35:36 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:35:36 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:35:36 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:35:36 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:35:36 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:35:36 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:35:36 user nova-compute[74776]:       <nova:owner>
Nov 22 14:35:36 user nova-compute[74776]:         <nova:user uuid="0eeea2b5eb8a496c8e7b880f76267845">tempest-VolumesActionsTest-250386743-project-member</nova:user>
Nov 22 14:35:36 user nova-compute[74776]:         <nova:project uuid="8080925d46054d36a78044f741861425">tempest-VolumesActionsTest-250386743</nova:project>
Nov 22 14:35:36 user nova-compute[74776]:       </nova:owner>
Nov 22 14:35:36 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:35:36 user nova-compute[74776]:       <nova:ports>
Nov 22 14:35:36 user nova-compute[74776]:         <nova:port uuid="aa68b905-ddee-44c5-936a-310de3d906c9">
Nov 22 14:35:36 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 14:35:36 user nova-compute[74776]:         </nova:port>
Nov 22 14:35:36 user nova-compute[74776]:       </nova:ports>
Nov 22 14:35:36 user nova-compute[74776]:     </nova:instance>
Nov 22 14:35:36 user nova-compute[74776]:   </metadata>
Nov 22 14:35:36 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:35:36 user nova-compute[74776]:     <system>
Nov 22 14:35:36 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:35:36 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:35:36 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:35:36 user nova-compute[74776]:       <entry name="serial">2b57c3c6-2b63-4caf-af83-c5d026a5e157</entry>
Nov 22 14:35:36 user nova-compute[74776]:       <entry name="uuid">2b57c3c6-2b63-4caf-af83-c5d026a5e157</entry>
Nov 22 14:35:36 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:35:36 user nova-compute[74776]:     </system>
Nov 22 14:35:36 user nova-compute[74776]:   </sysinfo>
Nov 22 14:35:36 user nova-compute[74776]:   <os>
Nov 22 14:35:36 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:35:36 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:35:36 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:35:36 user nova-compute[74776]:   </os>
Nov 22 14:35:36 user nova-compute[74776]:   <features>
Nov 22 14:35:36 user nova-compute[74776]:     <acpi/>
Nov 22 14:35:36 user nova-compute[74776]:     <apic/>
Nov 22 14:35:36 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:35:36 user nova-compute[74776]:   </features>
Nov 22 14:35:36 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:35:36 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:35:36 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:35:36 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:35:36 user nova-compute[74776]:   </clock>
Nov 22 14:35:36 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:35:36 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:35:36 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:35:36 user nova-compute[74776]:   </cpu>
Nov 22 14:35:36 user nova-compute[74776]:   <devices>
Nov 22 14:35:36 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:35:36 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:35:36 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157/disk"/>
Nov 22 14:35:36 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:35:36 user nova-compute[74776]:     </disk>
Nov 22 14:35:36 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:35:36 user nova-compute[74776]:       <mac address="fa:16:3e:5d:4b:a4"/>
Nov 22 14:35:36 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:35:36 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:35:36 user nova-compute[74776]:       <target dev="tapaa68b905-dd"/>
Nov 22 14:35:36 user nova-compute[74776]:     </interface>
Nov 22 14:35:36 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:35:36 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157/console.log" append="off"/>
Nov 22 14:35:36 user nova-compute[74776]:     </serial>
Nov 22 14:35:36 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:35:36 user nova-compute[74776]:     <video>
Nov 22 14:35:36 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:35:36 user nova-compute[74776]:     </video>
Nov 22 14:35:36 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:35:36 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:35:36 user nova-compute[74776]:     </rng>
Nov 22 14:35:36 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:35:36 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:35:36 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:35:36 user nova-compute[74776]:     </memballoon>
Nov 22 14:35:36 user nova-compute[74776]:   </devices>
Nov 22 14:35:36 user nova-compute[74776]: </domain>
Nov 22 14:35:36 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1401728127',display_name='tempest-VolumesActionsTest-instance-1401728127',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1401728127',id=36,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8080925d46054d36a78044f741861425',ramdisk_id='',reservation_id='r-e3t8nuuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-250386743',owner_user_name='tempest-VolumesActionsTest-250386743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:35:35Z,user_data=None,user_id='0eeea2b5eb8a496c8e7b880f76267845',uuid=2b57c3c6-2b63-4caf-af83-c5d026a5e157,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa68b905-ddee-44c5-936a-310de3d906c9", "address": "fa:16:3e:5d:4b:a4", "network": {"id": "e15e5de2-0012-46fe-a5ea-61ee7b59688b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1110547767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8080925d46054d36a78044f741861425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa68b905-dd", "ovs_interfaceid": "aa68b905-ddee-44c5-936a-310de3d906c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Converting VIF {"id": "aa68b905-ddee-44c5-936a-310de3d906c9", "address": "fa:16:3e:5d:4b:a4", "network": {"id": "e15e5de2-0012-46fe-a5ea-61ee7b59688b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1110547767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8080925d46054d36a78044f741861425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa68b905-dd", "ovs_interfaceid": "aa68b905-ddee-44c5-936a-310de3d906c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4b:a4,bridge_name='br-int',has_traffic_filtering=True,id=aa68b905-ddee-44c5-936a-310de3d906c9,network=Network(e15e5de2-0012-46fe-a5ea-61ee7b59688b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa68b905-dd') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG os_vif [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4b:a4,bridge_name='br-int',has_traffic_filtering=True,id=aa68b905-ddee-44c5-936a-310de3d906c9,network=Network(e15e5de2-0012-46fe-a5ea-61ee7b59688b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa68b905-dd') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a33c763a-4dc6-56cf-8cfb-918a72362fb7', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa68b905-dd, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa68b905-dd, col_values=(('qos', UUID('339906d8-0e7a-4e83-803e-5223cf416ef7')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa68b905-dd, col_values=(('external_ids', {'iface-id': 'aa68b905-ddee-44c5-936a-310de3d906c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:4b:a4', 'vm-uuid': '2b57c3c6-2b63-4caf-af83-c5d026a5e157'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:36 user nova-compute[74776]: INFO os_vif [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4b:a4,bridge_name='br-int',has_traffic_filtering=True,id=aa68b905-ddee-44c5-936a-310de3d906c9,network=Network(e15e5de2-0012-46fe-a5ea-61ee7b59688b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa68b905-dd')
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] No VIF found with MAC fa:16:3e:5d:4b:a4, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.network.neutron [req-97ed2d50-b707-4a7a-974a-357336034e71 req-c326887e-bec4-4f12-8181-5980a8cc858a service nova] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Updated VIF entry in instance network info cache for port aa68b905-ddee-44c5-936a-310de3d906c9. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG nova.network.neutron [req-97ed2d50-b707-4a7a-974a-357336034e71 req-c326887e-bec4-4f12-8181-5980a8cc858a service nova] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Updating instance_info_cache with network_info: [{"id": "aa68b905-ddee-44c5-936a-310de3d906c9", "address": "fa:16:3e:5d:4b:a4", "network": {"id": "e15e5de2-0012-46fe-a5ea-61ee7b59688b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1110547767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8080925d46054d36a78044f741861425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa68b905-dd", "ovs_interfaceid": "aa68b905-ddee-44c5-936a-310de3d906c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:35:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-97ed2d50-b707-4a7a-974a-357336034e71 req-c326887e-bec4-4f12-8181-5980a8cc858a service nova] Releasing lock "refresh_cache-2b57c3c6-2b63-4caf-af83-c5d026a5e157" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:35:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:37 user nova-compute[74776]: DEBUG nova.compute.manager [req-b18738c0-601f-4a68-bfeb-2b8b62c3a148 req-1410e73c-ec04-442b-80b1-008acb9b3ccf service nova] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Received event network-vif-plugged-aa68b905-ddee-44c5-936a-310de3d906c9 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:35:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b18738c0-601f-4a68-bfeb-2b8b62c3a148 req-1410e73c-ec04-442b-80b1-008acb9b3ccf service nova] Acquiring lock "2b57c3c6-2b63-4caf-af83-c5d026a5e157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b18738c0-601f-4a68-bfeb-2b8b62c3a148 req-1410e73c-ec04-442b-80b1-008acb9b3ccf service nova] Lock "2b57c3c6-2b63-4caf-af83-c5d026a5e157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b18738c0-601f-4a68-bfeb-2b8b62c3a148 req-1410e73c-ec04-442b-80b1-008acb9b3ccf service nova] Lock "2b57c3c6-2b63-4caf-af83-c5d026a5e157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:37 user nova-compute[74776]: DEBUG nova.compute.manager [req-b18738c0-601f-4a68-bfeb-2b8b62c3a148 req-1410e73c-ec04-442b-80b1-008acb9b3ccf service nova] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] No waiting events found dispatching network-vif-plugged-aa68b905-ddee-44c5-936a-310de3d906c9 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:35:37 user nova-compute[74776]: WARNING nova.compute.manager [req-b18738c0-601f-4a68-bfeb-2b8b62c3a148 req-1410e73c-ec04-442b-80b1-008acb9b3ccf service nova] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Received unexpected event network-vif-plugged-aa68b905-ddee-44c5-936a-310de3d906c9 for instance with vm_state building and task_state spawning.
Nov 22 14:35:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:39 user nova-compute[74776]: DEBUG nova.compute.manager [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:35:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:35:39 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Instance spawned successfully.
Nov 22 14:35:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:35:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:35:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:35:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:35:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:35:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:35:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:35:39 user nova-compute[74776]: INFO nova.compute.manager [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 22 14:35:39 user nova-compute[74776]: DEBUG nova.compute.manager [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:35:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-57983f80-a139-474a-a386-b9a21ed49e3e req-935a1bb8-a48f-4bdb-81c8-79aaa9cc34ee service nova] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Received event network-vif-plugged-aa68b905-ddee-44c5-936a-310de3d906c9 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:35:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-57983f80-a139-474a-a386-b9a21ed49e3e req-935a1bb8-a48f-4bdb-81c8-79aaa9cc34ee service nova] Acquiring lock "2b57c3c6-2b63-4caf-af83-c5d026a5e157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-57983f80-a139-474a-a386-b9a21ed49e3e req-935a1bb8-a48f-4bdb-81c8-79aaa9cc34ee service nova] Lock "2b57c3c6-2b63-4caf-af83-c5d026a5e157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-57983f80-a139-474a-a386-b9a21ed49e3e req-935a1bb8-a48f-4bdb-81c8-79aaa9cc34ee service nova] Lock "2b57c3c6-2b63-4caf-af83-c5d026a5e157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-57983f80-a139-474a-a386-b9a21ed49e3e req-935a1bb8-a48f-4bdb-81c8-79aaa9cc34ee service nova] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] No waiting events found dispatching network-vif-plugged-aa68b905-ddee-44c5-936a-310de3d906c9 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:35:39 user nova-compute[74776]: WARNING nova.compute.manager [req-57983f80-a139-474a-a386-b9a21ed49e3e req-935a1bb8-a48f-4bdb-81c8-79aaa9cc34ee service nova] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Received unexpected event network-vif-plugged-aa68b905-ddee-44c5-936a-310de3d906c9 for instance with vm_state building and task_state spawning.
Nov 22 14:35:39 user nova-compute[74776]: INFO nova.compute.manager [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Took 5.64 seconds to build instance.
Nov 22 14:35:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b7e85e81-1039-438a-b70f-61df124f9106 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Lock "2b57c3c6-2b63-4caf-af83-c5d026a5e157" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.741s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:49 user nova-compute[74776]: INFO nova.compute.manager [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Unshelving
Nov 22 14:35:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:49 user nova-compute[74776]: DEBUG nova.objects.instance [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lazy-loading 'pci_requests' on Instance uuid ac14ec9b-986a-4fe3-97e3-afbaaca431af {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:35:49 user nova-compute[74776]: DEBUG nova.objects.instance [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lazy-loading 'numa_topology' on Instance uuid ac14ec9b-986a-4fe3-97e3-afbaaca431af {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:35:49 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:35:49 user nova-compute[74776]: INFO nova.compute.claims [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Claim successful on node user
Nov 22 14:35:49 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:35:49 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:35:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:49 user nova-compute[74776]: INFO nova.network.neutron [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Updating port 9612ebd1-69ec-436b-b721-5b869e501abe with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 22 14:35:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "refresh_cache-ac14ec9b-986a-4fe3-97e3-afbaaca431af" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:35:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquired lock "refresh_cache-ac14ec9b-986a-4fe3-97e3-afbaaca431af" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:35:50 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:35:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-19074f7d-ece7-4945-b219-bceaabf539b3 req-bfaae93b-cb14-4565-843a-23f5518c2bcd service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Received event network-changed-9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:35:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-19074f7d-ece7-4945-b219-bceaabf539b3 req-bfaae93b-cb14-4565-843a-23f5518c2bcd service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Refreshing instance network info cache due to event network-changed-9612ebd1-69ec-436b-b721-5b869e501abe. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:35:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-19074f7d-ece7-4945-b219-bceaabf539b3 req-bfaae93b-cb14-4565-843a-23f5518c2bcd service nova] Acquiring lock "refresh_cache-ac14ec9b-986a-4fe3-97e3-afbaaca431af" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:35:50 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Updating instance_info_cache with network_info: [{"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9612ebd1-69", "ovs_interfaceid": "9612ebd1-69ec-436b-b721-5b869e501abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:35:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Releasing lock "refresh_cache-ac14ec9b-986a-4fe3-97e3-afbaaca431af" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:35:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:35:50 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Creating image(s)
Nov 22 14:35:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "/opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "/opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:50 user nova-compute[74776]: DEBUG nova.objects.instance [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lazy-loading 'trusted_certs' on Instance uuid ac14ec9b-986a-4fe3-97e3-afbaaca431af {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:35:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-19074f7d-ece7-4945-b219-bceaabf539b3 req-bfaae93b-cb14-4565-843a-23f5518c2bcd service nova] Acquired lock "refresh_cache-ac14ec9b-986a-4fe3-97e3-afbaaca431af" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:35:50 user nova-compute[74776]: DEBUG nova.network.neutron [req-19074f7d-ece7-4945-b219-bceaabf539b3 req-bfaae93b-cb14-4565-843a-23f5518c2bcd service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Refreshing network info cache for port 9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:35:50 user nova-compute[74776]: DEBUG nova.objects.base [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Object Instance<ac14ec9b-986a-4fe3-97e3-afbaaca431af> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:35:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "cb30ed7a028babaaeecbb1e750ff7f75a0703f2f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "cb30ed7a028babaaeecbb1e750ff7f75a0703f2f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb30ed7a028babaaeecbb1e750ff7f75a0703f2f.part --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb30ed7a028babaaeecbb1e750ff7f75a0703f2f.part --force-share --output=json" returned: 0 in 0.181s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:51 user nova-compute[74776]: DEBUG nova.virt.images [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] 0d5af90e-a4a3-42b0-af2f-68ada88c1e6d was qcow2, converting to raw {{(pid=74776) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 14:35:51 user nova-compute[74776]: DEBUG nova.privsep.utils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74776) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 14:35:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cb30ed7a028babaaeecbb1e750ff7f75a0703f2f.part /opt/stack/data/nova/instances/_base/cb30ed7a028babaaeecbb1e750ff7f75a0703f2f.converted {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:51 user nova-compute[74776]: DEBUG nova.network.neutron [req-19074f7d-ece7-4945-b219-bceaabf539b3 req-bfaae93b-cb14-4565-843a-23f5518c2bcd service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Updated VIF entry in instance network info cache for port 9612ebd1-69ec-436b-b721-5b869e501abe. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:35:51 user nova-compute[74776]: DEBUG nova.network.neutron [req-19074f7d-ece7-4945-b219-bceaabf539b3 req-bfaae93b-cb14-4565-843a-23f5518c2bcd service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Updating instance_info_cache with network_info: [{"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9612ebd1-69", "ovs_interfaceid": "9612ebd1-69ec-436b-b721-5b869e501abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:35:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-19074f7d-ece7-4945-b219-bceaabf539b3 req-bfaae93b-cb14-4565-843a-23f5518c2bcd service nova] Releasing lock "refresh_cache-ac14ec9b-986a-4fe3-97e3-afbaaca431af" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:35:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cb30ed7a028babaaeecbb1e750ff7f75a0703f2f.part /opt/stack/data/nova/instances/_base/cb30ed7a028babaaeecbb1e750ff7f75a0703f2f.converted" returned: 0 in 0.448s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb30ed7a028babaaeecbb1e750ff7f75a0703f2f.converted --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb30ed7a028babaaeecbb1e750ff7f75a0703f2f.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "cb30ed7a028babaaeecbb1e750ff7f75a0703f2f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.794s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb30ed7a028babaaeecbb1e750ff7f75a0703f2f --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb30ed7a028babaaeecbb1e750ff7f75a0703f2f --force-share --output=json" returned: 0 in 0.169s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "cb30ed7a028babaaeecbb1e750ff7f75a0703f2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "cb30ed7a028babaaeecbb1e750ff7f75a0703f2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb30ed7a028babaaeecbb1e750ff7f75a0703f2f --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb30ed7a028babaaeecbb1e750ff7f75a0703f2f --force-share --output=json" returned: 0 in 0.185s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cb30ed7a028babaaeecbb1e750ff7f75a0703f2f,backing_fmt=raw /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cb30ed7a028babaaeecbb1e750ff7f75a0703f2f,backing_fmt=raw /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk 1073741824" returned: 0 in 0.059s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "cb30ed7a028babaaeecbb1e750ff7f75a0703f2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb30ed7a028babaaeecbb1e750ff7f75a0703f2f --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb30ed7a028babaaeecbb1e750ff7f75a0703f2f --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:53 user nova-compute[74776]: DEBUG nova.objects.instance [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lazy-loading 'migration_context' on Instance uuid ac14ec9b-986a-4fe3-97e3-afbaaca431af {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:35:53 user nova-compute[74776]: DEBUG nova.objects.base [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Object Instance<ac14ec9b-986a-4fe3-97e3-afbaaca431af> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:35:53 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Rebasing disk image.
Nov 22 14:35:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.167s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e -F raw /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:35:55 user nova-compute[74776]: INFO nova.compute.claims [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Claim successful on node user
Nov 22 14:35:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e -F raw /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk" returned: 0 in 2.617s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Ensure instance console log exists: /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Start _get_guest_xml network_info=[{"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9612ebd1-69", "ovs_interfaceid": "9612ebd1-69ec-436b-b721-5b869e501abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='1be1cb443604ee5fe7411e6e1745d280',container_format='bare',created_at=2023-11-22T14:33:56Z,direct_url=<?>,disk_format='qcow2',id=0d5af90e-a4a3-42b0-af2f-68ada88c1e6d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-760894069-shelved',owner='b1d6da4f9f4149479a779475a69c9110',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-22T14:34:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:35:55 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:35:55 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1be1cb443604ee5fe7411e6e1745d280',container_format='bare',created_at=2023-11-22T14:33:56Z,direct_url=<?>,disk_format='qcow2',id=0d5af90e-a4a3-42b0-af2f-68ada88c1e6d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-760894069-shelved',owner='b1d6da4f9f4149479a779475a69c9110',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-22T14:34:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.objects.instance [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lazy-loading 'vcpu_model' on Instance uuid ac14ec9b-986a-4fe3-97e3-afbaaca431af {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:35:55 user nova-compute[74776]: DEBUG nova.objects.base [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Object Instance<ac14ec9b-986a-4fe3-97e3-afbaaca431af> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T14:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-760894069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-760894069',id=33,image_ref='0d5af90e-a4a3-42b0-af2f-68ada88c1e6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1459052423',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:32:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b1d6da4f9f4149479a779475a69c9110',ramdisk_id='',reservation_id='r-bhjjpdd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1293931160',owner_user_name='tempest-AttachVolumeShelveTestJSON-1293931160-project-member',shelved_at='2023-11-22T14:34:00.861555',shelved_host='user',shelved_image_id='0d5af90e-a4a3-42b0-af2f-68ada88c1e6d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:35:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c63eae228f99474899ce0620a4affe75',uuid=ac14ec9b-986a-4fe3-97e3-afbaaca431af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9612ebd1-69", "ovs_interfaceid": "9612ebd1-69ec-436b-b721-5b869e501abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converting VIF {"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9612ebd1-69", "ovs_interfaceid": "9612ebd1-69ec-436b-b721-5b869e501abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c5:4b,bridge_name='br-int',has_traffic_filtering=True,id=9612ebd1-69ec-436b-b721-5b869e501abe,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9612ebd1-69') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG nova.objects.instance [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lazy-loading 'pci_devices' on Instance uuid ac14ec9b-986a-4fe3-97e3-afbaaca431af {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG nova.objects.base [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Object Instance<ac14ec9b-986a-4fe3-97e3-afbaaca431af> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:35:56 user nova-compute[74776]:   <uuid>ac14ec9b-986a-4fe3-97e3-afbaaca431af</uuid>
Nov 22 14:35:56 user nova-compute[74776]:   <name>instance-00000021</name>
Nov 22 14:35:56 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:35:56 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:35:56 user nova-compute[74776]:   <metadata>
Nov 22 14:35:56 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:35:56 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:35:56 user nova-compute[74776]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-760894069</nova:name>
Nov 22 14:35:56 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:35:55</nova:creationTime>
Nov 22 14:35:56 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:35:56 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:35:56 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:35:56 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:35:56 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:35:56 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:35:56 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:35:56 user nova-compute[74776]:       <nova:owner>
Nov 22 14:35:56 user nova-compute[74776]:         <nova:user uuid="c63eae228f99474899ce0620a4affe75">tempest-AttachVolumeShelveTestJSON-1293931160-project-member</nova:user>
Nov 22 14:35:56 user nova-compute[74776]:         <nova:project uuid="b1d6da4f9f4149479a779475a69c9110">tempest-AttachVolumeShelveTestJSON-1293931160</nova:project>
Nov 22 14:35:56 user nova-compute[74776]:       </nova:owner>
Nov 22 14:35:56 user nova-compute[74776]:       <nova:root type="image" uuid="0d5af90e-a4a3-42b0-af2f-68ada88c1e6d"/>
Nov 22 14:35:56 user nova-compute[74776]:       <nova:ports>
Nov 22 14:35:56 user nova-compute[74776]:         <nova:port uuid="9612ebd1-69ec-436b-b721-5b869e501abe">
Nov 22 14:35:56 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 22 14:35:56 user nova-compute[74776]:         </nova:port>
Nov 22 14:35:56 user nova-compute[74776]:       </nova:ports>
Nov 22 14:35:56 user nova-compute[74776]:     </nova:instance>
Nov 22 14:35:56 user nova-compute[74776]:   </metadata>
Nov 22 14:35:56 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:35:56 user nova-compute[74776]:     <system>
Nov 22 14:35:56 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:35:56 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:35:56 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:35:56 user nova-compute[74776]:       <entry name="serial">ac14ec9b-986a-4fe3-97e3-afbaaca431af</entry>
Nov 22 14:35:56 user nova-compute[74776]:       <entry name="uuid">ac14ec9b-986a-4fe3-97e3-afbaaca431af</entry>
Nov 22 14:35:56 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:35:56 user nova-compute[74776]:     </system>
Nov 22 14:35:56 user nova-compute[74776]:   </sysinfo>
Nov 22 14:35:56 user nova-compute[74776]:   <os>
Nov 22 14:35:56 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:35:56 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:35:56 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:35:56 user nova-compute[74776]:   </os>
Nov 22 14:35:56 user nova-compute[74776]:   <features>
Nov 22 14:35:56 user nova-compute[74776]:     <acpi/>
Nov 22 14:35:56 user nova-compute[74776]:     <apic/>
Nov 22 14:35:56 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:35:56 user nova-compute[74776]:   </features>
Nov 22 14:35:56 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:35:56 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:35:56 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:35:56 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:35:56 user nova-compute[74776]:   </clock>
Nov 22 14:35:56 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:35:56 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:35:56 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:35:56 user nova-compute[74776]:   </cpu>
Nov 22 14:35:56 user nova-compute[74776]:   <devices>
Nov 22 14:35:56 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:35:56 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:35:56 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk"/>
Nov 22 14:35:56 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:35:56 user nova-compute[74776]:     </disk>
Nov 22 14:35:56 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:35:56 user nova-compute[74776]:       <mac address="fa:16:3e:3d:c5:4b"/>
Nov 22 14:35:56 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:35:56 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:35:56 user nova-compute[74776]:       <target dev="tap9612ebd1-69"/>
Nov 22 14:35:56 user nova-compute[74776]:     </interface>
Nov 22 14:35:56 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:35:56 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/console.log" append="off"/>
Nov 22 14:35:56 user nova-compute[74776]:     </serial>
Nov 22 14:35:56 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:35:56 user nova-compute[74776]:     <video>
Nov 22 14:35:56 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:35:56 user nova-compute[74776]:     </video>
Nov 22 14:35:56 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:35:56 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:35:56 user nova-compute[74776]:     </rng>
Nov 22 14:35:56 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:35:56 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:35:56 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:35:56 user nova-compute[74776]:     </memballoon>
Nov 22 14:35:56 user nova-compute[74776]:   </devices>
Nov 22 14:35:56 user nova-compute[74776]: </domain>
Nov 22 14:35:56 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T14:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-760894069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-760894069',id=33,image_ref='0d5af90e-a4a3-42b0-af2f-68ada88c1e6d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1459052423',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:32:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b1d6da4f9f4149479a779475a69c9110',ramdisk_id='',reservation_id='r-bhjjpdd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1293931160',owner_user_name='tempest-AttachVolumeShelveTestJSON-1293931160-project-member',shelved_at='2023-11-22T14:34:00.861555',shelved_host='user',shelved_image_id='0d5af90e-a4a3-42b0-af2f-68ada88c1e6d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:35:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c63eae228f99474899ce0620a4affe75',uuid=ac14ec9b-986a-4fe3-97e3-afbaaca431af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9612ebd1-69", "ovs_interfaceid": "9612ebd1-69ec-436b-b721-5b869e501abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converting VIF {"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9612ebd1-69", "ovs_interfaceid": "9612ebd1-69ec-436b-b721-5b869e501abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c5:4b,bridge_name='br-int',has_traffic_filtering=True,id=9612ebd1-69ec-436b-b721-5b869e501abe,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9612ebd1-69') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG os_vif [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c5:4b,bridge_name='br-int',has_traffic_filtering=True,id=9612ebd1-69ec-436b-b721-5b869e501abe,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9612ebd1-69') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f7f87a85-5b69-5cdf-889b-e6c92e02abe3', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9612ebd1-69, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9612ebd1-69, col_values=(('qos', UUID('5ca669fa-b195-4fe2-99d9-e7bfbfd74843')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9612ebd1-69, col_values=(('external_ids', {'iface-id': '9612ebd1-69ec-436b-b721-5b869e501abe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:c5:4b', 'vm-uuid': 'ac14ec9b-986a-4fe3-97e3-afbaaca431af'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:56 user nova-compute[74776]: INFO os_vif [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c5:4b,bridge_name='br-int',has_traffic_filtering=True,id=9612ebd1-69ec-436b-b721-5b869e501abe,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9612ebd1-69')
Nov 22 14:35:56 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] No VIF found with MAC fa:16:3e:3d:c5:4b, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:35:56 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:35:56 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:35:56 user nova-compute[74776]: DEBUG nova.policy [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dea876275c70471d9cba1c3158bd63e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359aba8e95e4090a02fb0a46012f20b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:35:56 user nova-compute[74776]: INFO nova.virt.block_device [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Booting with volume-backed-image ee204558-2a75-42f8-8c03-3c76a3916fa5 at /dev/vda
Nov 22 14:35:57 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Successfully created port: bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:35:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:57 user nova-compute[74776]: DEBUG nova.compute.manager [req-9cbb2dd6-2184-413e-aadc-b17ffdf334d0 req-eabaf8d6-5b55-4933-9eb6-fd1135f6c79d service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Received event network-vif-plugged-9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:35:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9cbb2dd6-2184-413e-aadc-b17ffdf334d0 req-eabaf8d6-5b55-4933-9eb6-fd1135f6c79d service nova] Acquiring lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9cbb2dd6-2184-413e-aadc-b17ffdf334d0 req-eabaf8d6-5b55-4933-9eb6-fd1135f6c79d service nova] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9cbb2dd6-2184-413e-aadc-b17ffdf334d0 req-eabaf8d6-5b55-4933-9eb6-fd1135f6c79d service nova] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:57 user nova-compute[74776]: DEBUG nova.compute.manager [req-9cbb2dd6-2184-413e-aadc-b17ffdf334d0 req-eabaf8d6-5b55-4933-9eb6-fd1135f6c79d service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] No waiting events found dispatching network-vif-plugged-9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:35:57 user nova-compute[74776]: WARNING nova.compute.manager [req-9cbb2dd6-2184-413e-aadc-b17ffdf334d0 req-eabaf8d6-5b55-4933-9eb6-fd1135f6c79d service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Received unexpected event network-vif-plugged-9612ebd1-69ec-436b-b721-5b869e501abe for instance with vm_state shelved_offloaded and task_state spawning.
Nov 22 14:35:57 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Successfully updated port: bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:35:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "refresh_cache-a0fdd07c-7e30-449f-95c4-8c2560d760e1" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:35:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquired lock "refresh_cache-a0fdd07c-7e30-449f-95c4-8c2560d760e1" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:35:57 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:35:57 user nova-compute[74776]: DEBUG nova.compute.manager [req-b811c1ac-ffbb-41d1-8bf5-3d4d4b2209c3 req-ca6b3ee2-fa79-4448-ab02-506a8f4c0707 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received event network-changed-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:35:57 user nova-compute[74776]: DEBUG nova.compute.manager [req-b811c1ac-ffbb-41d1-8bf5-3d4d4b2209c3 req-ca6b3ee2-fa79-4448-ab02-506a8f4c0707 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Refreshing instance network info cache due to event network-changed-bd8f1cd4-9030-4326-946d-380263be6dca. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:35:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b811c1ac-ffbb-41d1-8bf5-3d4d4b2209c3 req-ca6b3ee2-fa79-4448-ab02-506a8f4c0707 service nova] Acquiring lock "refresh_cache-a0fdd07c-7e30-449f-95c4-8c2560d760e1" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:35:57 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:35:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:35:58 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Updating instance_info_cache with network_info: [{"id": "bd8f1cd4-9030-4326-946d-380263be6dca", "address": "fa:16:3e:6c:d1:a2", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8f1cd4-90", "ovs_interfaceid": "bd8f1cd4-9030-4326-946d-380263be6dca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:35:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Releasing lock "refresh_cache-a0fdd07c-7e30-449f-95c4-8c2560d760e1" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:35:58 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Instance network_info: |[{"id": "bd8f1cd4-9030-4326-946d-380263be6dca", "address": "fa:16:3e:6c:d1:a2", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8f1cd4-90", "ovs_interfaceid": "bd8f1cd4-9030-4326-946d-380263be6dca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:35:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b811c1ac-ffbb-41d1-8bf5-3d4d4b2209c3 req-ca6b3ee2-fa79-4448-ab02-506a8f4c0707 service nova] Acquired lock "refresh_cache-a0fdd07c-7e30-449f-95c4-8c2560d760e1" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:35:58 user nova-compute[74776]: DEBUG nova.network.neutron [req-b811c1ac-ffbb-41d1-8bf5-3d4d4b2209c3 req-ca6b3ee2-fa79-4448-ab02-506a8f4c0707 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Refreshing network info cache for port bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:35:58 user nova-compute[74776]: DEBUG nova.network.neutron [req-b811c1ac-ffbb-41d1-8bf5-3d4d4b2209c3 req-ca6b3ee2-fa79-4448-ab02-506a8f4c0707 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Updated VIF entry in instance network info cache for port bd8f1cd4-9030-4326-946d-380263be6dca. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:35:58 user nova-compute[74776]: DEBUG nova.network.neutron [req-b811c1ac-ffbb-41d1-8bf5-3d4d4b2209c3 req-ca6b3ee2-fa79-4448-ab02-506a8f4c0707 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Updating instance_info_cache with network_info: [{"id": "bd8f1cd4-9030-4326-946d-380263be6dca", "address": "fa:16:3e:6c:d1:a2", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8f1cd4-90", "ovs_interfaceid": "bd8f1cd4-9030-4326-946d-380263be6dca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:35:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b811c1ac-ffbb-41d1-8bf5-3d4d4b2209c3 req-ca6b3ee2-fa79-4448-ab02-506a8f4c0707 service nova] Releasing lock "refresh_cache-a0fdd07c-7e30-449f-95c4-8c2560d760e1" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:35:59 user nova-compute[74776]: DEBUG nova.compute.manager [req-577052df-ddcc-4d14-8654-1739e2194cb7 req-db96a886-b8be-4267-8603-170d6ee611ad service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Received event network-vif-plugged-9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:35:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-577052df-ddcc-4d14-8654-1739e2194cb7 req-db96a886-b8be-4267-8603-170d6ee611ad service nova] Acquiring lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:35:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-577052df-ddcc-4d14-8654-1739e2194cb7 req-db96a886-b8be-4267-8603-170d6ee611ad service nova] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:35:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-577052df-ddcc-4d14-8654-1739e2194cb7 req-db96a886-b8be-4267-8603-170d6ee611ad service nova] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:35:59 user nova-compute[74776]: DEBUG nova.compute.manager [req-577052df-ddcc-4d14-8654-1739e2194cb7 req-db96a886-b8be-4267-8603-170d6ee611ad service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] No waiting events found dispatching network-vif-plugged-9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:35:59 user nova-compute[74776]: WARNING nova.compute.manager [req-577052df-ddcc-4d14-8654-1739e2194cb7 req-db96a886-b8be-4267-8603-170d6ee611ad service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Received unexpected event network-vif-plugged-9612ebd1-69ec-436b-b721-5b869e501abe for instance with vm_state shelved_offloaded and task_state spawning.
Nov 22 14:35:59 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:35:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:35:59 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Instance spawned successfully.
Nov 22 14:36:00 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:36:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f85cb155-50fe-4add-a7ef-1a777d519370 tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.102s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:02 user nova-compute[74776]: DEBUG os_brick.utils [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:36:02 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:02 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:02 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf27a0f-58f3-468b-9281-54fe4adc8dc8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:02 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:02 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:02 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c505302-24fc-48aa-8ef8-ffb91765934b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:02 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:02 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:02 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f26a515-9595-4e74-aae6-01ce27ab8e97]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:02 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4ebafb-84d2-4588-85d7-a84eeb02d870]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:02 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:02 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:36:02 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:36:02 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:02 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:36:02 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:36:02 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcc72e9-deb2-4a97-943a-8032d1c7ae04]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:02 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:36:02 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:36:02 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:36:02 user nova-compute[74776]: DEBUG os_brick.utils [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:36:02 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Updating existing volume attachment record: bf9b8679-4572-479c-84b6-dbbbd8fc9ec1 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:36:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:36:08 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Creating image(s)
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Did not create local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Ensure instance console log exists: /opt/stack/data/nova/instances/a0fdd07c-7e30-449f-95c4-8c2560d760e1/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Start _get_guest_xml network_info=[{"id": "bd8f1cd4-9030-4326-946d-380263be6dca", "address": "fa:16:3e:6c:d1:a2", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8f1cd4-90", "ovs_interfaceid": "bd8f1cd4-9030-4326-946d-380263be6dca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'bf9b8679-4572-479c-84b6-dbbbd8fc9ec1', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjWVmCuG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a0fdd07c-7e30-449f-95c4-8c2560d760e1', 'attached_at': '', 'detached_at': '', 'volume_id': '7daa249b-815d-47f6-9c03-33cff794a261', 'serial': '7daa249b-815d-47f6-9c03-33cff794a261'}, 'boot_index': 0, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:36:08 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:36:08 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjWVmCuG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:36:08 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:36:08 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:36:08 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a912656-126b-4a2e-8f5a-54601e79bc62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:36:08 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e146f730-9d85-46cc-a3e6-5da6aae61d06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261] added
Nov 22 14:36:08 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efbd665-f2e1-4f48-9a23-1db606200fc4]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4aec84-8415-440e-82ee-caf2c01bc4e1]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TjWVmCuG {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TjWVmCuG" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[89368344-81cc-4145-a20e-ea835ee4b50f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TjWVmCuG'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ba426a-9933-4bb9-b72c-cec4c459962a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b46b8e-0f58-47ad-b359-0c70bae049e2]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:36:08 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:36:08 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2ec64d-1b1c-4512-819d-00f68cebb87f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261, portal: 172.16.0.220,3260]
Nov 22 14:36:08 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261, portal: 172.16.0.220,3260] successful.
Nov 22 14:36:08 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c60f98-3d02-4389-85f7-b66c81e1bb6a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2ceeb7-a293-414f-aa1b-3fadfc7cba84]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:36:08 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:36:08 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:36:08 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:36:08 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c5731a-0a9b-49e2-98d1-270daa0f0219]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:08 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjWVmCuG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23832386434636464', 'path': '/dev/sdc'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832386434636464', 'path': '/dev/sdc'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-460725042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-460725042',id=37,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d359aba8e95e4090a02fb0a46012f20b',ramdisk_id='',reservation_id='r-k5u3k3yl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-202976361',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:35:56Z,user_data=None,user_id='dea876275c70471d9cba1c3158bd63e2',uuid=a0fdd07c-7e30-449f-95c4-8c2560d760e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd8f1cd4-9030-4326-946d-380263be6dca", "address": "fa:16:3e:6c:d1:a2", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8f1cd4-90", "ovs_interfaceid": "bd8f1cd4-9030-4326-946d-380263be6dca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converting VIF {"id": "bd8f1cd4-9030-4326-946d-380263be6dca", "address": "fa:16:3e:6c:d1:a2", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8f1cd4-90", "ovs_interfaceid": "bd8f1cd4-9030-4326-946d-380263be6dca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:d1:a2,bridge_name='br-int',has_traffic_filtering=True,id=bd8f1cd4-9030-4326-946d-380263be6dca,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8f1cd4-90') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG nova.objects.instance [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'pci_devices' on Instance uuid a0fdd07c-7e30-449f-95c4-8c2560d760e1 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:36:09 user nova-compute[74776]:   <uuid>a0fdd07c-7e30-449f-95c4-8c2560d760e1</uuid>
Nov 22 14:36:09 user nova-compute[74776]:   <name>instance-00000025</name>
Nov 22 14:36:09 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:36:09 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:36:09 user nova-compute[74776]:   <metadata>
Nov 22 14:36:09 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:36:09 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:36:09 user nova-compute[74776]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-460725042</nova:name>
Nov 22 14:36:09 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:36:08</nova:creationTime>
Nov 22 14:36:09 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:36:09 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:36:09 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:36:09 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:36:09 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:36:09 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:36:09 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:36:09 user nova-compute[74776]:       <nova:owner>
Nov 22 14:36:09 user nova-compute[74776]:         <nova:user uuid="dea876275c70471d9cba1c3158bd63e2">tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member</nova:user>
Nov 22 14:36:09 user nova-compute[74776]:         <nova:project uuid="d359aba8e95e4090a02fb0a46012f20b">tempest-ServerBootFromVolumeStableRescueTest-202976361</nova:project>
Nov 22 14:36:09 user nova-compute[74776]:       </nova:owner>
Nov 22 14:36:09 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:36:09 user nova-compute[74776]:       <nova:ports>
Nov 22 14:36:09 user nova-compute[74776]:         <nova:port uuid="bd8f1cd4-9030-4326-946d-380263be6dca">
Nov 22 14:36:09 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 22 14:36:09 user nova-compute[74776]:         </nova:port>
Nov 22 14:36:09 user nova-compute[74776]:       </nova:ports>
Nov 22 14:36:09 user nova-compute[74776]:     </nova:instance>
Nov 22 14:36:09 user nova-compute[74776]:   </metadata>
Nov 22 14:36:09 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:36:09 user nova-compute[74776]:     <system>
Nov 22 14:36:09 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:36:09 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:36:09 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:36:09 user nova-compute[74776]:       <entry name="serial">a0fdd07c-7e30-449f-95c4-8c2560d760e1</entry>
Nov 22 14:36:09 user nova-compute[74776]:       <entry name="uuid">a0fdd07c-7e30-449f-95c4-8c2560d760e1</entry>
Nov 22 14:36:09 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:36:09 user nova-compute[74776]:     </system>
Nov 22 14:36:09 user nova-compute[74776]:   </sysinfo>
Nov 22 14:36:09 user nova-compute[74776]:   <os>
Nov 22 14:36:09 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:36:09 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:36:09 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:36:09 user nova-compute[74776]:   </os>
Nov 22 14:36:09 user nova-compute[74776]:   <features>
Nov 22 14:36:09 user nova-compute[74776]:     <acpi/>
Nov 22 14:36:09 user nova-compute[74776]:     <apic/>
Nov 22 14:36:09 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:36:09 user nova-compute[74776]:   </features>
Nov 22 14:36:09 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:36:09 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:36:09 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:36:09 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:36:09 user nova-compute[74776]:   </clock>
Nov 22 14:36:09 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:36:09 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:36:09 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:36:09 user nova-compute[74776]:   </cpu>
Nov 22 14:36:09 user nova-compute[74776]:   <devices>
Nov 22 14:36:09 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:36:09 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:36:09 user nova-compute[74776]:       <source dev="/dev/sdc"/>
Nov 22 14:36:09 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:36:09 user nova-compute[74776]:       <serial>7daa249b-815d-47f6-9c03-33cff794a261</serial>
Nov 22 14:36:09 user nova-compute[74776]:     </disk>
Nov 22 14:36:09 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:36:09 user nova-compute[74776]:       <mac address="fa:16:3e:6c:d1:a2"/>
Nov 22 14:36:09 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:36:09 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:36:09 user nova-compute[74776]:       <target dev="tapbd8f1cd4-90"/>
Nov 22 14:36:09 user nova-compute[74776]:     </interface>
Nov 22 14:36:09 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:36:09 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/a0fdd07c-7e30-449f-95c4-8c2560d760e1/console.log" append="off"/>
Nov 22 14:36:09 user nova-compute[74776]:     </serial>
Nov 22 14:36:09 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:36:09 user nova-compute[74776]:     <video>
Nov 22 14:36:09 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:36:09 user nova-compute[74776]:     </video>
Nov 22 14:36:09 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:36:09 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:36:09 user nova-compute[74776]:     </rng>
Nov 22 14:36:09 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:36:09 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:36:09 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:36:09 user nova-compute[74776]:     </memballoon>
Nov 22 14:36:09 user nova-compute[74776]:   </devices>
Nov 22 14:36:09 user nova-compute[74776]: </domain>
Nov 22 14:36:09 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-460725042',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-460725042',id=37,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d359aba8e95e4090a02fb0a46012f20b',ramdisk_id='',reservation_id='r-k5u3k3yl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-202976361',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:35:56Z,user_data=None,user_id='dea876275c70471d9cba1c3158bd63e2',uuid=a0fdd07c-7e30-449f-95c4-8c2560d760e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd8f1cd4-9030-4326-946d-380263be6dca", "address": "fa:16:3e:6c:d1:a2", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8f1cd4-90", "ovs_interfaceid": "bd8f1cd4-9030-4326-946d-380263be6dca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converting VIF {"id": "bd8f1cd4-9030-4326-946d-380263be6dca", "address": "fa:16:3e:6c:d1:a2", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8f1cd4-90", "ovs_interfaceid": "bd8f1cd4-9030-4326-946d-380263be6dca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:d1:a2,bridge_name='br-int',has_traffic_filtering=True,id=bd8f1cd4-9030-4326-946d-380263be6dca,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8f1cd4-90') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG os_vif [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:d1:a2,bridge_name='br-int',has_traffic_filtering=True,id=bd8f1cd4-9030-4326-946d-380263be6dca,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8f1cd4-90') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9215da38-09ca-5e31-8eb0-25cb5b1fc462', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd8f1cd4-90, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd8f1cd4-90, col_values=(('qos', UUID('321fe42d-2e36-4c68-b734-196165d08dbe')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd8f1cd4-90, col_values=(('external_ids', {'iface-id': 'bd8f1cd4-9030-4326-946d-380263be6dca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:d1:a2', 'vm-uuid': 'a0fdd07c-7e30-449f-95c4-8c2560d760e1'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:36:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:09 user nova-compute[74776]: INFO os_vif [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:d1:a2,bridge_name='br-int',has_traffic_filtering=True,id=bd8f1cd4-9030-4326-946d-380263be6dca,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8f1cd4-90')
Nov 22 14:36:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:36:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] No VIF found with MAC fa:16:3e:6c:d1:a2, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:36:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG nova.objects.instance [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lazy-loading 'flavor' on Instance uuid 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:12 user nova-compute[74776]: INFO nova.compute.manager [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Attaching volume bba3b594-2372-4955-8321-721b6aad454f to /dev/vdb
Nov 22 14:36:12 user nova-compute[74776]: DEBUG os_brick.utils [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba32edc-4756-46f4-9a99-62ac96c582cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d04d887-17a4-44a7-a9d4-6b8ce80e8aff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[668c6ef1-08d4-453c-92d4-7cd8831efd01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0de292b-812b-4e9b-b942-0c6f8cafd6ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:36:12 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:36:12 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb85927-cca5-4b63-8a2f-d6507f8504ad]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG os_brick.utils [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:36:12 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Updating existing volume attachment record: acc41b46-b7b7-457e-ae5a-e87525d89470 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:36:13 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:36:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:36:13 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Instance spawned successfully.
Nov 22 14:36:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:36:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:36:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:36:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:36:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:36:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:36:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:36:13 user nova-compute[74776]: INFO nova.compute.manager [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 22 14:36:13 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:36:13 user nova-compute[74776]: INFO nova.compute.manager [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Took 18.10 seconds to build instance.
Nov 22 14:36:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0b2e2304-16a2-4f7a-9f90-e3c57a3fe4e2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.631s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:13 user nova-compute[74776]: DEBUG nova.compute.manager [req-eeedeea3-89d1-40b3-a8a7-11745aa6bcef req-e17568fe-cd25-46c1-abcf-3ce48b5dee9c service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received event network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:36:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-eeedeea3-89d1-40b3-a8a7-11745aa6bcef req-e17568fe-cd25-46c1-abcf-3ce48b5dee9c service nova] Acquiring lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-eeedeea3-89d1-40b3-a8a7-11745aa6bcef req-e17568fe-cd25-46c1-abcf-3ce48b5dee9c service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-eeedeea3-89d1-40b3-a8a7-11745aa6bcef req-e17568fe-cd25-46c1-abcf-3ce48b5dee9c service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:13 user nova-compute[74776]: DEBUG nova.compute.manager [req-eeedeea3-89d1-40b3-a8a7-11745aa6bcef req-e17568fe-cd25-46c1-abcf-3ce48b5dee9c service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] No waiting events found dispatching network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:36:13 user nova-compute[74776]: WARNING nova.compute.manager [req-eeedeea3-89d1-40b3-a8a7-11745aa6bcef req-e17568fe-cd25-46c1-abcf-3ce48b5dee9c service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received unexpected event network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca for instance with vm_state active and task_state None.
Nov 22 14:36:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "c392a863-0d2f-492f-992d-13b21ebd385e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:15 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:36:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:15 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:36:15 user nova-compute[74776]: INFO nova.compute.claims [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Claim successful on node user
Nov 22 14:36:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:15 user nova-compute[74776]: DEBUG nova.compute.manager [req-443bdbe1-b861-4840-a965-eec1b5d7f314 req-2fb7bdba-112f-4d9a-b329-717d28560d38 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received event network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:36:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-443bdbe1-b861-4840-a965-eec1b5d7f314 req-2fb7bdba-112f-4d9a-b329-717d28560d38 service nova] Acquiring lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-443bdbe1-b861-4840-a965-eec1b5d7f314 req-2fb7bdba-112f-4d9a-b329-717d28560d38 service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-443bdbe1-b861-4840-a965-eec1b5d7f314 req-2fb7bdba-112f-4d9a-b329-717d28560d38 service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:15 user nova-compute[74776]: DEBUG nova.compute.manager [req-443bdbe1-b861-4840-a965-eec1b5d7f314 req-2fb7bdba-112f-4d9a-b329-717d28560d38 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] No waiting events found dispatching network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:36:15 user nova-compute[74776]: WARNING nova.compute.manager [req-443bdbe1-b861-4840-a965-eec1b5d7f314 req-2fb7bdba-112f-4d9a-b329-717d28560d38 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received unexpected event network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca for instance with vm_state active and task_state None.
Nov 22 14:36:16 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:36:16 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:36:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:36:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:36:16 user nova-compute[74776]: DEBUG nova.network.neutron [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:36:16 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:36:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:36:16 user nova-compute[74776]: DEBUG nova.policy [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2494e8b489ea48f1a6b3b19eb87b6306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e8ed62c734be5945d8fbf307aa1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:36:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:36:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:36:16 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Creating image(s)
Nov 22 14:36:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "/opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "/opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "/opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.180s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.206s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:16 user nova-compute[74776]: DEBUG nova.network.neutron [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Successfully created port: 365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:36:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk 1073741824" returned: 0 in 0.063s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.185s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Cannot resize image /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Ensure instance console log exists: /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.network.neutron [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Successfully updated port: 365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "refresh_cache-c392a863-0d2f-492f-992d-13b21ebd385e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquired lock "refresh_cache-c392a863-0d2f-492f-992d-13b21ebd385e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.network.neutron [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-8e465445-e317-4a94-9d05-77157ade39ff req-31079223-8e6f-4309-a002-a1d0651c68ff service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received event network-changed-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-8e465445-e317-4a94-9d05-77157ade39ff req-31079223-8e6f-4309-a002-a1d0651c68ff service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Refreshing instance network info cache due to event network-changed-365c5ef1-7abf-4102-a6aa-be03a4f325f2. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8e465445-e317-4a94-9d05-77157ade39ff req-31079223-8e6f-4309-a002-a1d0651c68ff service nova] Acquiring lock "refresh_cache-c392a863-0d2f-492f-992d-13b21ebd385e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.network.neutron [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.network.neutron [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Updating instance_info_cache with network_info: [{"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Releasing lock "refresh_cache-c392a863-0d2f-492f-992d-13b21ebd385e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Instance network_info: |[{"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8e465445-e317-4a94-9d05-77157ade39ff req-31079223-8e6f-4309-a002-a1d0651c68ff service nova] Acquired lock "refresh_cache-c392a863-0d2f-492f-992d-13b21ebd385e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.network.neutron [req-8e465445-e317-4a94-9d05-77157ade39ff req-31079223-8e6f-4309-a002-a1d0651c68ff service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Refreshing network info cache for port 365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Start _get_guest_xml network_info=[{"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:36:17 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:36:17 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1939367355',display_name='tempest-AttachVolumeTestJSON-server-1939367355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1939367355',id=38,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuY5HJNrsYIY3niBmAsaghDVb+I+PBVWqd4MNCFlVINDMvlQLejGFXaXFFq/GrQzsAXjCAdhFS5NiuyPPLqWUQW2pA/3La+hbQ6NADZBNvomwBj1xOQ0pH4ACvIkEkbcw==',key_name='tempest-keypair-1181685632',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='801e8ed62c734be5945d8fbf307aa1d2',ramdisk_id='',reservation_id='r-d95rnpuu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1546562861',owner_user_name='tempest-AttachVolumeTestJSON-1546562861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:36:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2494e8b489ea48f1a6b3b19eb87b6306',uuid=c392a863-0d2f-492f-992d-13b21ebd385e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converting VIF {"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:95:20,bridge_name='br-int',has_traffic_filtering=True,id=365c5ef1-7abf-4102-a6aa-be03a4f325f2,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365c5ef1-7a') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.objects.instance [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'pci_devices' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:36:17 user nova-compute[74776]:   <uuid>c392a863-0d2f-492f-992d-13b21ebd385e</uuid>
Nov 22 14:36:17 user nova-compute[74776]:   <name>instance-00000026</name>
Nov 22 14:36:17 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:36:17 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:36:17 user nova-compute[74776]:   <metadata>
Nov 22 14:36:17 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:36:17 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:36:17 user nova-compute[74776]:       <nova:name>tempest-AttachVolumeTestJSON-server-1939367355</nova:name>
Nov 22 14:36:17 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:36:17</nova:creationTime>
Nov 22 14:36:17 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:36:17 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:36:17 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:36:17 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:36:17 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:36:17 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:36:17 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:36:17 user nova-compute[74776]:       <nova:owner>
Nov 22 14:36:17 user nova-compute[74776]:         <nova:user uuid="2494e8b489ea48f1a6b3b19eb87b6306">tempest-AttachVolumeTestJSON-1546562861-project-member</nova:user>
Nov 22 14:36:17 user nova-compute[74776]:         <nova:project uuid="801e8ed62c734be5945d8fbf307aa1d2">tempest-AttachVolumeTestJSON-1546562861</nova:project>
Nov 22 14:36:17 user nova-compute[74776]:       </nova:owner>
Nov 22 14:36:17 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:36:17 user nova-compute[74776]:       <nova:ports>
Nov 22 14:36:17 user nova-compute[74776]:         <nova:port uuid="365c5ef1-7abf-4102-a6aa-be03a4f325f2">
Nov 22 14:36:17 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 22 14:36:17 user nova-compute[74776]:         </nova:port>
Nov 22 14:36:17 user nova-compute[74776]:       </nova:ports>
Nov 22 14:36:17 user nova-compute[74776]:     </nova:instance>
Nov 22 14:36:17 user nova-compute[74776]:   </metadata>
Nov 22 14:36:17 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:36:17 user nova-compute[74776]:     <system>
Nov 22 14:36:17 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:36:17 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:36:17 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:36:17 user nova-compute[74776]:       <entry name="serial">c392a863-0d2f-492f-992d-13b21ebd385e</entry>
Nov 22 14:36:17 user nova-compute[74776]:       <entry name="uuid">c392a863-0d2f-492f-992d-13b21ebd385e</entry>
Nov 22 14:36:17 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:36:17 user nova-compute[74776]:     </system>
Nov 22 14:36:17 user nova-compute[74776]:   </sysinfo>
Nov 22 14:36:17 user nova-compute[74776]:   <os>
Nov 22 14:36:17 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:36:17 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:36:17 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:36:17 user nova-compute[74776]:   </os>
Nov 22 14:36:17 user nova-compute[74776]:   <features>
Nov 22 14:36:17 user nova-compute[74776]:     <acpi/>
Nov 22 14:36:17 user nova-compute[74776]:     <apic/>
Nov 22 14:36:17 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:36:17 user nova-compute[74776]:   </features>
Nov 22 14:36:17 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:36:17 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:36:17 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:36:17 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:36:17 user nova-compute[74776]:   </clock>
Nov 22 14:36:17 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:36:17 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:36:17 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:36:17 user nova-compute[74776]:   </cpu>
Nov 22 14:36:17 user nova-compute[74776]:   <devices>
Nov 22 14:36:17 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:36:17 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:36:17 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk"/>
Nov 22 14:36:17 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:36:17 user nova-compute[74776]:     </disk>
Nov 22 14:36:17 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:36:17 user nova-compute[74776]:       <mac address="fa:16:3e:61:95:20"/>
Nov 22 14:36:17 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:36:17 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:36:17 user nova-compute[74776]:       <target dev="tap365c5ef1-7a"/>
Nov 22 14:36:17 user nova-compute[74776]:     </interface>
Nov 22 14:36:17 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:36:17 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/console.log" append="off"/>
Nov 22 14:36:17 user nova-compute[74776]:     </serial>
Nov 22 14:36:17 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:36:17 user nova-compute[74776]:     <video>
Nov 22 14:36:17 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:36:17 user nova-compute[74776]:     </video>
Nov 22 14:36:17 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:36:17 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:36:17 user nova-compute[74776]:     </rng>
Nov 22 14:36:17 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:36:17 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:36:17 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:36:17 user nova-compute[74776]:     </memballoon>
Nov 22 14:36:17 user nova-compute[74776]:   </devices>
Nov 22 14:36:17 user nova-compute[74776]: </domain>
Nov 22 14:36:17 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1939367355',display_name='tempest-AttachVolumeTestJSON-server-1939367355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1939367355',id=38,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuY5HJNrsYIY3niBmAsaghDVb+I+PBVWqd4MNCFlVINDMvlQLejGFXaXFFq/GrQzsAXjCAdhFS5NiuyPPLqWUQW2pA/3La+hbQ6NADZBNvomwBj1xOQ0pH4ACvIkEkbcw==',key_name='tempest-keypair-1181685632',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='801e8ed62c734be5945d8fbf307aa1d2',ramdisk_id='',reservation_id='r-d95rnpuu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1546562861',owner_user_name='tempest-AttachVolumeTestJSON-1546562861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:36:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2494e8b489ea48f1a6b3b19eb87b6306',uuid=c392a863-0d2f-492f-992d-13b21ebd385e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converting VIF {"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:95:20,bridge_name='br-int',has_traffic_filtering=True,id=365c5ef1-7abf-4102-a6aa-be03a4f325f2,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365c5ef1-7a') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG os_vif [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:95:20,bridge_name='br-int',has_traffic_filtering=True,id=365c5ef1-7abf-4102-a6aa-be03a4f325f2,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365c5ef1-7a') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0697e9ec-a934-56c0-83ca-babb9e51e3a7', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap365c5ef1-7a, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap365c5ef1-7a, col_values=(('qos', UUID('bd2f8a5d-5db3-46ee-93dd-5b404561079e')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap365c5ef1-7a, col_values=(('external_ids', {'iface-id': '365c5ef1-7abf-4102-a6aa-be03a4f325f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:95:20', 'vm-uuid': 'c392a863-0d2f-492f-992d-13b21ebd385e'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:36:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:17 user nova-compute[74776]: INFO os_vif [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:95:20,bridge_name='br-int',has_traffic_filtering=True,id=365c5ef1-7abf-4102-a6aa-be03a4f325f2,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365c5ef1-7a')
Nov 22 14:36:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:36:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] No VIF found with MAC fa:16:3e:61:95:20, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:36:18 user nova-compute[74776]: DEBUG nova.network.neutron [req-8e465445-e317-4a94-9d05-77157ade39ff req-31079223-8e6f-4309-a002-a1d0651c68ff service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Updated VIF entry in instance network info cache for port 365c5ef1-7abf-4102-a6aa-be03a4f325f2. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:36:18 user nova-compute[74776]: DEBUG nova.network.neutron [req-8e465445-e317-4a94-9d05-77157ade39ff req-31079223-8e6f-4309-a002-a1d0651c68ff service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Updating instance_info_cache with network_info: [{"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:36:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8e465445-e317-4a94-9d05-77157ade39ff req-31079223-8e6f-4309-a002-a1d0651c68ff service nova] Releasing lock "refresh_cache-c392a863-0d2f-492f-992d-13b21ebd385e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:36:18 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIwajlOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:36:19 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:36:19 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:36:19 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e36fad3-974f-4e0e-bc74-1727a4daf2f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:36:19 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8b05fd-9967-48ee-ab00-61b314547843]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f] added
Nov 22 14:36:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8824b86-79c1-4b47-a884-3344552ededa]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04e45da-8859-44e3-a9aa-3b913a830fd1]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qIwajlOm {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qIwajlOm" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[500e04e1-f02c-43a5-8eb2-7310e0b8ac31]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qIwajlOm'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7378c4b2-0b28-4d1f-91a1-d0a3626aa460]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[988cc76a-1cbc-4bdd-8061-1f6da538c707]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:36:19 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:36:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:36:19 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:36:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb6aaae-a097-4830-8b10-9ec5767a6e76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f, portal: 172.16.0.220,3260]
Nov 22 14:36:19 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f, portal: 172.16.0.220,3260] successful.
Nov 22 14:36:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c00b33-e03c-483f-81ec-78b5dc4b0e58]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[96aa311f-812e-4640-9931-0585d3d7b005]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:36:19 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:36:19 user nova-compute[74776]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f (non-flash)
Nov 22 14:36:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:36:19 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:36:19 user nova-compute[74776]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f (non-flash)
Nov 22 14:36:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-146d0943-a034-48f8-953c-74705ac80e77 req-0464ba7a-f274-4235-ae8c-00d4ad1a8233 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-146d0943-a034-48f8-953c-74705ac80e77 req-0464ba7a-f274-4235-ae8c-00d4ad1a8233 service nova] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-146d0943-a034-48f8-953c-74705ac80e77 req-0464ba7a-f274-4235-ae8c-00d4ad1a8233 service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-146d0943-a034-48f8-953c-74705ac80e77 req-0464ba7a-f274-4235-ae8c-00d4ad1a8233 service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-146d0943-a034-48f8-953c-74705ac80e77 req-0464ba7a-f274-4235-ae8c-00d4ad1a8233 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] No waiting events found dispatching network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:36:19 user nova-compute[74776]: WARNING nova.compute.manager [req-146d0943-a034-48f8-953c-74705ac80e77 req-0464ba7a-f274-4235-ae8c-00d4ad1a8233 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received unexpected event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 for instance with vm_state building and task_state spawning.
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[41559c69-8784-4003-a94c-775e08baffb0]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIwajlOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:20 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:36:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:36:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23130613931323132', 'path': '/dev/sdd'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:36:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130613931323132', 'path': '/dev/sdd'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:36:20 user nova-compute[74776]: DEBUG nova.objects.instance [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lazy-loading 'flavor' on Instance uuid 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:36:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:36:20 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:36:20 user nova-compute[74776]:   <source dev="/dev/sdd"/>
Nov 22 14:36:20 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:36:20 user nova-compute[74776]:   <serial>bba3b594-2372-4955-8321-721b6aad454f</serial>
Nov 22 14:36:20 user nova-compute[74776]: </disk>
Nov 22 14:36:20 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:36:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:36:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:36:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] No VIF found with MAC fa:16:3e:68:f0:28, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:36:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-aa293364-0ac8-4349-b240-2982dc401e05 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.766s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:21 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:36:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:36:21 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Instance spawned successfully.
Nov 22 14:36:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:36:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:36:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:36:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:36:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:36:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:36:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:36:21 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:36:21 user nova-compute[74776]: INFO nova.compute.manager [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 22 14:36:21 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:36:21 user nova-compute[74776]: INFO nova.compute.manager [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Took 6.15 seconds to build instance.
Nov 22 14:36:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c2a0939c-5771-4853-8224-42678f4e073d tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "c392a863-0d2f-492f-992d-13b21ebd385e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.247s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-7e5283ee-c918-4f43-96ed-f933baccd7ec req-3202d739-f569-4029-964d-c43957a98ad6 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:36:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7e5283ee-c918-4f43-96ed-f933baccd7ec req-3202d739-f569-4029-964d-c43957a98ad6 service nova] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7e5283ee-c918-4f43-96ed-f933baccd7ec req-3202d739-f569-4029-964d-c43957a98ad6 service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7e5283ee-c918-4f43-96ed-f933baccd7ec req-3202d739-f569-4029-964d-c43957a98ad6 service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-7e5283ee-c918-4f43-96ed-f933baccd7ec req-3202d739-f569-4029-964d-c43957a98ad6 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] No waiting events found dispatching network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:36:21 user nova-compute[74776]: WARNING nova.compute.manager [req-7e5283ee-c918-4f43-96ed-f933baccd7ec req-3202d739-f569-4029-964d-c43957a98ad6 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received unexpected event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 for instance with vm_state active and task_state None.
Nov 22 14:36:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:23 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:36:23 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:36:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-6f2ce4b2-660c-431f-b951-c6ec5090ef7e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:36:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-6f2ce4b2-660c-431f-b951-c6ec5090ef7e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:36:23 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:36:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-d3b57c8a-3fa2-41ec-890a-d70e063603f1 req-457d150b-5c0a-4a46-b701-c42036e64557 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received event network-changed-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:36:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-d3b57c8a-3fa2-41ec-890a-d70e063603f1 req-457d150b-5c0a-4a46-b701-c42036e64557 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Refreshing instance network info cache due to event network-changed-e73b0b93-8497-4bf9-8149-c5c640ff6253. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:36:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d3b57c8a-3fa2-41ec-890a-d70e063603f1 req-457d150b-5c0a-4a46-b701-c42036e64557 service nova] Acquiring lock "refresh_cache-25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:36:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d3b57c8a-3fa2-41ec-890a-d70e063603f1 req-457d150b-5c0a-4a46-b701-c42036e64557 service nova] Acquired lock "refresh_cache-25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:36:24 user nova-compute[74776]: DEBUG nova.network.neutron [req-d3b57c8a-3fa2-41ec-890a-d70e063603f1 req-457d150b-5c0a-4a46-b701-c42036e64557 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Refreshing network info cache for port e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:36:24 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Updating instance_info_cache with network_info: [{"id": "c83b6599-820f-462a-bd26-af48014d7d7d", "address": "fa:16:3e:18:32:09", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b6599-82", "ovs_interfaceid": "c83b6599-820f-462a-bd26-af48014d7d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:36:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-6f2ce4b2-660c-431f-b951-c6ec5090ef7e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:36:24 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:36:24 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:36:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:24 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:36:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:25 user nova-compute[74776]: DEBUG nova.network.neutron [req-d3b57c8a-3fa2-41ec-890a-d70e063603f1 req-457d150b-5c0a-4a46-b701-c42036e64557 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Updated VIF entry in instance network info cache for port e73b0b93-8497-4bf9-8149-c5c640ff6253. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:36:25 user nova-compute[74776]: DEBUG nova.network.neutron [req-d3b57c8a-3fa2-41ec-890a-d70e063603f1 req-457d150b-5c0a-4a46-b701-c42036e64557 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Updating instance_info_cache with network_info: [{"id": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "address": "fa:16:3e:68:f0:28", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73b0b93-84", "ovs_interfaceid": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:36:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d3b57c8a-3fa2-41ec-890a-d70e063603f1 req-457d150b-5c0a-4a46-b701-c42036e64557 service nova] Releasing lock "refresh_cache-25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:36:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:25 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:26 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:36:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:27 user nova-compute[74776]: DEBUG nova.compute.manager [req-08f948ea-9385-4a54-9832-995e82292137 req-76c1c3b0-6e3e-4722-8be9-2b95df6b34e7 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received event network-changed-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:36:27 user nova-compute[74776]: DEBUG nova.compute.manager [req-08f948ea-9385-4a54-9832-995e82292137 req-76c1c3b0-6e3e-4722-8be9-2b95df6b34e7 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Refreshing instance network info cache due to event network-changed-e73b0b93-8497-4bf9-8149-c5c640ff6253. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:36:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-08f948ea-9385-4a54-9832-995e82292137 req-76c1c3b0-6e3e-4722-8be9-2b95df6b34e7 service nova] Acquiring lock "refresh_cache-25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:36:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-08f948ea-9385-4a54-9832-995e82292137 req-76c1c3b0-6e3e-4722-8be9-2b95df6b34e7 service nova] Acquired lock "refresh_cache-25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:36:27 user nova-compute[74776]: DEBUG nova.network.neutron [req-08f948ea-9385-4a54-9832-995e82292137 req-76c1c3b0-6e3e-4722-8be9-2b95df6b34e7 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Refreshing network info cache for port e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:36:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:36:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:27 user nova-compute[74776]: DEBUG nova.network.neutron [req-08f948ea-9385-4a54-9832-995e82292137 req-76c1c3b0-6e3e-4722-8be9-2b95df6b34e7 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Updated VIF entry in instance network info cache for port e73b0b93-8497-4bf9-8149-c5c640ff6253. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:36:27 user nova-compute[74776]: DEBUG nova.network.neutron [req-08f948ea-9385-4a54-9832-995e82292137 req-76c1c3b0-6e3e-4722-8be9-2b95df6b34e7 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Updating instance_info_cache with network_info: [{"id": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "address": "fa:16:3e:68:f0:28", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73b0b93-84", "ovs_interfaceid": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:36:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-08f948ea-9385-4a54-9832-995e82292137 req-76c1c3b0-6e3e-4722-8be9-2b95df6b34e7 service nova] Releasing lock "refresh_cache-25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:36:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9037b821-aaa0-4e70-b1a1-cdd3b4f52909 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9037b821-aaa0-4e70-b1a1-cdd3b4f52909 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:27 user nova-compute[74776]: INFO nova.compute.manager [None req-9037b821-aaa0-4e70-b1a1-cdd3b4f52909 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Rebooting instance
Nov 22 14:36:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9037b821-aaa0-4e70-b1a1-cdd3b4f52909 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "refresh_cache-25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9037b821-aaa0-4e70-b1a1-cdd3b4f52909 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquired lock "refresh_cache-25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG nova.network.neutron [None req-9037b821-aaa0-4e70-b1a1-cdd3b4f52909 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:28 user nova-compute[74776]: INFO nova.compute.manager [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Terminating instance
Nov 22 14:36:28 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG nova.network.neutron [None req-9037b821-aaa0-4e70-b1a1-cdd3b4f52909 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Updating instance_info_cache with network_info: [{"id": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "address": "fa:16:3e:68:f0:28", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73b0b93-84", "ovs_interfaceid": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9037b821-aaa0-4e70-b1a1-cdd3b4f52909 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Releasing lock "refresh_cache-25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG nova.compute.manager [None req-9037b821-aaa0-4e70-b1a1-cdd3b4f52909 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG nova.compute.manager [req-9dc89d21-0818-491e-9ba4-0118c7740a92 req-633d6b90-77a8-48bf-8e94-4f23b80b1529 service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Received event network-vif-unplugged-c83b6599-820f-462a-bd26-af48014d7d7d {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9dc89d21-0818-491e-9ba4-0118c7740a92 req-633d6b90-77a8-48bf-8e94-4f23b80b1529 service nova] Acquiring lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9dc89d21-0818-491e-9ba4-0118c7740a92 req-633d6b90-77a8-48bf-8e94-4f23b80b1529 service nova] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9dc89d21-0818-491e-9ba4-0118c7740a92 req-633d6b90-77a8-48bf-8e94-4f23b80b1529 service nova] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG nova.compute.manager [req-9dc89d21-0818-491e-9ba4-0118c7740a92 req-633d6b90-77a8-48bf-8e94-4f23b80b1529 service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] No waiting events found dispatching network-vif-unplugged-c83b6599-820f-462a-bd26-af48014d7d7d {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG nova.compute.manager [req-9dc89d21-0818-491e-9ba4-0118c7740a92 req-633d6b90-77a8-48bf-8e94-4f23b80b1529 service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Received event network-vif-unplugged-c83b6599-820f-462a-bd26-af48014d7d7d for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:36:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:36:29 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:36:29 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:36:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=7878MB free_disk=24.868587493896484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:29 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Instance destroyed successfully.
Nov 22 14:36:29 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'resources' on Instance uuid 6f2ce4b2-660c-431f-b951-c6ec5090ef7e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:20:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-143378724',display_name='tempest-ServerRescueNegativeTestJSON-server-143378724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-143378724',id=15,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:22:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36f36a88fd7b403d9c2dd29bcd64aac6',ramdisk_id='',reservation_id='r-mtmgdtqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1360515217',owner_user_name='tempest-ServerRescueNegativeTestJSON-1360515217-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:22:28Z,user_data=None,user_id='d686d08dc36a49fa80192546c4f68940',uuid=6f2ce4b2-660c-431f-b951-c6ec5090ef7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "c83b6599-820f-462a-bd26-af48014d7d7d", "address": "fa:16:3e:18:32:09", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b6599-82", "ovs_interfaceid": "c83b6599-820f-462a-bd26-af48014d7d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converting VIF {"id": "c83b6599-820f-462a-bd26-af48014d7d7d", "address": "fa:16:3e:18:32:09", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b6599-82", "ovs_interfaceid": "c83b6599-820f-462a-bd26-af48014d7d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:32:09,bridge_name='br-int',has_traffic_filtering=True,id=c83b6599-820f-462a-bd26-af48014d7d7d,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b6599-82') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG os_vif [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:32:09,bridge_name='br-int',has_traffic_filtering=True,id=c83b6599-820f-462a-bd26-af48014d7d7d,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b6599-82') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc83b6599-82, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ef937a9-82f4-4ee6-b8af-018d257a3458) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:36:29 user nova-compute[74776]: INFO os_vif [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:32:09,bridge_name='br-int',has_traffic_filtering=True,id=c83b6599-820f-462a-bd26-af48014d7d7d,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b6599-82')
Nov 22 14:36:29 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Deleting instance files /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e_del
Nov 22 14:36:29 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Deletion of /opt/stack/data/nova/instances/6f2ce4b2-660c-431f-b951-c6ec5090ef7e_del complete
Nov 22 14:36:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 525baf66-82cc-4e8d-a37a-c92c51d4673d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6f2ce4b2-660c-431f-b951-c6ec5090ef7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f4f30fe7-b234-4f81-b081-3214f5ebe789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance bc98341b-ca28-4097-9887-16c8e8d7f9f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 7819c3bf-bf3e-4012-8fcc-19226486de8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 2b57c3c6-2b63-4caf-af83-c5d026a5e157 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance ac14ec9b-986a-4fe3-97e3-afbaaca431af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance a0fdd07c-7e30-449f-95c4-8c2560d760e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance c392a863-0d2f-492f-992d-13b21ebd385e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:36:29 user nova-compute[74776]: INFO nova.compute.manager [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 22 14:36:29 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:36:29 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:36:30 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:36:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.585s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:30 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:36:30 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Took 0.60 seconds to deallocate network for instance.
Nov 22 14:36:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:30 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:36:30 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:36:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:30 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Deleted allocations for instance 6f2ce4b2-660c-431f-b951-c6ec5090ef7e
Nov 22 14:36:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7c9b38ad-e69f-45d2-84f7-4f9b9f80954d tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.428s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:30 user nova-compute[74776]: DEBUG nova.compute.manager [req-4ccfec9f-2a35-407d-a99c-954052076f09 req-c5f2e454-8e18-4992-9896-181658ebeac4 service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Received event network-vif-plugged-c83b6599-820f-462a-bd26-af48014d7d7d {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:36:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4ccfec9f-2a35-407d-a99c-954052076f09 req-c5f2e454-8e18-4992-9896-181658ebeac4 service nova] Acquiring lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4ccfec9f-2a35-407d-a99c-954052076f09 req-c5f2e454-8e18-4992-9896-181658ebeac4 service nova] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4ccfec9f-2a35-407d-a99c-954052076f09 req-c5f2e454-8e18-4992-9896-181658ebeac4 service nova] Lock "6f2ce4b2-660c-431f-b951-c6ec5090ef7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:30 user nova-compute[74776]: DEBUG nova.compute.manager [req-4ccfec9f-2a35-407d-a99c-954052076f09 req-c5f2e454-8e18-4992-9896-181658ebeac4 service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] No waiting events found dispatching network-vif-plugged-c83b6599-820f-462a-bd26-af48014d7d7d {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:36:30 user nova-compute[74776]: WARNING nova.compute.manager [req-4ccfec9f-2a35-407d-a99c-954052076f09 req-c5f2e454-8e18-4992-9896-181658ebeac4 service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Received unexpected event network-vif-plugged-c83b6599-820f-462a-bd26-af48014d7d7d for instance with vm_state deleted and task_state None.
Nov 22 14:36:30 user nova-compute[74776]: DEBUG nova.compute.manager [req-4ccfec9f-2a35-407d-a99c-954052076f09 req-c5f2e454-8e18-4992-9896-181658ebeac4 service nova] [instance: 6f2ce4b2-660c-431f-b951-c6ec5090ef7e] Received event network-vif-deleted-c83b6599-820f-462a-bd26-af48014d7d7d {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:36:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:31 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:36:31 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:36:31 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:36:31 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:36:31 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:36:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-745f4938-e9f6-4d39-8867-5abf418f5830 req-fc455e03-4dfe-43d0-96c2-febcea6e73c4 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received event network-vif-unplugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:36:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-745f4938-e9f6-4d39-8867-5abf418f5830 req-fc455e03-4dfe-43d0-96c2-febcea6e73c4 service nova] Acquiring lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-745f4938-e9f6-4d39-8867-5abf418f5830 req-fc455e03-4dfe-43d0-96c2-febcea6e73c4 service nova] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-745f4938-e9f6-4d39-8867-5abf418f5830 req-fc455e03-4dfe-43d0-96c2-febcea6e73c4 service nova] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-745f4938-e9f6-4d39-8867-5abf418f5830 req-fc455e03-4dfe-43d0-96c2-febcea6e73c4 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] No waiting events found dispatching network-vif-unplugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:36:31 user nova-compute[74776]: WARNING nova.compute.manager [req-745f4938-e9f6-4d39-8867-5abf418f5830 req-fc455e03-4dfe-43d0-96c2-febcea6e73c4 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received unexpected event network-vif-unplugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 for instance with vm_state active and task_state reboot_started.
Nov 22 14:36:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:32 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-9037b821-aaa0-4e70-b1a1-cdd3b4f52909 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Instance shutdown successfully.
Nov 22 14:36:33 user nova-compute[74776]: DEBUG nova.compute.manager [req-b1fe7fa2-a61d-4805-9986-295b4d9ec09a req-0d0f810c-2523-4ad9-bd77-1415abfcf613 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received event network-vif-plugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:36:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b1fe7fa2-a61d-4805-9986-295b4d9ec09a req-0d0f810c-2523-4ad9-bd77-1415abfcf613 service nova] Acquiring lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b1fe7fa2-a61d-4805-9986-295b4d9ec09a req-0d0f810c-2523-4ad9-bd77-1415abfcf613 service nova] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b1fe7fa2-a61d-4805-9986-295b4d9ec09a req-0d0f810c-2523-4ad9-bd77-1415abfcf613 service nova] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:33 user nova-compute[74776]: DEBUG nova.compute.manager [req-b1fe7fa2-a61d-4805-9986-295b4d9ec09a req-0d0f810c-2523-4ad9-bd77-1415abfcf613 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] No waiting events found dispatching network-vif-plugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:36:33 user nova-compute[74776]: WARNING nova.compute.manager [req-b1fe7fa2-a61d-4805-9986-295b4d9ec09a req-0d0f810c-2523-4ad9-bd77-1415abfcf613 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received unexpected event network-vif-plugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 for instance with vm_state active and task_state reboot_started.
Nov 22 14:36:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:35 user nova-compute[74776]: DEBUG nova.compute.manager [req-b276cdb5-a298-4cd6-828b-1645d092dbc9 req-39aa9b10-ec9b-4e40-8969-4843504d2453 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received event network-vif-plugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:36:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b276cdb5-a298-4cd6-828b-1645d092dbc9 req-39aa9b10-ec9b-4e40-8969-4843504d2453 service nova] Acquiring lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b276cdb5-a298-4cd6-828b-1645d092dbc9 req-39aa9b10-ec9b-4e40-8969-4843504d2453 service nova] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b276cdb5-a298-4cd6-828b-1645d092dbc9 req-39aa9b10-ec9b-4e40-8969-4843504d2453 service nova] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:35 user nova-compute[74776]: DEBUG nova.compute.manager [req-b276cdb5-a298-4cd6-828b-1645d092dbc9 req-39aa9b10-ec9b-4e40-8969-4843504d2453 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] No waiting events found dispatching network-vif-plugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:36:35 user nova-compute[74776]: WARNING nova.compute.manager [req-b276cdb5-a298-4cd6-828b-1645d092dbc9 req-39aa9b10-ec9b-4e40-8969-4843504d2453 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received unexpected event network-vif-plugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 for instance with vm_state active and task_state reboot_started.
Nov 22 14:36:35 user nova-compute[74776]: DEBUG nova.compute.manager [req-b276cdb5-a298-4cd6-828b-1645d092dbc9 req-39aa9b10-ec9b-4e40-8969-4843504d2453 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received event network-vif-plugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:36:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b276cdb5-a298-4cd6-828b-1645d092dbc9 req-39aa9b10-ec9b-4e40-8969-4843504d2453 service nova] Acquiring lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:36:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b276cdb5-a298-4cd6-828b-1645d092dbc9 req-39aa9b10-ec9b-4e40-8969-4843504d2453 service nova] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:36:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b276cdb5-a298-4cd6-828b-1645d092dbc9 req-39aa9b10-ec9b-4e40-8969-4843504d2453 service nova] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:35 user nova-compute[74776]: DEBUG nova.compute.manager [req-b276cdb5-a298-4cd6-828b-1645d092dbc9 req-39aa9b10-ec9b-4e40-8969-4843504d2453 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] No waiting events found dispatching network-vif-plugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:36:35 user nova-compute[74776]: WARNING nova.compute.manager [req-b276cdb5-a298-4cd6-828b-1645d092dbc9 req-39aa9b10-ec9b-4e40-8969-4843504d2453 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received unexpected event network-vif-plugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 for instance with vm_state active and task_state reboot_started.
Nov 22 14:36:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:36 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Instance running successfully.
Nov 22 14:36:36 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-9037b821-aaa0-4e70-b1a1-cdd3b4f52909 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Instance soft rebooted successfully.
Nov 22 14:36:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-9037b821-aaa0-4e70-b1a1-cdd3b4f52909 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:36:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-9037b821-aaa0-4e70-b1a1-cdd3b4f52909 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.700s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:36:38 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:36:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:36:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:18 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:37:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "525baf66-82cc-4e8d-a37a-c92c51d4673d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:18 user nova-compute[74776]: INFO nova.compute.manager [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Terminating instance
Nov 22 14:37:18 user nova-compute[74776]: DEBUG nova.compute.manager [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:37:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-914b98df-f016-4592-bd08-4313f02a9d44 req-984f0e7a-70f8-4bf7-80b5-7ddf8eb6b1f3 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received event network-vif-unplugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-914b98df-f016-4592-bd08-4313f02a9d44 req-984f0e7a-70f8-4bf7-80b5-7ddf8eb6b1f3 service nova] Acquiring lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-914b98df-f016-4592-bd08-4313f02a9d44 req-984f0e7a-70f8-4bf7-80b5-7ddf8eb6b1f3 service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-914b98df-f016-4592-bd08-4313f02a9d44 req-984f0e7a-70f8-4bf7-80b5-7ddf8eb6b1f3 service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-914b98df-f016-4592-bd08-4313f02a9d44 req-984f0e7a-70f8-4bf7-80b5-7ddf8eb6b1f3 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] No waiting events found dispatching network-vif-unplugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-914b98df-f016-4592-bd08-4313f02a9d44 req-984f0e7a-70f8-4bf7-80b5-7ddf8eb6b1f3 service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received event network-vif-unplugged-ac898a82-d482-4299-b86b-db6aacf8175a for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:19 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Instance destroyed successfully.
Nov 22 14:37:19 user nova-compute[74776]: DEBUG nova.objects.instance [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lazy-loading 'resources' on Instance uuid 525baf66-82cc-4e8d-a37a-c92c51d4673d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:20:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-248863747',display_name='tempest-ServerRescueNegativeTestJSON-server-248863747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-248863747',id=14,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36f36a88fd7b403d9c2dd29bcd64aac6',ramdisk_id='',reservation_id='r-qlinlrt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1360515217',owner_user_name='tempest-ServerRescueNegativeTestJSON-1360515217-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:27:03Z,user_data=None,user_id='d686d08dc36a49fa80192546c4f68940',uuid=525baf66-82cc-4e8d-a37a-c92c51d4673d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac898a82-d482-4299-b86b-db6aacf8175a", "address": "fa:16:3e:38:af:39", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac898a82-d4", "ovs_interfaceid": "ac898a82-d482-4299-b86b-db6aacf8175a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converting VIF {"id": "ac898a82-d482-4299-b86b-db6aacf8175a", "address": "fa:16:3e:38:af:39", "network": {"id": "88557f6b-e2af-4756-b12f-9f2bf6d34873", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-511194333-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f36a88fd7b403d9c2dd29bcd64aac6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac898a82-d4", "ovs_interfaceid": "ac898a82-d482-4299-b86b-db6aacf8175a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:af:39,bridge_name='br-int',has_traffic_filtering=True,id=ac898a82-d482-4299-b86b-db6aacf8175a,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac898a82-d4') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG os_vif [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:af:39,bridge_name='br-int',has_traffic_filtering=True,id=ac898a82-d482-4299-b86b-db6aacf8175a,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac898a82-d4') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac898a82-d4, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=512580c2-c5af-4c84-86fc-8936b372415e) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:19 user nova-compute[74776]: INFO os_vif [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:af:39,bridge_name='br-int',has_traffic_filtering=True,id=ac898a82-d482-4299-b86b-db6aacf8175a,network=Network(88557f6b-e2af-4756-b12f-9f2bf6d34873),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac898a82-d4')
Nov 22 14:37:19 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Deleting instance files /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d_del
Nov 22 14:37:19 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Deletion of /opt/stack/data/nova/instances/525baf66-82cc-4e8d-a37a-c92c51d4673d_del complete
Nov 22 14:37:19 user nova-compute[74776]: INFO nova.compute.manager [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 22 14:37:19 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:37:19 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:37:20 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:37:20 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Took 0.44 seconds to deallocate network for instance.
Nov 22 14:37:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-491da84f-edd1-430c-9ab9-da95ca3b6abe req-ad90479e-cd39-4db0-8aa0-618b8a98cd9d service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received event network-vif-deleted-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:37:20 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:37:20 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:37:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:20 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Deleted allocations for instance 525baf66-82cc-4e8d-a37a-c92c51d4673d
Nov 22 14:37:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-db6010bf-8a3c-433e-82a1-ca42d686d8b9 tempest-ServerRescueNegativeTestJSON-1360515217 tempest-ServerRescueNegativeTestJSON-1360515217-project-member] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.796s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-b056decd-8eef-4198-8a7c-2c81455afb6f req-c11fe233-6488-4635-bffc-750f492f180e service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received event network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:37:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b056decd-8eef-4198-8a7c-2c81455afb6f req-c11fe233-6488-4635-bffc-750f492f180e service nova] Acquiring lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b056decd-8eef-4198-8a7c-2c81455afb6f req-c11fe233-6488-4635-bffc-750f492f180e service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b056decd-8eef-4198-8a7c-2c81455afb6f req-c11fe233-6488-4635-bffc-750f492f180e service nova] Lock "525baf66-82cc-4e8d-a37a-c92c51d4673d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-b056decd-8eef-4198-8a7c-2c81455afb6f req-c11fe233-6488-4635-bffc-750f492f180e service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] No waiting events found dispatching network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:37:21 user nova-compute[74776]: WARNING nova.compute.manager [req-b056decd-8eef-4198-8a7c-2c81455afb6f req-c11fe233-6488-4635-bffc-750f492f180e service nova] [instance: 525baf66-82cc-4e8d-a37a-c92c51d4673d] Received unexpected event network-vif-plugged-ac898a82-d482-4299-b86b-db6aacf8175a for instance with vm_state deleted and task_state None.
Nov 22 14:37:21 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:37:21 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:37:23 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:37:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:24 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:37:24 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:37:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-f4f30fe7-b234-4f81-b081-3214f5ebe789" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:37:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-f4f30fe7-b234-4f81-b081-3214f5ebe789" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:37:24 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:37:25 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Updating instance_info_cache with network_info: [{"id": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "address": "fa:16:3e:46:10:91", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669801ba-1e", "ovs_interfaceid": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:37:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-f4f30fe7-b234-4f81-b081-3214f5ebe789" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:37:25 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:37:26 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:37:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:26 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:37:26 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:37:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:37:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:37:29 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:37:29 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:37:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=7946MB free_disk=24.88690948486328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:37:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:37:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f4f30fe7-b234-4f81-b081-3214f5ebe789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:37:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance bc98341b-ca28-4097-9887-16c8e8d7f9f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:37:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 7819c3bf-bf3e-4012-8fcc-19226486de8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:37:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:37:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 2b57c3c6-2b63-4caf-af83-c5d026a5e157 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:37:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance ac14ec9b-986a-4fe3-97e3-afbaaca431af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:37:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance a0fdd07c-7e30-449f-95c4-8c2560d760e1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:37:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance c392a863-0d2f-492f-992d-13b21ebd385e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:37:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:37:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:37:29 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing inventories for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 14:37:29 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating ProviderTree inventory for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 14:37:29 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating inventory in ProviderTree for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 14:37:29 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing aggregate associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, aggregates: None {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 14:37:29 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing trait associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 14:37:30 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:37:30 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:37:30 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:37:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.642s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:30 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:37:30 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74776) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 14:37:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Acquiring lock "2b57c3c6-2b63-4caf-af83-c5d026a5e157" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Lock "2b57c3c6-2b63-4caf-af83-c5d026a5e157" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Acquiring lock "2b57c3c6-2b63-4caf-af83-c5d026a5e157-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Lock "2b57c3c6-2b63-4caf-af83-c5d026a5e157-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Lock "2b57c3c6-2b63-4caf-af83-c5d026a5e157-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:30 user nova-compute[74776]: INFO nova.compute.manager [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Terminating instance
Nov 22 14:37:30 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-a33e7550-c401-48a6-9b3a-afa9226f1d3e req-04fc5a56-ff7e-4fe7-a6b3-5b7be500103e service nova] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Received event network-vif-unplugged-aa68b905-ddee-44c5-936a-310de3d906c9 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-a33e7550-c401-48a6-9b3a-afa9226f1d3e req-04fc5a56-ff7e-4fe7-a6b3-5b7be500103e service nova] Acquiring lock "2b57c3c6-2b63-4caf-af83-c5d026a5e157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-a33e7550-c401-48a6-9b3a-afa9226f1d3e req-04fc5a56-ff7e-4fe7-a6b3-5b7be500103e service nova] Lock "2b57c3c6-2b63-4caf-af83-c5d026a5e157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-a33e7550-c401-48a6-9b3a-afa9226f1d3e req-04fc5a56-ff7e-4fe7-a6b3-5b7be500103e service nova] Lock "2b57c3c6-2b63-4caf-af83-c5d026a5e157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-a33e7550-c401-48a6-9b3a-afa9226f1d3e req-04fc5a56-ff7e-4fe7-a6b3-5b7be500103e service nova] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] No waiting events found dispatching network-vif-unplugged-aa68b905-ddee-44c5-936a-310de3d906c9 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-a33e7550-c401-48a6-9b3a-afa9226f1d3e req-04fc5a56-ff7e-4fe7-a6b3-5b7be500103e service nova] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Received event network-vif-unplugged-aa68b905-ddee-44c5-936a-310de3d906c9 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:31 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Instance destroyed successfully.
Nov 22 14:37:31 user nova-compute[74776]: DEBUG nova.objects.instance [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Lazy-loading 'resources' on Instance uuid 2b57c3c6-2b63-4caf-af83-c5d026a5e157 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1401728127',display_name='tempest-VolumesActionsTest-instance-1401728127',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1401728127',id=36,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:35:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8080925d46054d36a78044f741861425',ramdisk_id='',reservation_id='r-e3t8nuuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-250386743',owner_user_name='tempest-VolumesActionsTest-250386743-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:35:40Z,user_data=None,user_id='0eeea2b5eb8a496c8e7b880f76267845',uuid=2b57c3c6-2b63-4caf-af83-c5d026a5e157,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa68b905-ddee-44c5-936a-310de3d906c9", "address": "fa:16:3e:5d:4b:a4", "network": {"id": "e15e5de2-0012-46fe-a5ea-61ee7b59688b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1110547767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8080925d46054d36a78044f741861425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa68b905-dd", "ovs_interfaceid": "aa68b905-ddee-44c5-936a-310de3d906c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Converting VIF {"id": "aa68b905-ddee-44c5-936a-310de3d906c9", "address": "fa:16:3e:5d:4b:a4", "network": {"id": "e15e5de2-0012-46fe-a5ea-61ee7b59688b", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1110547767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8080925d46054d36a78044f741861425", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa68b905-dd", "ovs_interfaceid": "aa68b905-ddee-44c5-936a-310de3d906c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4b:a4,bridge_name='br-int',has_traffic_filtering=True,id=aa68b905-ddee-44c5-936a-310de3d906c9,network=Network(e15e5de2-0012-46fe-a5ea-61ee7b59688b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa68b905-dd') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG os_vif [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4b:a4,bridge_name='br-int',has_traffic_filtering=True,id=aa68b905-ddee-44c5-936a-310de3d906c9,network=Network(e15e5de2-0012-46fe-a5ea-61ee7b59688b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa68b905-dd') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa68b905-dd, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=339906d8-0e7a-4e83-803e-5223cf416ef7) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:31 user nova-compute[74776]: INFO os_vif [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4b:a4,bridge_name='br-int',has_traffic_filtering=True,id=aa68b905-ddee-44c5-936a-310de3d906c9,network=Network(e15e5de2-0012-46fe-a5ea-61ee7b59688b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa68b905-dd')
Nov 22 14:37:31 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Deleting instance files /opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157_del
Nov 22 14:37:31 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Deletion of /opt/stack/data/nova/instances/2b57c3c6-2b63-4caf-af83-c5d026a5e157_del complete
Nov 22 14:37:31 user nova-compute[74776]: INFO nova.compute.manager [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 22 14:37:31 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:37:31 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:37:32 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:37:32 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Took 0.39 seconds to deallocate network for instance.
Nov 22 14:37:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:32 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:37:32 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:37:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:32 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Deleted allocations for instance 2b57c3c6-2b63-4caf-af83-c5d026a5e157
Nov 22 14:37:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a888bfc3-3e3a-4f9e-972f-f81c0a176a57 tempest-VolumesActionsTest-250386743 tempest-VolumesActionsTest-250386743-project-member] Lock "2b57c3c6-2b63-4caf-af83-c5d026a5e157" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.765s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:33 user nova-compute[74776]: DEBUG nova.compute.manager [req-20326f3d-fc31-4084-87e2-685f7a3c5e8f req-9bca587a-bb38-4b81-bc85-4ae07084864a service nova] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Received event network-vif-plugged-aa68b905-ddee-44c5-936a-310de3d906c9 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:37:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-20326f3d-fc31-4084-87e2-685f7a3c5e8f req-9bca587a-bb38-4b81-bc85-4ae07084864a service nova] Acquiring lock "2b57c3c6-2b63-4caf-af83-c5d026a5e157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-20326f3d-fc31-4084-87e2-685f7a3c5e8f req-9bca587a-bb38-4b81-bc85-4ae07084864a service nova] Lock "2b57c3c6-2b63-4caf-af83-c5d026a5e157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-20326f3d-fc31-4084-87e2-685f7a3c5e8f req-9bca587a-bb38-4b81-bc85-4ae07084864a service nova] Lock "2b57c3c6-2b63-4caf-af83-c5d026a5e157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:33 user nova-compute[74776]: DEBUG nova.compute.manager [req-20326f3d-fc31-4084-87e2-685f7a3c5e8f req-9bca587a-bb38-4b81-bc85-4ae07084864a service nova] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] No waiting events found dispatching network-vif-plugged-aa68b905-ddee-44c5-936a-310de3d906c9 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:37:33 user nova-compute[74776]: WARNING nova.compute.manager [req-20326f3d-fc31-4084-87e2-685f7a3c5e8f req-9bca587a-bb38-4b81-bc85-4ae07084864a service nova] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Received unexpected event network-vif-plugged-aa68b905-ddee-44c5-936a-310de3d906c9 for instance with vm_state deleted and task_state None.
Nov 22 14:37:33 user nova-compute[74776]: DEBUG nova.compute.manager [req-20326f3d-fc31-4084-87e2-685f7a3c5e8f req-9bca587a-bb38-4b81-bc85-4ae07084864a service nova] [instance: 2b57c3c6-2b63-4caf-af83-c5d026a5e157] Received event network-vif-deleted-aa68b905-ddee-44c5-936a-310de3d906c9 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:37:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:39 user nova-compute[74776]: INFO nova.compute.manager [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Terminating instance
Nov 22 14:37:39 user nova-compute[74776]: DEBUG nova.compute.manager [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-5b663c7f-de17-470f-a817-c88d52352123 req-a98d321e-c68e-431c-a9a6-468264025107 service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Received event network-vif-unplugged-9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5b663c7f-de17-470f-a817-c88d52352123 req-a98d321e-c68e-431c-a9a6-468264025107 service nova] Acquiring lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5b663c7f-de17-470f-a817-c88d52352123 req-a98d321e-c68e-431c-a9a6-468264025107 service nova] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5b663c7f-de17-470f-a817-c88d52352123 req-a98d321e-c68e-431c-a9a6-468264025107 service nova] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-5b663c7f-de17-470f-a817-c88d52352123 req-a98d321e-c68e-431c-a9a6-468264025107 service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] No waiting events found dispatching network-vif-unplugged-9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-5b663c7f-de17-470f-a817-c88d52352123 req-a98d321e-c68e-431c-a9a6-468264025107 service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Received event network-vif-unplugged-9612ebd1-69ec-436b-b721-5b869e501abe for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:37:39 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Instance destroyed successfully.
Nov 22 14:37:39 user nova-compute[74776]: DEBUG nova.objects.instance [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lazy-loading 'resources' on Instance uuid ac14ec9b-986a-4fe3-97e3-afbaaca431af {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-22T14:31:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-760894069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-760894069',id=33,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdVv6ik0x7LTS3T1xKKEQGeVfCF7kChgagVSWlM65HLoyqkv00NkhIQaIYoNFWaBTsZzvGaoREtSwBYGqWRiYq6NdXaQJ6NWlqMyEGRS4eJZ8BDoKPxJuJ060BQc80P9A==',key_name='tempest-keypair-1459052423',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:36:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1d6da4f9f4149479a779475a69c9110',ramdisk_id='',reservation_id='r-bhjjpdd0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1293931160',owner_user_name='tempest-AttachVolumeShelveTestJSON-1293931160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:36:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c63eae228f99474899ce0620a4affe75',uuid=ac14ec9b-986a-4fe3-97e3-afbaaca431af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9612ebd1-69", "ovs_interfaceid": "9612ebd1-69ec-436b-b721-5b869e501abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converting VIF {"id": "9612ebd1-69ec-436b-b721-5b869e501abe", "address": "fa:16:3e:3d:c5:4b", "network": {"id": "ee4ceac4-701b-43ee-a713-548f2656bf60", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1344825894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d6da4f9f4149479a779475a69c9110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9612ebd1-69", "ovs_interfaceid": "9612ebd1-69ec-436b-b721-5b869e501abe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c5:4b,bridge_name='br-int',has_traffic_filtering=True,id=9612ebd1-69ec-436b-b721-5b869e501abe,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9612ebd1-69') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG os_vif [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c5:4b,bridge_name='br-int',has_traffic_filtering=True,id=9612ebd1-69ec-436b-b721-5b869e501abe,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9612ebd1-69') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9612ebd1-69, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ca669fa-b195-4fe2-99d9-e7bfbfd74843) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:39 user nova-compute[74776]: INFO os_vif [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c5:4b,bridge_name='br-int',has_traffic_filtering=True,id=9612ebd1-69ec-436b-b721-5b869e501abe,network=Network(ee4ceac4-701b-43ee-a713-548f2656bf60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9612ebd1-69')
Nov 22 14:37:39 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Deleting instance files /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af_del
Nov 22 14:37:39 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Deletion of /opt/stack/data/nova/instances/ac14ec9b-986a-4fe3-97e3-afbaaca431af_del complete
Nov 22 14:37:40 user nova-compute[74776]: INFO nova.compute.manager [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 22 14:37:40 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:37:40 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:37:40 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:37:40 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:37:40 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Took 0.66 seconds to deallocate network for instance.
Nov 22 14:37:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:40 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:37:40 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:37:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:41 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Deleted allocations for instance ac14ec9b-986a-4fe3-97e3-afbaaca431af
Nov 22 14:37:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e8a12cac-b12a-4fab-8904-58d33e1aa18d tempest-AttachVolumeShelveTestJSON-1293931160 tempest-AttachVolumeShelveTestJSON-1293931160-project-member] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.960s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-3583b11b-2537-4aa8-9832-ef54a1592fdf req-bd0925d6-1cc5-44c8-b618-347a83387a04 service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Received event network-vif-plugged-9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:37:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3583b11b-2537-4aa8-9832-ef54a1592fdf req-bd0925d6-1cc5-44c8-b618-347a83387a04 service nova] Acquiring lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3583b11b-2537-4aa8-9832-ef54a1592fdf req-bd0925d6-1cc5-44c8-b618-347a83387a04 service nova] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3583b11b-2537-4aa8-9832-ef54a1592fdf req-bd0925d6-1cc5-44c8-b618-347a83387a04 service nova] Lock "ac14ec9b-986a-4fe3-97e3-afbaaca431af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-3583b11b-2537-4aa8-9832-ef54a1592fdf req-bd0925d6-1cc5-44c8-b618-347a83387a04 service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] No waiting events found dispatching network-vif-plugged-9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:37:41 user nova-compute[74776]: WARNING nova.compute.manager [req-3583b11b-2537-4aa8-9832-ef54a1592fdf req-bd0925d6-1cc5-44c8-b618-347a83387a04 service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Received unexpected event network-vif-plugged-9612ebd1-69ec-436b-b721-5b869e501abe for instance with vm_state deleted and task_state None.
Nov 22 14:37:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-3583b11b-2537-4aa8-9832-ef54a1592fdf req-bd0925d6-1cc5-44c8-b618-347a83387a04 service nova] [instance: ac14ec9b-986a-4fe3-97e3-afbaaca431af] Received event network-vif-deleted-9612ebd1-69ec-436b-b721-5b869e501abe {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:37:41 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:37:41 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 14:37:41 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] There are 0 instances to clean {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 14:37:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:45 user nova-compute[74776]: INFO nova.compute.manager [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Rescuing
Nov 22 14:37:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "refresh_cache-a0fdd07c-7e30-449f-95c4-8c2560d760e1" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:37:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquired lock "refresh_cache-a0fdd07c-7e30-449f-95c4-8c2560d760e1" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:37:45 user nova-compute[74776]: DEBUG nova.network.neutron [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:37:45 user nova-compute[74776]: DEBUG nova.network.neutron [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Updating instance_info_cache with network_info: [{"id": "bd8f1cd4-9030-4326-946d-380263be6dca", "address": "fa:16:3e:6c:d1:a2", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8f1cd4-90", "ovs_interfaceid": "bd8f1cd4-9030-4326-946d-380263be6dca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:37:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Releasing lock "refresh_cache-a0fdd07c-7e30-449f-95c4-8c2560d760e1" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:37:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:46 user nova-compute[74776]: DEBUG nova.compute.manager [req-c4e3d541-5f34-4ffb-8e9e-30be06d59de2 req-8bcde6bb-3088-4569-bcbb-fd35c8ab3497 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received event network-vif-unplugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:37:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c4e3d541-5f34-4ffb-8e9e-30be06d59de2 req-8bcde6bb-3088-4569-bcbb-fd35c8ab3497 service nova] Acquiring lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c4e3d541-5f34-4ffb-8e9e-30be06d59de2 req-8bcde6bb-3088-4569-bcbb-fd35c8ab3497 service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c4e3d541-5f34-4ffb-8e9e-30be06d59de2 req-8bcde6bb-3088-4569-bcbb-fd35c8ab3497 service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:46 user nova-compute[74776]: DEBUG nova.compute.manager [req-c4e3d541-5f34-4ffb-8e9e-30be06d59de2 req-8bcde6bb-3088-4569-bcbb-fd35c8ab3497 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] No waiting events found dispatching network-vif-unplugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:37:46 user nova-compute[74776]: WARNING nova.compute.manager [req-c4e3d541-5f34-4ffb-8e9e-30be06d59de2 req-8bcde6bb-3088-4569-bcbb-fd35c8ab3497 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received unexpected event network-vif-unplugged-bd8f1cd4-9030-4326-946d-380263be6dca for instance with vm_state active and task_state rescuing.
Nov 22 14:37:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:46 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Instance destroyed successfully.
Nov 22 14:37:46 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Attempting a stable device rescue
Nov 22 14:37:46 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74776) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 22 14:37:46 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Instance directory exists: not creating {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 22 14:37:46 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Creating image(s)
Nov 22 14:37:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0fdd07c-7e30-449f-95c4-8c2560d760e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "/opt/stack/data/nova/instances/a0fdd07c-7e30-449f-95c4-8c2560d760e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "/opt/stack/data/nova/instances/a0fdd07c-7e30-449f-95c4-8c2560d760e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:46 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'trusted_certs' on Instance uuid a0fdd07c-7e30-449f-95c4-8c2560d760e1 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:37:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "437069e1d141bdfd13852144404ad190984a60a2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "437069e1d141bdfd13852144404ad190984a60a2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/437069e1d141bdfd13852144404ad190984a60a2.part --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/437069e1d141bdfd13852144404ad190984a60a2.part --force-share --output=json" returned: 0 in 0.170s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:48 user nova-compute[74776]: DEBUG nova.virt.images [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] 183a6f22-1b79-41b6-bb62-9d6643ac2c80 was qcow2, converting to raw {{(pid=74776) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 22 14:37:48 user nova-compute[74776]: DEBUG nova.privsep.utils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74776) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 22 14:37:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/437069e1d141bdfd13852144404ad190984a60a2.part /opt/stack/data/nova/instances/_base/437069e1d141bdfd13852144404ad190984a60a2.converted {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:48 user nova-compute[74776]: DEBUG nova.compute.manager [req-c34996f3-95c4-4391-bee2-420ee45adefa req-b871dd8a-9b8d-4f6a-bbfc-d375c7f7cc15 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received event network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:37:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c34996f3-95c4-4391-bee2-420ee45adefa req-b871dd8a-9b8d-4f6a-bbfc-d375c7f7cc15 service nova] Acquiring lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c34996f3-95c4-4391-bee2-420ee45adefa req-b871dd8a-9b8d-4f6a-bbfc-d375c7f7cc15 service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c34996f3-95c4-4391-bee2-420ee45adefa req-b871dd8a-9b8d-4f6a-bbfc-d375c7f7cc15 service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:48 user nova-compute[74776]: DEBUG nova.compute.manager [req-c34996f3-95c4-4391-bee2-420ee45adefa req-b871dd8a-9b8d-4f6a-bbfc-d375c7f7cc15 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] No waiting events found dispatching network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:37:48 user nova-compute[74776]: WARNING nova.compute.manager [req-c34996f3-95c4-4391-bee2-420ee45adefa req-b871dd8a-9b8d-4f6a-bbfc-d375c7f7cc15 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received unexpected event network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca for instance with vm_state active and task_state rescuing.
Nov 22 14:37:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/437069e1d141bdfd13852144404ad190984a60a2.part /opt/stack/data/nova/instances/_base/437069e1d141bdfd13852144404ad190984a60a2.converted" returned: 0 in 0.422s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/437069e1d141bdfd13852144404ad190984a60a2.converted --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/437069e1d141bdfd13852144404ad190984a60a2.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "437069e1d141bdfd13852144404ad190984a60a2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.936s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "437069e1d141bdfd13852144404ad190984a60a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "437069e1d141bdfd13852144404ad190984a60a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/437069e1d141bdfd13852144404ad190984a60a2 --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/437069e1d141bdfd13852144404ad190984a60a2 --force-share --output=json" returned: 0 in 0.180s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/437069e1d141bdfd13852144404ad190984a60a2,backing_fmt=raw /opt/stack/data/nova/instances/a0fdd07c-7e30-449f-95c4-8c2560d760e1/disk.rescue {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/437069e1d141bdfd13852144404ad190984a60a2,backing_fmt=raw /opt/stack/data/nova/instances/a0fdd07c-7e30-449f-95c4-8c2560d760e1/disk.rescue" returned: 0 in 0.056s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "437069e1d141bdfd13852144404ad190984a60a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'migration_context' on Instance uuid a0fdd07c-7e30-449f-95c4-8c2560d760e1 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.objects.base [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Object Instance<a0fdd07c-7e30-449f-95c4-8c2560d760e1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Start _get_guest_xml network_info=[{"id": "bd8f1cd4-9030-4326-946d-380263be6dca", "address": "fa:16:3e:6c:d1:a2", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "vif_mac": "fa:16:3e:6c:d1:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8f1cd4-90", "ovs_interfaceid": "bd8f1cd4-9030-4326-946d-380263be6dca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '183a6f22-1b79-41b6-bb62-9d6643ac2c80', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'bf9b8679-4572-479c-84b6-dbbbd8fc9ec1', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjWVmCuG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'a0fdd07c-7e30-449f-95c4-8c2560d760e1', 'attached_at': '', 'detached_at': '', 'volume_id': '7daa249b-815d-47f6-9c03-33cff794a261', 'serial': '7daa249b-815d-47f6-9c03-33cff794a261'}, 'boot_index': 0, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'resources' on Instance uuid a0fdd07c-7e30-449f-95c4-8c2560d760e1 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.objects.base [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Object Instance<a0fdd07c-7e30-449f-95c4-8c2560d760e1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'numa_topology' on Instance uuid a0fdd07c-7e30-449f-95c4-8c2560d760e1 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.objects.base [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Object Instance<a0fdd07c-7e30-449f-95c4-8c2560d760e1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:37:49 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:37:49 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'vcpu_model' on Instance uuid a0fdd07c-7e30-449f-95c4-8c2560d760e1 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.objects.base [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Object Instance<a0fdd07c-7e30-449f-95c4-8c2560d760e1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjWVmCuG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:37:49 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:37:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:37:49 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:37:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:37:49 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b14c5f-2f5b-472e-97a7-be14dd8e941f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = TjWVmCuG\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 22 14:37:49 user nova-compute[74776]: node.name = iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261
Nov 22 14:37:49 user nova-compute[74776]: node.tpgt = -1
Nov 22 14:37:49 user nova-compute[74776]: node.startup = automatic
Nov 22 14:37:49 user nova-compute[74776]: node.leading_login = No
Nov 22 14:37:49 user nova-compute[74776]: iface.iscsi_ifacename = default
Nov 22 14:37:49 user nova-compute[74776]: iface.net_ifacename = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.ipaddress = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.prefix_len = 0
Nov 22 14:37:49 user nova-compute[74776]: iface.hwaddress = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.transport_name = tcp
Nov 22 14:37:49 user nova-compute[74776]: iface.initiatorname = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.state = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.vlan_id = 0
Nov 22 14:37:49 user nova-compute[74776]: iface.vlan_priority = 0
Nov 22 14:37:49 user nova-compute[74776]: iface.vlan_state = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.iface_num = 0
Nov 22 14:37:49 user nova-compute[74776]: iface.mtu = 0
Nov 22 14:37:49 user nova-compute[74776]: iface.port = 0
Nov 22 14:37:49 user nova-compute[74776]: iface.bootproto = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.subnet_mask = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.gateway = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.dhcp_alt_client_id_state = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.dhcp_alt_client_id = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.dhcp_dns = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.dhcp_learn_iqn = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.dhcp_req_vendor_id_state = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.dhcp_vendor_id_state = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.dhcp_vendor_id = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.dhcp_slp_da = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.fragmentation = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.gratuitous_arp = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.incoming_forwarding = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.tos_state = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.tos = 0
Nov 22 14:37:49 user nova-compute[74776]: iface.ttl = 0
Nov 22 14:37:49 user nova-compute[74776]: iface.delayed_ack = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.tcp_nagle = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.tcp_wsf_state = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.tcp_wsf = 0
Nov 22 14:37:49 user nova-compute[74776]: iface.tcp_timer_scale = 0
Nov 22 14:37:49 user nova-compute[74776]: iface.tcp_timestamp = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.redirect = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.def_task_mgmt_timeout = 0
Nov 22 14:37:49 user nova-compute[74776]: iface.header_digest = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.data_digest = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.immediate_data = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.initial_r2t = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.data_seq_inorder = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.data_pdu_inorder = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.erl = 0
Nov 22 14:37:49 user nova-compute[74776]: iface.max_receive_data_len = 0
Nov 22 14:37:49 user nova-compute[74776]: iface.first_burst_len = 0
Nov 22 14:37:49 user nova-compute[74776]: iface.max_outstanding_r2t = 0
Nov 22 14:37:49 user nova-compute[74776]: iface.max_burst_len = 0
Nov 22 14:37:49 user nova-compute[74776]: iface.chap_auth = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.bidi_chap = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.strict_login_compliance = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.discovery_auth = <empty>
Nov 22 14:37:49 user nova-compute[74776]: iface.discovery_logout = <empty>
Nov 22 14:37:49 user nova-compute[74776]: node.discovery_address = <empty>
Nov 22 14:37:49 user nova-compute[74776]: node.discovery_port = 0
Nov 22 14:37:49 user nova-compute[74776]: node.discovery_type = static
Nov 22 14:37:49 user nova-compute[74776]: node.session.initial_cmdsn = 0
Nov 22 14:37:49 user nova-compute[74776]: node.session.initial_login_retry_max = 8
Nov 22 14:37:49 user nova-compute[74776]: node.session.xmit_thread_priority = -20
Nov 22 14:37:49 user nova-compute[74776]: node.session.cmds_max = 128
Nov 22 14:37:49 user nova-compute[74776]: node.session.queue_depth = 32
Nov 22 14:37:49 user nova-compute[74776]: node.session.nr_sessions = 1
Nov 22 14:37:49 user nova-compute[74776]: node.session.auth.authmethod = CHAP
Nov 22 14:37:49 user nova-compute[74776]: node.session.auth.username = TjWVmCuG
Nov 22 14:37:49 user nova-compute[74776]: node.session.auth.password = ***
Nov 22 14:37:49 user nova-compute[74776]: node.session.auth.username_in = <empty>
Nov 22 14:37:49 user nova-compute[74776]: node.session.auth.password_in = <empty>
Nov 22 14:37:49 user nova-compute[74776]: node.session.auth.chap_algs = MD5
Nov 22 14:37:49 user nova-compute[74776]: node.session.timeo.replacement_timeout = 120
Nov 22 14:37:49 user nova-compute[74776]: node.session.err_timeo.abort_timeout = 15
Nov 22 14:37:49 user nova-compute[74776]: node.session.err_timeo.lu_reset_timeout = 30
Nov 22 14:37:49 user nova-compute[74776]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 22 14:37:49 user nova-compute[74776]: node.session.err_timeo.host_reset_timeout = 60
Nov 22 14:37:49 user nova-compute[74776]: node.session.iscsi.FastAbort = Yes
Nov 22 14:37:49 user nova-compute[74776]: node.session.iscsi.InitialR2T = No
Nov 22 14:37:49 user nova-compute[74776]: node.session.iscsi.ImmediateData = Yes
Nov 22 14:37:49 user nova-compute[74776]: node.session.iscsi.FirstBurstLength = 262144
Nov 22 14:37:49 user nova-compute[74776]: node.session.iscsi.MaxBurstLength = 16776192
Nov 22 14:37:49 user nova-compute[74776]: node.session.iscsi.DefaultTime2Retain = 0
Nov 22 14:37:49 user nova-compute[74776]: node.session.iscsi.DefaultTime2Wait = 2
Nov 22 14:37:49 user nova-compute[74776]: node.session.iscsi.MaxConnections = 1
Nov 22 14:37:49 user nova-compute[74776]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 22 14:37:49 user nova-compute[74776]: node.session.iscsi.ERL = 0
Nov 22 14:37:49 user nova-compute[74776]: node.session.scan = manual
Nov 22 14:37:49 user nova-compute[74776]: node.session.reopen_max = 0
Nov 22 14:37:49 user nova-compute[74776]: node.conn[0].address = 172.16.0.220
Nov 22 14:37:49 user nova-compute[74776]: node.conn[0].port = 3260
Nov 22 14:37:49 user nova-compute[74776]: node.conn[0].startup = manual
Nov 22 14:37:49 user nova-compute[74776]: node.conn[0].tcp.window_size = 524288
Nov 22 14:37:49 user nova-compute[74776]: node.conn[0].tcp.type_of_service = 0
Nov 22 14:37:49 user nova-compute[74776]: node.conn[0].timeo.logout_timeout = 15
Nov 22 14:37:49 user nova-compute[74776]: node.conn[0].timeo.login_timeout = 15
Nov 22 14:37:49 user nova-compute[74776]: node.conn[0].timeo.auth_timeout = 45
Nov 22 14:37:49 user nova-compute[74776]: node.conn[0].timeo.noop_out_interval = 5
Nov 22 14:37:49 user nova-compute[74776]: node.conn[0].timeo.noop_out_timeout = 5
Nov 22 14:37:49 user nova-compute[74776]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 22 14:37:49 user nova-compute[74776]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 22 14:37:49 user nova-compute[74776]: node.conn[0].iscsi.HeaderDigest = None
Nov 22 14:37:49 user nova-compute[74776]: node.conn[0].iscsi.DataDigest = None
Nov 22 14:37:49 user nova-compute[74776]: node.conn[0].iscsi.IFMarker = No
Nov 22 14:37:49 user nova-compute[74776]: node.conn[0].iscsi.OFMarker = No
Nov 22 14:37:49 user nova-compute[74776]: # END RECORD
Nov 22 14:37:49 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d6ffde-68a9-47c4-b239-aea85b7669b0]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8be7b50-487e-44a0-823c-04282e77787f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TjWVmCuG {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TjWVmCuG" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[639357c2-c0f1-4617-b732-ad0d1b3ff002]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TjWVmCuG'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.142s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[66052e81-3bcf-4616-9386-0eabc3826b5d]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[642ff5cd-8fe8-4b98-9b17-308f07f7286f]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:37:49 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:37:49 user nova-compute[74776]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f (non-flash)
Nov 22 14:37:49 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:37:49 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:37:49 user nova-compute[74776]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f (non-flash)
Nov 22 14:37:49 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] HCTL ('34', '0', '0', 0) found on session 44 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e55bcd-19d8-4e6b-8a04-561656c2179a]: (4, ('0 0 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Searching for a device in session 44 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjWVmCuG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.299s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] <== connect_volume: return (301ms) {'type': 'block', 'scsi_wwn': '23832386434636464', 'path': '/dev/sdc'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832386434636464', 'path': '/dev/sdc'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-460725042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-460725042',id=37,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:36:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d359aba8e95e4090a02fb0a46012f20b',ramdisk_id='',reservation_id='r-k5u3k3yl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-202976361',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:36:14Z,user_data=None,user_id='dea876275c70471d9cba1c3158bd63e2',uuid=a0fdd07c-7e30-449f-95c4-8c2560d760e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd8f1cd4-9030-4326-946d-380263be6dca", "address": "fa:16:3e:6c:d1:a2", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "vif_mac": "fa:16:3e:6c:d1:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8f1cd4-90", "ovs_interfaceid": "bd8f1cd4-9030-4326-946d-380263be6dca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converting VIF {"id": "bd8f1cd4-9030-4326-946d-380263be6dca", "address": "fa:16:3e:6c:d1:a2", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "vif_mac": "fa:16:3e:6c:d1:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8f1cd4-90", "ovs_interfaceid": "bd8f1cd4-9030-4326-946d-380263be6dca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:d1:a2,bridge_name='br-int',has_traffic_filtering=True,id=bd8f1cd4-9030-4326-946d-380263be6dca,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8f1cd4-90') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'pci_devices' on Instance uuid a0fdd07c-7e30-449f-95c4-8c2560d760e1 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.objects.base [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Object Instance<a0fdd07c-7e30-449f-95c4-8c2560d760e1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:37:49 user nova-compute[74776]:   <uuid>a0fdd07c-7e30-449f-95c4-8c2560d760e1</uuid>
Nov 22 14:37:49 user nova-compute[74776]:   <name>instance-00000025</name>
Nov 22 14:37:49 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:37:49 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:37:49 user nova-compute[74776]:   <metadata>
Nov 22 14:37:49 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:37:49 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:37:49 user nova-compute[74776]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-460725042</nova:name>
Nov 22 14:37:49 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:37:49</nova:creationTime>
Nov 22 14:37:49 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:37:49 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:37:49 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:37:49 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:37:49 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:37:49 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:37:49 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:37:49 user nova-compute[74776]:       <nova:owner>
Nov 22 14:37:49 user nova-compute[74776]:         <nova:user uuid="dea876275c70471d9cba1c3158bd63e2">tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member</nova:user>
Nov 22 14:37:49 user nova-compute[74776]:         <nova:project uuid="d359aba8e95e4090a02fb0a46012f20b">tempest-ServerBootFromVolumeStableRescueTest-202976361</nova:project>
Nov 22 14:37:49 user nova-compute[74776]:       </nova:owner>
Nov 22 14:37:49 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:37:49 user nova-compute[74776]:       <nova:ports>
Nov 22 14:37:49 user nova-compute[74776]:         <nova:port uuid="bd8f1cd4-9030-4326-946d-380263be6dca">
Nov 22 14:37:49 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 22 14:37:49 user nova-compute[74776]:         </nova:port>
Nov 22 14:37:49 user nova-compute[74776]:       </nova:ports>
Nov 22 14:37:49 user nova-compute[74776]:     </nova:instance>
Nov 22 14:37:49 user nova-compute[74776]:   </metadata>
Nov 22 14:37:49 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:37:49 user nova-compute[74776]:     <system>
Nov 22 14:37:49 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:37:49 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:37:49 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:37:49 user nova-compute[74776]:       <entry name="serial">a0fdd07c-7e30-449f-95c4-8c2560d760e1</entry>
Nov 22 14:37:49 user nova-compute[74776]:       <entry name="uuid">a0fdd07c-7e30-449f-95c4-8c2560d760e1</entry>
Nov 22 14:37:49 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:37:49 user nova-compute[74776]:     </system>
Nov 22 14:37:49 user nova-compute[74776]:   </sysinfo>
Nov 22 14:37:49 user nova-compute[74776]:   <os>
Nov 22 14:37:49 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:37:49 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:37:49 user nova-compute[74776]:   </os>
Nov 22 14:37:49 user nova-compute[74776]:   <features>
Nov 22 14:37:49 user nova-compute[74776]:     <acpi/>
Nov 22 14:37:49 user nova-compute[74776]:     <apic/>
Nov 22 14:37:49 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:37:49 user nova-compute[74776]:   </features>
Nov 22 14:37:49 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:37:49 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:37:49 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:37:49 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:37:49 user nova-compute[74776]:   </clock>
Nov 22 14:37:49 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:37:49 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:37:49 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:37:49 user nova-compute[74776]:   </cpu>
Nov 22 14:37:49 user nova-compute[74776]:   <devices>
Nov 22 14:37:49 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:37:49 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:37:49 user nova-compute[74776]:       <source dev="/dev/sdc"/>
Nov 22 14:37:49 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:37:49 user nova-compute[74776]:       <serial>7daa249b-815d-47f6-9c03-33cff794a261</serial>
Nov 22 14:37:49 user nova-compute[74776]:     </disk>
Nov 22 14:37:49 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:37:49 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:37:49 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/a0fdd07c-7e30-449f-95c4-8c2560d760e1/disk.rescue"/>
Nov 22 14:37:49 user nova-compute[74776]:       <target dev="vdb" bus="virtio"/>
Nov 22 14:37:49 user nova-compute[74776]:       <boot order="1"/>
Nov 22 14:37:49 user nova-compute[74776]:     </disk>
Nov 22 14:37:49 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:37:49 user nova-compute[74776]:       <mac address="fa:16:3e:6c:d1:a2"/>
Nov 22 14:37:49 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:37:49 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:37:49 user nova-compute[74776]:       <target dev="tapbd8f1cd4-90"/>
Nov 22 14:37:49 user nova-compute[74776]:     </interface>
Nov 22 14:37:49 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:37:49 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/a0fdd07c-7e30-449f-95c4-8c2560d760e1/console.log" append="off"/>
Nov 22 14:37:49 user nova-compute[74776]:     </serial>
Nov 22 14:37:49 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:37:49 user nova-compute[74776]:     <video>
Nov 22 14:37:49 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:37:49 user nova-compute[74776]:     </video>
Nov 22 14:37:49 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:37:49 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:37:49 user nova-compute[74776]:     </rng>
Nov 22 14:37:49 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:37:49 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:37:49 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:37:49 user nova-compute[74776]:     </memballoon>
Nov 22 14:37:49 user nova-compute[74776]:   </devices>
Nov 22 14:37:49 user nova-compute[74776]: </domain>
Nov 22 14:37:49 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:37:49 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Instance destroyed successfully.
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] No VIF found with MAC fa:16:3e:6c:d1:a2, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:37:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:51 user nova-compute[74776]: DEBUG nova.compute.manager [req-32d807fc-1dc3-4e2a-b256-d54616ba0203 req-6d7723bd-6525-4d0a-9d70-5f40c7186bcc service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received event network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:37:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-32d807fc-1dc3-4e2a-b256-d54616ba0203 req-6d7723bd-6525-4d0a-9d70-5f40c7186bcc service nova] Acquiring lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-32d807fc-1dc3-4e2a-b256-d54616ba0203 req-6d7723bd-6525-4d0a-9d70-5f40c7186bcc service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-32d807fc-1dc3-4e2a-b256-d54616ba0203 req-6d7723bd-6525-4d0a-9d70-5f40c7186bcc service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:51 user nova-compute[74776]: DEBUG nova.compute.manager [req-32d807fc-1dc3-4e2a-b256-d54616ba0203 req-6d7723bd-6525-4d0a-9d70-5f40c7186bcc service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] No waiting events found dispatching network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:37:51 user nova-compute[74776]: WARNING nova.compute.manager [req-32d807fc-1dc3-4e2a-b256-d54616ba0203 req-6d7723bd-6525-4d0a-9d70-5f40c7186bcc service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received unexpected event network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca for instance with vm_state active and task_state rescuing.
Nov 22 14:37:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:53 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d7903867-5d4d-4b96-bdf0-3bddd0b71248 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:37:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-36c981d9-65f8-41dc-8d5f-61552a895862 req-17c3d0fb-e686-40c5-8c1f-8b670ac6de68 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received event network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:37:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-36c981d9-65f8-41dc-8d5f-61552a895862 req-17c3d0fb-e686-40c5-8c1f-8b670ac6de68 service nova] Acquiring lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:37:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-36c981d9-65f8-41dc-8d5f-61552a895862 req-17c3d0fb-e686-40c5-8c1f-8b670ac6de68 service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:37:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-36c981d9-65f8-41dc-8d5f-61552a895862 req-17c3d0fb-e686-40c5-8c1f-8b670ac6de68 service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:37:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-36c981d9-65f8-41dc-8d5f-61552a895862 req-17c3d0fb-e686-40c5-8c1f-8b670ac6de68 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] No waiting events found dispatching network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:37:53 user nova-compute[74776]: WARNING nova.compute.manager [req-36c981d9-65f8-41dc-8d5f-61552a895862 req-17c3d0fb-e686-40c5-8c1f-8b670ac6de68 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received unexpected event network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca for instance with vm_state rescued and task_state None.
Nov 22 14:37:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:37:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-850f6508-1dc0-48c0-b0c6-a78af8a7941f req-4ce890db-9a31-45ba-9757-0d975dad9976 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received event network-changed-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:38:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-850f6508-1dc0-48c0-b0c6-a78af8a7941f req-4ce890db-9a31-45ba-9757-0d975dad9976 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Refreshing instance network info cache due to event network-changed-365c5ef1-7abf-4102-a6aa-be03a4f325f2. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:38:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-850f6508-1dc0-48c0-b0c6-a78af8a7941f req-4ce890db-9a31-45ba-9757-0d975dad9976 service nova] Acquiring lock "refresh_cache-c392a863-0d2f-492f-992d-13b21ebd385e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:38:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-850f6508-1dc0-48c0-b0c6-a78af8a7941f req-4ce890db-9a31-45ba-9757-0d975dad9976 service nova] Acquired lock "refresh_cache-c392a863-0d2f-492f-992d-13b21ebd385e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:38:06 user nova-compute[74776]: DEBUG nova.network.neutron [req-850f6508-1dc0-48c0-b0c6-a78af8a7941f req-4ce890db-9a31-45ba-9757-0d975dad9976 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Refreshing network info cache for port 365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:38:07 user nova-compute[74776]: DEBUG nova.network.neutron [req-850f6508-1dc0-48c0-b0c6-a78af8a7941f req-4ce890db-9a31-45ba-9757-0d975dad9976 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Updated VIF entry in instance network info cache for port 365c5ef1-7abf-4102-a6aa-be03a4f325f2. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:38:07 user nova-compute[74776]: DEBUG nova.network.neutron [req-850f6508-1dc0-48c0-b0c6-a78af8a7941f req-4ce890db-9a31-45ba-9757-0d975dad9976 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Updating instance_info_cache with network_info: [{"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:38:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-850f6508-1dc0-48c0-b0c6-a78af8a7941f req-4ce890db-9a31-45ba-9757-0d975dad9976 service nova] Releasing lock "refresh_cache-c392a863-0d2f-492f-992d-13b21ebd385e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:38:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:38:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "c392a863-0d2f-492f-992d-13b21ebd385e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:38:09 user nova-compute[74776]: DEBUG nova.objects.instance [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'flavor' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:38:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "c392a863-0d2f-492f-992d-13b21ebd385e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:38:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:38:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:38:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:38:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:38:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:38:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "c392a863-0d2f-492f-992d-13b21ebd385e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:38:09 user nova-compute[74776]: INFO nova.compute.manager [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Attaching volume 63f308c1-ecd0-4675-9d75-ec247693f59e to /dev/vdb
Nov 22 14:38:10 user nova-compute[74776]: DEBUG os_brick.utils [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:38:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[31193a99-c581-4a6f-932c-5ce61f50ebe1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e147ad8-98ff-49cf-a84b-c1940dd7d9bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5684c1-4c41-4004-82b8-5f2cf8dda779]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fea5f7-438c-4425-a559-c6df9f2b6d55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:38:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:38:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:38:10 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:38:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f9c2d6-ea05-486c-ba14-51d1752cf2b4]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:38:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:38:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:38:10 user nova-compute[74776]: DEBUG os_brick.utils [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:38:10 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Updating existing volume attachment record: 0052f1eb-0b8e-43b2-8f2b-d968348e138f {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:38:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EStVPghu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:38:16 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:38:16 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:38:16 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e7bd47-0304-4b64-815d-420191a2df46]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:38:16 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[96491fcf-3dc0-4646-953b-ca9bae184157]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e] added
Nov 22 14:38:16 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0feb8cb0-5b37-4cfa-9ced-cd0e8aa110cd]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b290deda-ddb2-4791-ae60-1dfb864a6764]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EStVPghu {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EStVPghu" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4d34d7-5e66-48ef-ba8a-9f281b13fecc]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EStVPghu'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c38bc9-4e06-4420-84e4-8ae95df2e66f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d7a439-8e8e-4529-b046-ce2df8bb0216]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:38:16 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:38:16 user nova-compute[74776]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f (non-flash)
Nov 22 14:38:16 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:38:16 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:38:16 user nova-compute[74776]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f (non-flash)
Nov 22 14:38:16 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcff9f4-764e-44f5-b31e-5824d25c5a17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e, portal: 172.16.0.220,3260]
Nov 22 14:38:16 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e, portal: 172.16.0.220,3260] successful.
Nov 22 14:38:16 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c2c310-2c62-42ab-975e-f72a62cbbf01]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1316b2b-d1cb-4232-a07c-ed3e45042dec]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:38:16 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:38:16 user nova-compute[74776]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f (non-flash)
Nov 22 14:38:16 user nova-compute[74776]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e (non-flash)
Nov 22 14:38:16 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:38:16 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:38:16 user nova-compute[74776]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f (non-flash)
Nov 22 14:38:16 user nova-compute[74776]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e (non-flash)
Nov 22 14:38:16 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d76e7cb-18e5-43a8-99aa-4b9406247e3d]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: None {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:38:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:17 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:38:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EStVPghu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:38:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:38:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23866643033643864', 'path': '/dev/sde'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:38:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866643033643864', 'path': '/dev/sde'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:38:17 user nova-compute[74776]: DEBUG nova.objects.instance [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'flavor' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:38:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:38:17 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:38:17 user nova-compute[74776]:   <source dev="/dev/sde"/>
Nov 22 14:38:17 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:38:17 user nova-compute[74776]:   <serial>63f308c1-ecd0-4675-9d75-ec247693f59e</serial>
Nov 22 14:38:17 user nova-compute[74776]: </disk>
Nov 22 14:38:17 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:38:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:38:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:38:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] No VIF found with MAC fa:16:3e:61:95:20, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:38:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-342a28f3-aad7-43eb-a582-d917d95b961b tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "c392a863-0d2f-492f-992d-13b21ebd385e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.247s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:38:18 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:38:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6dfd05bd-e4c0-4008-9eba-20bcb04fae17 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:38:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6dfd05bd-e4c0-4008-9eba-20bcb04fae17 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "c392a863-0d2f-492f-992d-13b21ebd385e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:38:18 user nova-compute[74776]: DEBUG nova.compute.manager [None req-6dfd05bd-e4c0-4008-9eba-20bcb04fae17 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:38:18 user nova-compute[74776]: DEBUG nova.compute.manager [None req-6dfd05bd-e4c0-4008-9eba-20bcb04fae17 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74776) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 22 14:38:18 user nova-compute[74776]: DEBUG nova.objects.instance [None req-6dfd05bd-e4c0-4008-9eba-20bcb04fae17 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'flavor' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:38:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-92ea655c-a3f8-41ed-86c6-102cc39b8271 req-54e5b5e6-2618-4daf-bad6-52bbd2f16a9b service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received event network-vif-unplugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:38:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-92ea655c-a3f8-41ed-86c6-102cc39b8271 req-54e5b5e6-2618-4daf-bad6-52bbd2f16a9b service nova] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:38:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-92ea655c-a3f8-41ed-86c6-102cc39b8271 req-54e5b5e6-2618-4daf-bad6-52bbd2f16a9b service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:38:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-92ea655c-a3f8-41ed-86c6-102cc39b8271 req-54e5b5e6-2618-4daf-bad6-52bbd2f16a9b service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:38:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-92ea655c-a3f8-41ed-86c6-102cc39b8271 req-54e5b5e6-2618-4daf-bad6-52bbd2f16a9b service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] No waiting events found dispatching network-vif-unplugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:38:19 user nova-compute[74776]: WARNING nova.compute.manager [req-92ea655c-a3f8-41ed-86c6-102cc39b8271 req-54e5b5e6-2618-4daf-bad6-52bbd2f16a9b service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received unexpected event network-vif-unplugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 for instance with vm_state active and task_state powering-off.
Nov 22 14:38:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:19 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Instance destroyed successfully.
Nov 22 14:38:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-6dfd05bd-e4c0-4008-9eba-20bcb04fae17 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:38:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-b81f7df7-22e0-4021-8ec6-432ed36afa69 req-4dfbb4f0-fc1b-4106-a039-e6404d160aef service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received event network-changed-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:38:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-b81f7df7-22e0-4021-8ec6-432ed36afa69 req-4dfbb4f0-fc1b-4106-a039-e6404d160aef service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Refreshing instance network info cache due to event network-changed-e73b0b93-8497-4bf9-8149-c5c640ff6253. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:38:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b81f7df7-22e0-4021-8ec6-432ed36afa69 req-4dfbb4f0-fc1b-4106-a039-e6404d160aef service nova] Acquiring lock "refresh_cache-25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:38:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b81f7df7-22e0-4021-8ec6-432ed36afa69 req-4dfbb4f0-fc1b-4106-a039-e6404d160aef service nova] Acquired lock "refresh_cache-25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:38:19 user nova-compute[74776]: DEBUG nova.network.neutron [req-b81f7df7-22e0-4021-8ec6-432ed36afa69 req-4dfbb4f0-fc1b-4106-a039-e6404d160aef service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Refreshing network info cache for port e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:38:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6dfd05bd-e4c0-4008-9eba-20bcb04fae17 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "c392a863-0d2f-492f-992d-13b21ebd385e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.890s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:38:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:20 user nova-compute[74776]: DEBUG nova.network.neutron [req-b81f7df7-22e0-4021-8ec6-432ed36afa69 req-4dfbb4f0-fc1b-4106-a039-e6404d160aef service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Updated VIF entry in instance network info cache for port e73b0b93-8497-4bf9-8149-c5c640ff6253. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:38:20 user nova-compute[74776]: DEBUG nova.network.neutron [req-b81f7df7-22e0-4021-8ec6-432ed36afa69 req-4dfbb4f0-fc1b-4106-a039-e6404d160aef service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Updating instance_info_cache with network_info: [{"id": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "address": "fa:16:3e:68:f0:28", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73b0b93-84", "ovs_interfaceid": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:38:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b81f7df7-22e0-4021-8ec6-432ed36afa69 req-4dfbb4f0-fc1b-4106-a039-e6404d160aef service nova] Releasing lock "refresh_cache-25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:38:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Acquiring lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:38:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:38:20 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:38:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:38:21 user nova-compute[74776]: INFO nova.compute.claims [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Claim successful on node user
Nov 22 14:38:21 user nova-compute[74776]: INFO nova.compute.manager [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Detaching volume bba3b594-2372-4955-8321-721b6aad454f
Nov 22 14:38:21 user nova-compute[74776]: INFO nova.virt.block_device [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Attempting to driver detach volume bba3b594-2372-4955-8321-721b6aad454f from mountpoint /dev/vdb
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Attempting to detach device vdb from instance 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:38:21 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:38:21 user nova-compute[74776]:   <source dev="/dev/sdd"/>
Nov 22 14:38:21 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:38:21 user nova-compute[74776]:   <serial>bba3b594-2372-4955-8321-721b6aad454f</serial>
Nov 22 14:38:21 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:38:21 user nova-compute[74776]: </disk>
Nov 22 14:38:21 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:38:21 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Successfully detached device vdb from instance 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f from the persistent domain config.
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:38:21 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:38:21 user nova-compute[74776]:   <source dev="/dev/sdd"/>
Nov 22 14:38:21 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:38:21 user nova-compute[74776]:   <serial>bba3b594-2372-4955-8321-721b6aad454f</serial>
Nov 22 14:38:21 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:38:21 user nova-compute[74776]: </disk>
Nov 22 14:38:21 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] No waiting events found dispatching network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:38:21 user nova-compute[74776]: WARNING nova.compute.manager [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received unexpected event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 for instance with vm_state stopped and task_state None.
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] No waiting events found dispatching network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:38:21 user nova-compute[74776]: WARNING nova.compute.manager [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received unexpected event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 for instance with vm_state stopped and task_state None.
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] No waiting events found dispatching network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:38:21 user nova-compute[74776]: WARNING nova.compute.manager [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received unexpected event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 for instance with vm_state stopped and task_state None.
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received event network-vif-unplugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] No waiting events found dispatching network-vif-unplugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:38:21 user nova-compute[74776]: WARNING nova.compute.manager [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received unexpected event network-vif-unplugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 for instance with vm_state stopped and task_state None.
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] No waiting events found dispatching network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:38:21 user nova-compute[74776]: WARNING nova.compute.manager [req-112bc373-6b34-4488-ab8f-7afec9c3cd2c req-c1277caa-902d-4c29-985c-64a3b1a8cb2f service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received unexpected event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 for instance with vm_state stopped and task_state None.
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.network.neutron [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:38:21 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.policy [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a13b1e5b2494485aedb60ce10cdff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc1a673644b4227a3b00fcd84a68207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-1529747d-3bc8-448d-93bb-b1ed354be6d5 req-3a148e8f-0ce3-4117-9307-065d6903be5c service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received event network-changed-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-1529747d-3bc8-448d-93bb-b1ed354be6d5 req-3a148e8f-0ce3-4117-9307-065d6903be5c service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Refreshing instance network info cache due to event network-changed-e73b0b93-8497-4bf9-8149-c5c640ff6253. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1529747d-3bc8-448d-93bb-b1ed354be6d5 req-3a148e8f-0ce3-4117-9307-065d6903be5c service nova] Acquiring lock "refresh_cache-25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1529747d-3bc8-448d-93bb-b1ed354be6d5 req-3a148e8f-0ce3-4117-9307-065d6903be5c service nova] Acquired lock "refresh_cache-25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.network.neutron [req-1529747d-3bc8-448d-93bb-b1ed354be6d5 req-3a148e8f-0ce3-4117-9307-065d6903be5c service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Refreshing network info cache for port e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:38:21 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Creating image(s)
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "/opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "/opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.194s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:38:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.187s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk 1073741824" returned: 0 in 0.056s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG nova.network.neutron [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Successfully created port: da635911-c5a6-4a05-a14f-f19d94a6e6fd {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG nova.network.neutron [req-1529747d-3bc8-448d-93bb-b1ed354be6d5 req-3a148e8f-0ce3-4117-9307-065d6903be5c service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Updated VIF entry in instance network info cache for port e73b0b93-8497-4bf9-8149-c5c640ff6253. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG nova.network.neutron [req-1529747d-3bc8-448d-93bb-b1ed354be6d5 req-3a148e8f-0ce3-4117-9307-065d6903be5c service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Updating instance_info_cache with network_info: [{"id": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "address": "fa:16:3e:68:f0:28", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73b0b93-84", "ovs_interfaceid": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1529747d-3bc8-448d-93bb-b1ed354be6d5 req-3a148e8f-0ce3-4117-9307-065d6903be5c service nova] Releasing lock "refresh_cache-25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.181s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Cannot resize image /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Ensure instance console log exists: /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG nova.network.neutron [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Successfully updated port: da635911-c5a6-4a05-a14f-f19d94a6e6fd {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Acquiring lock "refresh_cache-dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Acquired lock "refresh_cache-dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG nova.network.neutron [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG nova.compute.manager [req-5df4424a-150b-46a2-9cb6-7ea251a2e306 req-b0b92a1a-2ea3-4eb7-88f4-51e4dd5f541d service nova] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Received event network-changed-da635911-c5a6-4a05-a14f-f19d94a6e6fd {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG nova.compute.manager [req-5df4424a-150b-46a2-9cb6-7ea251a2e306 req-b0b92a1a-2ea3-4eb7-88f4-51e4dd5f541d service nova] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Refreshing instance network info cache due to event network-changed-da635911-c5a6-4a05-a14f-f19d94a6e6fd. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5df4424a-150b-46a2-9cb6-7ea251a2e306 req-b0b92a1a-2ea3-4eb7-88f4-51e4dd5f541d service nova] Acquiring lock "refresh_cache-dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:38:22 user nova-compute[74776]: DEBUG nova.network.neutron [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.network.neutron [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Updating instance_info_cache with network_info: [{"id": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "address": "fa:16:3e:1c:18:6c", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda635911-c5", "ovs_interfaceid": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Releasing lock "refresh_cache-dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Instance network_info: |[{"id": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "address": "fa:16:3e:1c:18:6c", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda635911-c5", "ovs_interfaceid": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5df4424a-150b-46a2-9cb6-7ea251a2e306 req-b0b92a1a-2ea3-4eb7-88f4-51e4dd5f541d service nova] Acquired lock "refresh_cache-dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.network.neutron [req-5df4424a-150b-46a2-9cb6-7ea251a2e306 req-b0b92a1a-2ea3-4eb7-88f4-51e4dd5f541d service nova] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Refreshing network info cache for port da635911-c5a6-4a05-a14f-f19d94a6e6fd {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Start _get_guest_xml network_info=[{"id": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "address": "fa:16:3e:1c:18:6c", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda635911-c5", "ovs_interfaceid": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:38:23 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:38:23 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1956793021',display_name='tempest-ServersNegativeTestJSON-server-1956793021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1956793021',id=39,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fc1a673644b4227a3b00fcd84a68207',ramdisk_id='',reservation_id='r-t4z2v6cv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-704417429',owner_user_name='tempest-ServersNegativeTestJSON-704417429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:38:22Z,user_data=None,user_id='9a13b1e5b2494485aedb60ce10cdff29',uuid=dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "address": "fa:16:3e:1c:18:6c", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda635911-c5", "ovs_interfaceid": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Converting VIF {"id": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "address": "fa:16:3e:1c:18:6c", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda635911-c5", "ovs_interfaceid": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:18:6c,bridge_name='br-int',has_traffic_filtering=True,id=da635911-c5a6-4a05-a14f-f19d94a6e6fd,network=Network(3b251e44-6e92-4252-8e46-710de94e597f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda635911-c5') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.objects.instance [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lazy-loading 'pci_devices' on Instance uuid dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:38:23 user nova-compute[74776]:   <uuid>dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9</uuid>
Nov 22 14:38:23 user nova-compute[74776]:   <name>instance-00000027</name>
Nov 22 14:38:23 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:38:23 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:38:23 user nova-compute[74776]:   <metadata>
Nov 22 14:38:23 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:38:23 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:38:23 user nova-compute[74776]:       <nova:name>tempest-ServersNegativeTestJSON-server-1956793021</nova:name>
Nov 22 14:38:23 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:38:23</nova:creationTime>
Nov 22 14:38:23 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:38:23 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:38:23 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:38:23 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:38:23 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:38:23 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:38:23 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:38:23 user nova-compute[74776]:       <nova:owner>
Nov 22 14:38:23 user nova-compute[74776]:         <nova:user uuid="9a13b1e5b2494485aedb60ce10cdff29">tempest-ServersNegativeTestJSON-704417429-project-member</nova:user>
Nov 22 14:38:23 user nova-compute[74776]:         <nova:project uuid="9fc1a673644b4227a3b00fcd84a68207">tempest-ServersNegativeTestJSON-704417429</nova:project>
Nov 22 14:38:23 user nova-compute[74776]:       </nova:owner>
Nov 22 14:38:23 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:38:23 user nova-compute[74776]:       <nova:ports>
Nov 22 14:38:23 user nova-compute[74776]:         <nova:port uuid="da635911-c5a6-4a05-a14f-f19d94a6e6fd">
Nov 22 14:38:23 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 22 14:38:23 user nova-compute[74776]:         </nova:port>
Nov 22 14:38:23 user nova-compute[74776]:       </nova:ports>
Nov 22 14:38:23 user nova-compute[74776]:     </nova:instance>
Nov 22 14:38:23 user nova-compute[74776]:   </metadata>
Nov 22 14:38:23 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:38:23 user nova-compute[74776]:     <system>
Nov 22 14:38:23 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:38:23 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:38:23 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:38:23 user nova-compute[74776]:       <entry name="serial">dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9</entry>
Nov 22 14:38:23 user nova-compute[74776]:       <entry name="uuid">dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9</entry>
Nov 22 14:38:23 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:38:23 user nova-compute[74776]:     </system>
Nov 22 14:38:23 user nova-compute[74776]:   </sysinfo>
Nov 22 14:38:23 user nova-compute[74776]:   <os>
Nov 22 14:38:23 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:38:23 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:38:23 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:38:23 user nova-compute[74776]:   </os>
Nov 22 14:38:23 user nova-compute[74776]:   <features>
Nov 22 14:38:23 user nova-compute[74776]:     <acpi/>
Nov 22 14:38:23 user nova-compute[74776]:     <apic/>
Nov 22 14:38:23 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:38:23 user nova-compute[74776]:   </features>
Nov 22 14:38:23 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:38:23 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:38:23 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:38:23 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:38:23 user nova-compute[74776]:   </clock>
Nov 22 14:38:23 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:38:23 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:38:23 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:38:23 user nova-compute[74776]:   </cpu>
Nov 22 14:38:23 user nova-compute[74776]:   <devices>
Nov 22 14:38:23 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:38:23 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:38:23 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk"/>
Nov 22 14:38:23 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:38:23 user nova-compute[74776]:     </disk>
Nov 22 14:38:23 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:38:23 user nova-compute[74776]:       <mac address="fa:16:3e:1c:18:6c"/>
Nov 22 14:38:23 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:38:23 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:38:23 user nova-compute[74776]:       <target dev="tapda635911-c5"/>
Nov 22 14:38:23 user nova-compute[74776]:     </interface>
Nov 22 14:38:23 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:38:23 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/console.log" append="off"/>
Nov 22 14:38:23 user nova-compute[74776]:     </serial>
Nov 22 14:38:23 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:38:23 user nova-compute[74776]:     <video>
Nov 22 14:38:23 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:38:23 user nova-compute[74776]:     </video>
Nov 22 14:38:23 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:38:23 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:38:23 user nova-compute[74776]:     </rng>
Nov 22 14:38:23 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:38:23 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:38:23 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:38:23 user nova-compute[74776]:     </memballoon>
Nov 22 14:38:23 user nova-compute[74776]:   </devices>
Nov 22 14:38:23 user nova-compute[74776]: </domain>
Nov 22 14:38:23 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1956793021',display_name='tempest-ServersNegativeTestJSON-server-1956793021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1956793021',id=39,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fc1a673644b4227a3b00fcd84a68207',ramdisk_id='',reservation_id='r-t4z2v6cv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-704417429',owner_user_name='tempest-ServersNegativeTestJSON-704417429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:38:22Z,user_data=None,user_id='9a13b1e5b2494485aedb60ce10cdff29',uuid=dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "address": "fa:16:3e:1c:18:6c", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda635911-c5", "ovs_interfaceid": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Converting VIF {"id": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "address": "fa:16:3e:1c:18:6c", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda635911-c5", "ovs_interfaceid": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:18:6c,bridge_name='br-int',has_traffic_filtering=True,id=da635911-c5a6-4a05-a14f-f19d94a6e6fd,network=Network(3b251e44-6e92-4252-8e46-710de94e597f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda635911-c5') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG os_vif [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:18:6c,bridge_name='br-int',has_traffic_filtering=True,id=da635911-c5a6-4a05-a14f-f19d94a6e6fd,network=Network(3b251e44-6e92-4252-8e46-710de94e597f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda635911-c5') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b2e1788-6e0e-544d-b688-169fd550b711', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda635911-c5, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda635911-c5, col_values=(('qos', UUID('e7641622-ef49-4185-9f0b-b1ffc9f30a59')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda635911-c5, col_values=(('external_ids', {'iface-id': 'da635911-c5a6-4a05-a14f-f19d94a6e6fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:18:6c', 'vm-uuid': 'dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:23 user nova-compute[74776]: INFO os_vif [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:18:6c,bridge_name='br-int',has_traffic_filtering=True,id=da635911-c5a6-4a05-a14f-f19d94a6e6fd,network=Network(3b251e44-6e92-4252-8e46-710de94e597f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda635911-c5')
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] No VIF found with MAC fa:16:3e:1c:18:6c, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.network.neutron [req-5df4424a-150b-46a2-9cb6-7ea251a2e306 req-b0b92a1a-2ea3-4eb7-88f4-51e4dd5f541d service nova] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Updated VIF entry in instance network info cache for port da635911-c5a6-4a05-a14f-f19d94a6e6fd. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG nova.network.neutron [req-5df4424a-150b-46a2-9cb6-7ea251a2e306 req-b0b92a1a-2ea3-4eb7-88f4-51e4dd5f541d service nova] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Updating instance_info_cache with network_info: [{"id": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "address": "fa:16:3e:1c:18:6c", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda635911-c5", "ovs_interfaceid": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5df4424a-150b-46a2-9cb6-7ea251a2e306 req-b0b92a1a-2ea3-4eb7-88f4-51e4dd5f541d service nova] Releasing lock "refresh_cache-dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:38:23 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:38:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-dd30ee91-7fb6-4782-9bc3-f087b111e6d0 req-09918393-7c72-49da-a6bc-7a1d1481349d service nova] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Received event network-vif-plugged-da635911-c5a6-4a05-a14f-f19d94a6e6fd {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:38:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dd30ee91-7fb6-4782-9bc3-f087b111e6d0 req-09918393-7c72-49da-a6bc-7a1d1481349d service nova] Acquiring lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:38:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dd30ee91-7fb6-4782-9bc3-f087b111e6d0 req-09918393-7c72-49da-a6bc-7a1d1481349d service nova] Lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:38:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dd30ee91-7fb6-4782-9bc3-f087b111e6d0 req-09918393-7c72-49da-a6bc-7a1d1481349d service nova] Lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:38:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-dd30ee91-7fb6-4782-9bc3-f087b111e6d0 req-09918393-7c72-49da-a6bc-7a1d1481349d service nova] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] No waiting events found dispatching network-vif-plugged-da635911-c5a6-4a05-a14f-f19d94a6e6fd {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:38:24 user nova-compute[74776]: WARNING nova.compute.manager [req-dd30ee91-7fb6-4782-9bc3-f087b111e6d0 req-09918393-7c72-49da-a6bc-7a1d1481349d service nova] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Received unexpected event network-vif-plugged-da635911-c5a6-4a05-a14f-f19d94a6e6fd for instance with vm_state building and task_state spawning.
Nov 22 14:38:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:25 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:38:25 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:38:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-bc98341b-ca28-4097-9887-16c8e8d7f9f7" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:38:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-bc98341b-ca28-4097-9887-16c8e8d7f9f7" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:38:25 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:38:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:26 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Updating instance_info_cache with network_info: [{"id": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "address": "fa:16:3e:5f:fc:12", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cec0cf0-89", "ovs_interfaceid": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:38:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-bc98341b-ca28-4097-9887-16c8e8d7f9f7" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:38:26 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:38:26 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:38:26 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:38:26 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Instance spawned successfully.
Nov 22 14:38:26 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:38:26 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:38:26 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:38:26 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:38:26 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:38:26 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:38:26 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:38:26 user nova-compute[74776]: INFO nova.compute.manager [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 22 14:38:26 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:38:26 user nova-compute[74776]: INFO nova.compute.manager [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Took 5.91 seconds to build instance.
Nov 22 14:38:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a401d4f8-f073-4a4b-b89d-11c5823eeaf7 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.024s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:38:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-280210d3-955b-4774-961b-7a7c3c586099 req-ee02618b-b83b-44d1-a10d-61afed4b3746 service nova] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Received event network-vif-plugged-da635911-c5a6-4a05-a14f-f19d94a6e6fd {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:38:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-280210d3-955b-4774-961b-7a7c3c586099 req-ee02618b-b83b-44d1-a10d-61afed4b3746 service nova] Acquiring lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:38:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-280210d3-955b-4774-961b-7a7c3c586099 req-ee02618b-b83b-44d1-a10d-61afed4b3746 service nova] Lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:38:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-280210d3-955b-4774-961b-7a7c3c586099 req-ee02618b-b83b-44d1-a10d-61afed4b3746 service nova] Lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:38:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-280210d3-955b-4774-961b-7a7c3c586099 req-ee02618b-b83b-44d1-a10d-61afed4b3746 service nova] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] No waiting events found dispatching network-vif-plugged-da635911-c5a6-4a05-a14f-f19d94a6e6fd {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:38:26 user nova-compute[74776]: WARNING nova.compute.manager [req-280210d3-955b-4774-961b-7a7c3c586099 req-ee02618b-b83b-44d1-a10d-61afed4b3746 service nova] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Received unexpected event network-vif-plugged-da635911-c5a6-4a05-a14f-f19d94a6e6fd for instance with vm_state active and task_state None.
Nov 22 14:38:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:28 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:38:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:38:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:38:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:38:28 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:38:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:38:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:38:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:38:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fdd07c-7e30-449f-95c4-8c2560d760e1/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fdd07c-7e30-449f-95c4-8c2560d760e1/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fdd07c-7e30-449f-95c4-8c2560d760e1/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fdd07c-7e30-449f-95c4-8c2560d760e1/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:31 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:38:31 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:38:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8298MB free_disk=24.842926025390625GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:38:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:38:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:38:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f4f30fe7-b234-4f81-b081-3214f5ebe789 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:38:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance bc98341b-ca28-4097-9887-16c8e8d7f9f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:38:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 7819c3bf-bf3e-4012-8fcc-19226486de8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:38:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:38:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance a0fdd07c-7e30-449f-95c4-8c2560d760e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:38:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance c392a863-0d2f-492f-992d-13b21ebd385e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:38:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:38:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:38:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:38:31 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:38:31 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:38:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:38:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:38:33 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:38:33 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:38:33 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:38:33 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:38:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:38:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:39 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:38:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:41 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f is timed out.
Nov 22 14:38:41 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Successfully detached device vdb from instance 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f from the live domain config.
Nov 22 14:38:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qIwajlOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:38:41 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:38:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a471743-9401-4ee7-bae2-05f6fdd98c95]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:38:41 user nova-compute[74776]: No targets found.
Nov 22 14:38:41 user nova-compute[74776]: iSNS:
Nov 22 14:38:41 user nova-compute[74776]: No targets found.
Nov 22 14:38:41 user nova-compute[74776]: STATIC:
Nov 22 14:38:41 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e
Nov 22 14:38:41 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:38:41 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:38:41 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261
Nov 22 14:38:41 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:38:41 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:38:41 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a
Nov 22 14:38:41 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:38:41 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:38:41 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f
Nov 22 14:38:41 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:38:41 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:38:41 user nova-compute[74776]: FIRMWARE:
Nov 22 14:38:41 user nova-compute[74776]: No targets found.
Nov 22 14:38:41 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:38:41 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:38:41 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad740559-1b5a-4242-ae4f-011e3f1ec7d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f3da3b-3fbe-4ec0-9069-cc3871f5b4ba]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:38:41 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:38:41 user nova-compute[74776]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f (non-flash)
Nov 22 14:38:41 user nova-compute[74776]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e (non-flash)
Nov 22 14:38:41 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:38:41 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:38:41 user nova-compute[74776]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f (non-flash)
Nov 22 14:38:41 user nova-compute[74776]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e (non-flash)
Nov 22 14:38:41 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c78418550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f'): ({'sdd'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Removing single pathed devices sdd {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbc9511-2d9b-4814-a053-bb314fa43c96]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de0ae59-c7f3-4f71-9ef7-3d6e5bc5b2db]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Flushing IO for device /dev/sdd {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d22a9c-2090-4f28-a0e9-44afffb4b7b9]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd982f1-a34e-470c-b1d0-445ac2f2513a]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] SCSI volumes sdd have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1539460d-e0f7-455e-858b-6ea3ebcaac62]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bb0883-b317-475e-b227-ecf337da47d4]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f, portal: 172.16.0.220,3260]
Nov 22 14:38:41 user nova-compute[74776]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f, portal: 172.16.0.220,3260] successful.
Nov 22 14:38:41 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bba3b594-2372-4955-8321-721b6aad454f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c709ecd-5584-43d2-8735-dab1d234159c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] <== disconnect_volume: return (315ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:38:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:38:42 user nova-compute[74776]: DEBUG nova.objects.instance [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lazy-loading 'flavor' on Instance uuid 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:38:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-00327b4a-ccfe-407e-82b8-3d299c4d0786 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.699s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:38:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:38:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:39:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:39:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:39:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:39:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:39:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:39:14 user nova-compute[74776]: INFO nova.compute.manager [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Terminating instance
Nov 22 14:39:14 user nova-compute[74776]: DEBUG nova.compute.manager [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:39:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-a5228a81-3fe8-4234-aeb4-42d242d8942b req-b4954001-6878-4fd6-acbc-6c5bf46225a8 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received event network-vif-unplugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:39:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-a5228a81-3fe8-4234-aeb4-42d242d8942b req-b4954001-6878-4fd6-acbc-6c5bf46225a8 service nova] Acquiring lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:39:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-a5228a81-3fe8-4234-aeb4-42d242d8942b req-b4954001-6878-4fd6-acbc-6c5bf46225a8 service nova] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:39:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-a5228a81-3fe8-4234-aeb4-42d242d8942b req-b4954001-6878-4fd6-acbc-6c5bf46225a8 service nova] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:39:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-a5228a81-3fe8-4234-aeb4-42d242d8942b req-b4954001-6878-4fd6-acbc-6c5bf46225a8 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] No waiting events found dispatching network-vif-unplugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:39:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-a5228a81-3fe8-4234-aeb4-42d242d8942b req-b4954001-6878-4fd6-acbc-6c5bf46225a8 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received event network-vif-unplugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:39:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:15 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Instance destroyed successfully.
Nov 22 14:39:15 user nova-compute[74776]: DEBUG nova.objects.instance [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lazy-loading 'resources' on Instance uuid 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:39:15 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:34:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1228269153',display_name='tempest-TestMinimumBasicScenario-server-1228269153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1228269153',id=35,image_ref='b123b10e-b6aa-4ea6-a79b-d2575d9b405a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTCF9EILD4y6IxcYrKKP5EsDB3J0Ac9qEcBJ1MGNXhPb9I02DjoR2D/ekN6rgAkY7TQh7As7M1I3eax87VWaSOCBTNo7YLLObmL4ktL9UrqROnSdIC1Boo2itlj4OTSDg==',key_name='tempest-TestMinimumBasicScenario-1238686472',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:34:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2602b8e7e2414a3d88d18f9f0c973ab5',ramdisk_id='',reservation_id='r-t0tas7za',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b123b10e-b6aa-4ea6-a79b-d2575d9b405a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1122910147',owner_user_name='tempest-TestMinimumBasicScenario-1122910147-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:36:37Z,user_data=None,user_id='aac47c7fc2fc4380a5673117151dbdb0',uuid=25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "address": "fa:16:3e:68:f0:28", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73b0b93-84", "ovs_interfaceid": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:39:15 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Converting VIF {"id": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "address": "fa:16:3e:68:f0:28", "network": {"id": "9ede03a9-ae5e-43f2-9865-595667d6d899", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-684064937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2602b8e7e2414a3d88d18f9f0c973ab5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73b0b93-84", "ovs_interfaceid": "e73b0b93-8497-4bf9-8149-c5c640ff6253", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:39:15 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:f0:28,bridge_name='br-int',has_traffic_filtering=True,id=e73b0b93-8497-4bf9-8149-c5c640ff6253,network=Network(9ede03a9-ae5e-43f2-9865-595667d6d899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73b0b93-84') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:39:15 user nova-compute[74776]: DEBUG os_vif [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:f0:28,bridge_name='br-int',has_traffic_filtering=True,id=e73b0b93-8497-4bf9-8149-c5c640ff6253,network=Network(9ede03a9-ae5e-43f2-9865-595667d6d899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73b0b93-84') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:39:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape73b0b93-84, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:39:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:39:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e26ec9b4-085d-4eb9-bcb2-18f65c77aaf4) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:39:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:39:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:15 user nova-compute[74776]: INFO os_vif [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:f0:28,bridge_name='br-int',has_traffic_filtering=True,id=e73b0b93-8497-4bf9-8149-c5c640ff6253,network=Network(9ede03a9-ae5e-43f2-9865-595667d6d899),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73b0b93-84')
Nov 22 14:39:15 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Deleting instance files /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f_del
Nov 22 14:39:15 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Deletion of /opt/stack/data/nova/instances/25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f_del complete
Nov 22 14:39:15 user nova-compute[74776]: INFO nova.compute.manager [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 22 14:39:15 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:39:15 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:39:15 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:39:16 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:39:16 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Took 0.49 seconds to deallocate network for instance.
Nov 22 14:39:16 user nova-compute[74776]: DEBUG nova.compute.manager [req-c4b3f461-8c38-42eb-83c9-44e48270aa1a req-0341f490-b749-4e4d-ae49-c212cdccc701 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received event network-vif-deleted-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:39:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:39:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:39:16 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:39:16 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:39:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:39:16 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Deleted allocations for instance 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f
Nov 22 14:39:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-60a43772-fa03-4015-86a4-c3be71c814b5 tempest-TestMinimumBasicScenario-1122910147 tempest-TestMinimumBasicScenario-1122910147-project-member] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.813s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:39:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-b69dd570-edaa-4784-8251-60846bfe381b req-56aa1f15-6835-4fb3-ba56-69e49615c6b5 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received event network-vif-plugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:39:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b69dd570-edaa-4784-8251-60846bfe381b req-56aa1f15-6835-4fb3-ba56-69e49615c6b5 service nova] Acquiring lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:39:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b69dd570-edaa-4784-8251-60846bfe381b req-56aa1f15-6835-4fb3-ba56-69e49615c6b5 service nova] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:39:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b69dd570-edaa-4784-8251-60846bfe381b req-56aa1f15-6835-4fb3-ba56-69e49615c6b5 service nova] Lock "25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:39:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-b69dd570-edaa-4784-8251-60846bfe381b req-56aa1f15-6835-4fb3-ba56-69e49615c6b5 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] No waiting events found dispatching network-vif-plugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:39:17 user nova-compute[74776]: WARNING nova.compute.manager [req-b69dd570-edaa-4784-8251-60846bfe381b req-56aa1f15-6835-4fb3-ba56-69e49615c6b5 service nova] [instance: 25a7d3d2-43ab-459f-bbf0-fbd0e4dd185f] Received unexpected event network-vif-plugged-e73b0b93-8497-4bf9-8149-c5c640ff6253 for instance with vm_state deleted and task_state None.
Nov 22 14:39:18 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:39:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:23 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:39:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:25 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:39:25 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:39:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-7819c3bf-bf3e-4012-8fcc-19226486de8e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:39:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-7819c3bf-bf3e-4012-8fcc-19226486de8e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:39:25 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:39:26 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Updating instance_info_cache with network_info: [{"id": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "address": "fa:16:3e:55:20:d3", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b0593b-ed", "ovs_interfaceid": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:39:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-7819c3bf-bf3e-4012-8fcc-19226486de8e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:39:26 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:39:26 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:39:29 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:39:29 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:39:29 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:39:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:39:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:39:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:39:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:39:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:39:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:39:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:39:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:39:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:39:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:39:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:39:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:39:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:39:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:39:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:39:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:39:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:39:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:39:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:39:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:39:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:39:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:39:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:39:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:39:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fdd07c-7e30-449f-95c4-8c2560d760e1/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:39:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fdd07c-7e30-449f-95c4-8c2560d760e1/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:39:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fdd07c-7e30-449f-95c4-8c2560d760e1/disk.rescue --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:39:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0fdd07c-7e30-449f-95c4-8c2560d760e1/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:39:32 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:39:32 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:39:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8489MB free_disk=24.83031463623047GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:39:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:39:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:39:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f4f30fe7-b234-4f81-b081-3214f5ebe789 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:39:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance bc98341b-ca28-4097-9887-16c8e8d7f9f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:39:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 7819c3bf-bf3e-4012-8fcc-19226486de8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:39:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance a0fdd07c-7e30-449f-95c4-8c2560d760e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:39:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance c392a863-0d2f-492f-992d-13b21ebd385e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:39:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:39:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:39:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:39:32 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:39:32 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:39:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:39:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.359s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:39:34 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:39:34 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:39:34 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:39:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:39:36 user nova-compute[74776]: INFO nova.compute.manager [None req-18d5f2e3-bc80-4f67-88d0-15f424c2fcb6 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Unrescuing
Nov 22 14:39:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-18d5f2e3-bc80-4f67-88d0-15f424c2fcb6 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "refresh_cache-a0fdd07c-7e30-449f-95c4-8c2560d760e1" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:39:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-18d5f2e3-bc80-4f67-88d0-15f424c2fcb6 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquired lock "refresh_cache-a0fdd07c-7e30-449f-95c4-8c2560d760e1" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:39:36 user nova-compute[74776]: DEBUG nova.network.neutron [None req-18d5f2e3-bc80-4f67-88d0-15f424c2fcb6 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:39:36 user nova-compute[74776]: DEBUG nova.network.neutron [None req-18d5f2e3-bc80-4f67-88d0-15f424c2fcb6 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Updating instance_info_cache with network_info: [{"id": "bd8f1cd4-9030-4326-946d-380263be6dca", "address": "fa:16:3e:6c:d1:a2", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8f1cd4-90", "ovs_interfaceid": "bd8f1cd4-9030-4326-946d-380263be6dca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:39:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-18d5f2e3-bc80-4f67-88d0-15f424c2fcb6 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Releasing lock "refresh_cache-a0fdd07c-7e30-449f-95c4-8c2560d760e1" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:39:36 user nova-compute[74776]: DEBUG nova.objects.instance [None req-18d5f2e3-bc80-4f67-88d0-15f424c2fcb6 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'flavor' on Instance uuid a0fdd07c-7e30-449f-95c4-8c2560d760e1 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:39:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:37 user nova-compute[74776]: DEBUG nova.compute.manager [req-f475dc9b-a765-4032-a0ac-e5eca511f82a req-14d274cb-92d6-41e1-9d46-fa1314a3867e service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received event network-vif-unplugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:39:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f475dc9b-a765-4032-a0ac-e5eca511f82a req-14d274cb-92d6-41e1-9d46-fa1314a3867e service nova] Acquiring lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:39:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f475dc9b-a765-4032-a0ac-e5eca511f82a req-14d274cb-92d6-41e1-9d46-fa1314a3867e service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:39:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f475dc9b-a765-4032-a0ac-e5eca511f82a req-14d274cb-92d6-41e1-9d46-fa1314a3867e service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:39:37 user nova-compute[74776]: DEBUG nova.compute.manager [req-f475dc9b-a765-4032-a0ac-e5eca511f82a req-14d274cb-92d6-41e1-9d46-fa1314a3867e service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] No waiting events found dispatching network-vif-unplugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:39:37 user nova-compute[74776]: WARNING nova.compute.manager [req-f475dc9b-a765-4032-a0ac-e5eca511f82a req-14d274cb-92d6-41e1-9d46-fa1314a3867e service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received unexpected event network-vif-unplugged-bd8f1cd4-9030-4326-946d-380263be6dca for instance with vm_state rescued and task_state unrescuing.
Nov 22 14:39:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:37 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Instance destroyed successfully.
Nov 22 14:39:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-1d4e241d-51d0-4232-8ff7-3a2f64316399 req-94449975-391d-4976-b01c-1d7f5114ce50 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received event network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:39:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1d4e241d-51d0-4232-8ff7-3a2f64316399 req-94449975-391d-4976-b01c-1d7f5114ce50 service nova] Acquiring lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:39:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1d4e241d-51d0-4232-8ff7-3a2f64316399 req-94449975-391d-4976-b01c-1d7f5114ce50 service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:39:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1d4e241d-51d0-4232-8ff7-3a2f64316399 req-94449975-391d-4976-b01c-1d7f5114ce50 service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:39:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-1d4e241d-51d0-4232-8ff7-3a2f64316399 req-94449975-391d-4976-b01c-1d7f5114ce50 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] No waiting events found dispatching network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:39:39 user nova-compute[74776]: WARNING nova.compute.manager [req-1d4e241d-51d0-4232-8ff7-3a2f64316399 req-94449975-391d-4976-b01c-1d7f5114ce50 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received unexpected event network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca for instance with vm_state rescued and task_state unrescuing.
Nov 22 14:39:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-1d4e241d-51d0-4232-8ff7-3a2f64316399 req-94449975-391d-4976-b01c-1d7f5114ce50 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received event network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:39:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1d4e241d-51d0-4232-8ff7-3a2f64316399 req-94449975-391d-4976-b01c-1d7f5114ce50 service nova] Acquiring lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:39:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1d4e241d-51d0-4232-8ff7-3a2f64316399 req-94449975-391d-4976-b01c-1d7f5114ce50 service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:39:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1d4e241d-51d0-4232-8ff7-3a2f64316399 req-94449975-391d-4976-b01c-1d7f5114ce50 service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:39:39 user nova-compute[74776]: DEBUG nova.compute.manager [req-1d4e241d-51d0-4232-8ff7-3a2f64316399 req-94449975-391d-4976-b01c-1d7f5114ce50 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] No waiting events found dispatching network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:39:39 user nova-compute[74776]: WARNING nova.compute.manager [req-1d4e241d-51d0-4232-8ff7-3a2f64316399 req-94449975-391d-4976-b01c-1d7f5114ce50 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received unexpected event network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca for instance with vm_state rescued and task_state unrescuing.
Nov 22 14:39:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:41 user nova-compute[74776]: DEBUG nova.compute.manager [None req-18d5f2e3-bc80-4f67-88d0-15f424c2fcb6 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:39:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-a456587e-9899-443c-84e4-4e24669d4e1a req-ebdf3235-ad2f-4792-926e-c93198f4b555 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received event network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:39:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-a456587e-9899-443c-84e4-4e24669d4e1a req-ebdf3235-ad2f-4792-926e-c93198f4b555 service nova] Acquiring lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:39:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-a456587e-9899-443c-84e4-4e24669d4e1a req-ebdf3235-ad2f-4792-926e-c93198f4b555 service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:39:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-a456587e-9899-443c-84e4-4e24669d4e1a req-ebdf3235-ad2f-4792-926e-c93198f4b555 service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:39:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-a456587e-9899-443c-84e4-4e24669d4e1a req-ebdf3235-ad2f-4792-926e-c93198f4b555 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] No waiting events found dispatching network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:39:41 user nova-compute[74776]: WARNING nova.compute.manager [req-a456587e-9899-443c-84e4-4e24669d4e1a req-ebdf3235-ad2f-4792-926e-c93198f4b555 service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received unexpected event network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca for instance with vm_state active and task_state None.
Nov 22 14:39:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:39:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:09 user nova-compute[74776]: DEBUG nova.objects.instance [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'flavor' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:40:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "refresh_cache-c392a863-0d2f-492f-992d-13b21ebd385e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:40:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquired lock "refresh_cache-c392a863-0d2f-492f-992d-13b21ebd385e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:40:09 user nova-compute[74776]: DEBUG nova.network.neutron [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:40:09 user nova-compute[74776]: DEBUG nova.objects.instance [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'info_cache' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:40:09 user nova-compute[74776]: DEBUG nova.objects.base [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Object Instance<c392a863-0d2f-492f-992d-13b21ebd385e> lazy-loaded attributes: flavor,info_cache {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.network.neutron [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Updating instance_info_cache with network_info: [{"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Releasing lock "refresh_cache-c392a863-0d2f-492f-992d-13b21ebd385e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:40:10 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Instance destroyed successfully.
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.objects.instance [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'resources' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.objects.base [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Object Instance<c392a863-0d2f-492f-992d-13b21ebd385e> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1939367355',display_name='tempest-AttachVolumeTestJSON-server-1939367355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1939367355',id=38,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuY5HJNrsYIY3niBmAsaghDVb+I+PBVWqd4MNCFlVINDMvlQLejGFXaXFFq/GrQzsAXjCAdhFS5NiuyPPLqWUQW2pA/3La+hbQ6NADZBNvomwBj1xOQ0pH4ACvIkEkbcw==',key_name='tempest-keypair-1181685632',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:36:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='801e8ed62c734be5945d8fbf307aa1d2',ramdisk_id='',reservation_id='r-d95rnpuu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1546562861',owner_user_name='tempest-AttachVolumeTestJSON-1546562861-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:38:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2494e8b489ea48f1a6b3b19eb87b6306',uuid=c392a863-0d2f-492f-992d-13b21ebd385e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converting VIF {"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:95:20,bridge_name='br-int',has_traffic_filtering=True,id=365c5ef1-7abf-4102-a6aa-be03a4f325f2,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365c5ef1-7a') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_vif [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:95:20,bridge_name='br-int',has_traffic_filtering=True,id=365c5ef1-7abf-4102-a6aa-be03a4f325f2,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365c5ef1-7a') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap365c5ef1-7a, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd2f8a5d-5db3-46ee-93dd-5b404561079e) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:10 user nova-compute[74776]: INFO os_vif [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:95:20,bridge_name='br-int',has_traffic_filtering=True,id=365c5ef1-7abf-4102-a6aa-be03a4f325f2,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365c5ef1-7a')
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EStVPghu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:40:10 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4eaf7b-c6ba-4fcd-b83f-54e2cc72c6c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:40:10 user nova-compute[74776]: No targets found.
Nov 22 14:40:10 user nova-compute[74776]: iSNS:
Nov 22 14:40:10 user nova-compute[74776]: No targets found.
Nov 22 14:40:10 user nova-compute[74776]: STATIC:
Nov 22 14:40:10 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e
Nov 22 14:40:10 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:40:10 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:40:10 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261
Nov 22 14:40:10 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:40:10 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:40:10 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a
Nov 22 14:40:10 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:40:10 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:40:10 user nova-compute[74776]: FIRMWARE:
Nov 22 14:40:10 user nova-compute[74776]: No targets found.
Nov 22 14:40:10 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:40:10 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:40:10 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ff91f9-3c6e-41d7-9896-627971d68d14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcbe029-b6d6-4957-9446-381f423c9d43]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:40:10 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:40:10 user nova-compute[74776]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e (non-flash)
Nov 22 14:40:10 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:40:10 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:40:10 user nova-compute[74776]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e (non-flash)
Nov 22 14:40:10 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c582500d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e'): ({'sde'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Removing single pathed devices sde {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cf9610-5f8a-4623-8c7a-6cfc0087cb58]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a914c075-0da5-4bef-becc-d3a32cae1e52]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Flushing IO for device /dev/sde {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4ccf67-1884-4cf9-8478-391e52374c0c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e258fd-5c4f-4c8b-b51d-1870992b3cfd]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] SCSI volumes sde have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0bd8ae-576f-4349-8db9-8aac251f03dc]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e544b0-74b1-44bd-9384-552ed55cb5fe]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e, portal: 172.16.0.220,3260]
Nov 22 14:40:10 user nova-compute[74776]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e, portal: 172.16.0.220,3260] successful.
Nov 22 14:40:10 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a70a68a-98d8-4f01-8b04-a40140b4ffb5]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] <== disconnect_volume: return (294ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Start _get_guest_xml network_info=[{"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0052f1eb-0b8e-43b2-8f2b-d968348e138f', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EStVPghu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'c392a863-0d2f-492f-992d-13b21ebd385e', 'attached_at': '', 'detached_at': '', 'volume_id': '63f308c1-ecd0-4675-9d75-ec247693f59e', 'serial': '63f308c1-ecd0-4675-9d75-ec247693f59e'}, 'boot_index': None, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.objects.instance [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'numa_topology' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.objects.base [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Object Instance<c392a863-0d2f-492f-992d-13b21ebd385e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:40:10 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:40:10 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.objects.instance [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'vcpu_model' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.objects.base [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Object Instance<c392a863-0d2f-492f-992d-13b21ebd385e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EStVPghu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:40:10 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:40:10 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:40:10 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcea4c09-815b-4283-86e9-1749889499ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:40:10 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8d0d1b-b012-4b0c-8691-daa35536209f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e] added
Nov 22 14:40:10 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[addd6aeb-b636-4aa9-bbbb-014ccfabfcde]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a899442-3056-482c-9877-f34abf8fb7d1]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EStVPghu {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EStVPghu" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb777429-c990-4f8f-b773-eed683008ead]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EStVPghu'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b02c528-3a0d-410b-af48-01bf047051f1]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3c7d68-f5aa-45ce-a116-8a65e115abc0]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:40:10 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:40:10 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:40:10 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:40:10 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce85f98-eef0-4458-a1e5-30051d32117a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e, portal: 172.16.0.220,3260]
Nov 22 14:40:10 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e, portal: 172.16.0.220,3260] successful.
Nov 22 14:40:10 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bc3139-1f44-46a9-a1e2-a34340b39947]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[014d564a-7d5c-4cd2-a7ee-ee648f9668bf]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:40:10 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:40:10 user nova-compute[74776]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e (non-flash)
Nov 22 14:40:10 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:40:10 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:40:10 user nova-compute[74776]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e (non-flash)
Nov 22 14:40:10 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd628f8-77e4-4bfa-85d1-faf7e2cd39be]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EStVPghu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:40:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Acquiring lock "01694067-eade-44d4-9866-c8c2a1cf412b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:40:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "01694067-eade-44d4-9866-c8c2a1cf412b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:40:11 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:40:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:40:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:40:11 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:40:11 user nova-compute[74776]: INFO nova.compute.claims [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Claim successful on node user
Nov 22 14:40:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:40:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23866643033643864', 'path': '/dev/sdd'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:40:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866643033643864', 'path': '/dev/sdd'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:40:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1939367355',display_name='tempest-AttachVolumeTestJSON-server-1939367355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1939367355',id=38,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuY5HJNrsYIY3niBmAsaghDVb+I+PBVWqd4MNCFlVINDMvlQLejGFXaXFFq/GrQzsAXjCAdhFS5NiuyPPLqWUQW2pA/3La+hbQ6NADZBNvomwBj1xOQ0pH4ACvIkEkbcw==',key_name='tempest-keypair-1181685632',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:36:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='801e8ed62c734be5945d8fbf307aa1d2',ramdisk_id='',reservation_id='r-d95rnpuu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1546562861',owner_user_name='tempest-AttachVolumeTestJSON-1546562861-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:38:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2494e8b489ea48f1a6b3b19eb87b6306',uuid=c392a863-0d2f-492f-992d-13b21ebd385e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:40:11 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converting VIF {"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:40:11 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:95:20,bridge_name='br-int',has_traffic_filtering=True,id=365c5ef1-7abf-4102-a6aa-be03a4f325f2,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365c5ef1-7a') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:40:11 user nova-compute[74776]: DEBUG nova.objects.instance [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'pci_devices' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:40:11 user nova-compute[74776]: DEBUG nova.objects.base [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Object Instance<c392a863-0d2f-492f-992d-13b21ebd385e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:40:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:40:11 user nova-compute[74776]:   <uuid>c392a863-0d2f-492f-992d-13b21ebd385e</uuid>
Nov 22 14:40:11 user nova-compute[74776]:   <name>instance-00000026</name>
Nov 22 14:40:11 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:40:11 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:40:11 user nova-compute[74776]:   <metadata>
Nov 22 14:40:11 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:40:11 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:40:11 user nova-compute[74776]:       <nova:name>tempest-AttachVolumeTestJSON-server-1939367355</nova:name>
Nov 22 14:40:11 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:40:10</nova:creationTime>
Nov 22 14:40:11 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:40:11 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:40:11 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:40:11 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:40:11 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:40:11 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:40:11 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:40:11 user nova-compute[74776]:       <nova:owner>
Nov 22 14:40:11 user nova-compute[74776]:         <nova:user uuid="2494e8b489ea48f1a6b3b19eb87b6306">tempest-AttachVolumeTestJSON-1546562861-project-member</nova:user>
Nov 22 14:40:11 user nova-compute[74776]:         <nova:project uuid="801e8ed62c734be5945d8fbf307aa1d2">tempest-AttachVolumeTestJSON-1546562861</nova:project>
Nov 22 14:40:11 user nova-compute[74776]:       </nova:owner>
Nov 22 14:40:11 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:40:11 user nova-compute[74776]:       <nova:ports>
Nov 22 14:40:11 user nova-compute[74776]:         <nova:port uuid="365c5ef1-7abf-4102-a6aa-be03a4f325f2">
Nov 22 14:40:11 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 22 14:40:11 user nova-compute[74776]:         </nova:port>
Nov 22 14:40:11 user nova-compute[74776]:       </nova:ports>
Nov 22 14:40:11 user nova-compute[74776]:     </nova:instance>
Nov 22 14:40:11 user nova-compute[74776]:   </metadata>
Nov 22 14:40:11 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:40:11 user nova-compute[74776]:     <system>
Nov 22 14:40:11 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:40:11 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:40:11 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:40:11 user nova-compute[74776]:       <entry name="serial">c392a863-0d2f-492f-992d-13b21ebd385e</entry>
Nov 22 14:40:11 user nova-compute[74776]:       <entry name="uuid">c392a863-0d2f-492f-992d-13b21ebd385e</entry>
Nov 22 14:40:11 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:40:11 user nova-compute[74776]:     </system>
Nov 22 14:40:11 user nova-compute[74776]:   </sysinfo>
Nov 22 14:40:11 user nova-compute[74776]:   <os>
Nov 22 14:40:11 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:40:11 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:40:11 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:40:11 user nova-compute[74776]:   </os>
Nov 22 14:40:11 user nova-compute[74776]:   <features>
Nov 22 14:40:11 user nova-compute[74776]:     <acpi/>
Nov 22 14:40:11 user nova-compute[74776]:     <apic/>
Nov 22 14:40:11 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:40:11 user nova-compute[74776]:   </features>
Nov 22 14:40:11 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:40:11 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:40:11 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:40:11 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:40:11 user nova-compute[74776]:   </clock>
Nov 22 14:40:11 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:40:11 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:40:11 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:40:11 user nova-compute[74776]:   </cpu>
Nov 22 14:40:11 user nova-compute[74776]:   <devices>
Nov 22 14:40:11 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:40:11 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:40:11 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk"/>
Nov 22 14:40:11 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:40:11 user nova-compute[74776]:     </disk>
Nov 22 14:40:11 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:40:11 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:40:11 user nova-compute[74776]:       <source dev="/dev/sdd"/>
Nov 22 14:40:11 user nova-compute[74776]:       <target dev="vdb" bus="virtio"/>
Nov 22 14:40:11 user nova-compute[74776]:       <serial>63f308c1-ecd0-4675-9d75-ec247693f59e</serial>
Nov 22 14:40:11 user nova-compute[74776]:     </disk>
Nov 22 14:40:11 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:40:11 user nova-compute[74776]:       <mac address="fa:16:3e:61:95:20"/>
Nov 22 14:40:11 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:40:11 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:40:11 user nova-compute[74776]:       <target dev="tap365c5ef1-7a"/>
Nov 22 14:40:11 user nova-compute[74776]:     </interface>
Nov 22 14:40:11 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:40:11 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/console.log" append="off"/>
Nov 22 14:40:11 user nova-compute[74776]:     </serial>
Nov 22 14:40:11 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:40:11 user nova-compute[74776]:     <video>
Nov 22 14:40:11 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:40:11 user nova-compute[74776]:     </video>
Nov 22 14:40:11 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:40:11 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:40:11 user nova-compute[74776]:     </rng>
Nov 22 14:40:11 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:40:11 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:40:11 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:40:11 user nova-compute[74776]:     </memballoon>
Nov 22 14:40:11 user nova-compute[74776]:   </devices>
Nov 22 14:40:11 user nova-compute[74776]: </domain>
Nov 22 14:40:11 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:40:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG nova.objects.instance [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'trusted_certs' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG nova.objects.base [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Object Instance<c392a863-0d2f-492f-992d-13b21ebd385e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG nova.network.neutron [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:40:12 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:40:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG nova.policy [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a13b1e5b2494485aedb60ce10cdff29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc1a673644b4227a3b00fcd84a68207', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.199s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:40:12 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Creating image(s)
Nov 22 14:40:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Acquiring lock "/opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "/opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "/opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Cannot resize image /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG nova.objects.instance [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'migration_context' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG nova.objects.base [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Object Instance<c392a863-0d2f-492f-992d-13b21ebd385e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1939367355',display_name='tempest-AttachVolumeTestJSON-server-1939367355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1939367355',id=38,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuY5HJNrsYIY3niBmAsaghDVb+I+PBVWqd4MNCFlVINDMvlQLejGFXaXFFq/GrQzsAXjCAdhFS5NiuyPPLqWUQW2pA/3La+hbQ6NADZBNvomwBj1xOQ0pH4ACvIkEkbcw==',key_name='tempest-keypair-1181685632',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:36:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='801e8ed62c734be5945d8fbf307aa1d2',ramdisk_id='',reservation_id='r-d95rnpuu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1546562861',owner_user_name='tempest-AttachVolumeTestJSON-1546562861-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:38:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2494e8b489ea48f1a6b3b19eb87b6306',uuid=c392a863-0d2f-492f-992d-13b21ebd385e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converting VIF {"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:95:20,bridge_name='br-int',has_traffic_filtering=True,id=365c5ef1-7abf-4102-a6aa-be03a4f325f2,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365c5ef1-7a') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG os_vif [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:95:20,bridge_name='br-int',has_traffic_filtering=True,id=365c5ef1-7abf-4102-a6aa-be03a4f325f2,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365c5ef1-7a') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0697e9ec-a934-56c0-83ca-babb9e51e3a7', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.186s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap365c5ef1-7a, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap365c5ef1-7a, col_values=(('qos', UUID('b783a107-7998-41a9-b25e-8355e73a91f5')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap365c5ef1-7a, col_values=(('external_ids', {'iface-id': '365c5ef1-7abf-4102-a6aa-be03a4f325f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:95:20', 'vm-uuid': 'c392a863-0d2f-492f-992d-13b21ebd385e'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:40:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:12 user nova-compute[74776]: INFO os_vif [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:95:20,bridge_name='br-int',has_traffic_filtering=True,id=365c5ef1-7abf-4102-a6aa-be03a4f325f2,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365c5ef1-7a')
Nov 22 14:40:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b/disk 1073741824" returned: 0 in 0.049s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG nova.network.neutron [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Successfully created port: 8b12fd4c-6135-4479-80ff-7d9535b7e08d {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.186s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Cannot resize image /opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Ensure instance console log exists: /opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG nova.network.neutron [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Successfully updated port: 8b12fd4c-6135-4479-80ff-7d9535b7e08d {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Acquiring lock "refresh_cache-01694067-eade-44d4-9866-c8c2a1cf412b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Acquired lock "refresh_cache-01694067-eade-44d4-9866-c8c2a1cf412b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG nova.network.neutron [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG nova.compute.manager [req-133e50a2-305f-4bc4-8ef3-05a15d26fb06 req-a6fb1df9-6147-47fd-bd1b-0fe77eeafa45 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Received event network-changed-8b12fd4c-6135-4479-80ff-7d9535b7e08d {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG nova.compute.manager [req-133e50a2-305f-4bc4-8ef3-05a15d26fb06 req-a6fb1df9-6147-47fd-bd1b-0fe77eeafa45 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Refreshing instance network info cache due to event network-changed-8b12fd4c-6135-4479-80ff-7d9535b7e08d. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-133e50a2-305f-4bc4-8ef3-05a15d26fb06 req-a6fb1df9-6147-47fd-bd1b-0fe77eeafa45 service nova] Acquiring lock "refresh_cache-01694067-eade-44d4-9866-c8c2a1cf412b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:40:13 user nova-compute[74776]: DEBUG nova.network.neutron [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.network.neutron [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Updating instance_info_cache with network_info: [{"id": "8b12fd4c-6135-4479-80ff-7d9535b7e08d", "address": "fa:16:3e:26:68:62", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b12fd4c-61", "ovs_interfaceid": "8b12fd4c-6135-4479-80ff-7d9535b7e08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Releasing lock "refresh_cache-01694067-eade-44d4-9866-c8c2a1cf412b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Instance network_info: |[{"id": "8b12fd4c-6135-4479-80ff-7d9535b7e08d", "address": "fa:16:3e:26:68:62", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b12fd4c-61", "ovs_interfaceid": "8b12fd4c-6135-4479-80ff-7d9535b7e08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-133e50a2-305f-4bc4-8ef3-05a15d26fb06 req-a6fb1df9-6147-47fd-bd1b-0fe77eeafa45 service nova] Acquired lock "refresh_cache-01694067-eade-44d4-9866-c8c2a1cf412b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.network.neutron [req-133e50a2-305f-4bc4-8ef3-05a15d26fb06 req-a6fb1df9-6147-47fd-bd1b-0fe77eeafa45 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Refreshing network info cache for port 8b12fd4c-6135-4479-80ff-7d9535b7e08d {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Start _get_guest_xml network_info=[{"id": "8b12fd4c-6135-4479-80ff-7d9535b7e08d", "address": "fa:16:3e:26:68:62", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b12fd4c-61", "ovs_interfaceid": "8b12fd4c-6135-4479-80ff-7d9535b7e08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:14 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:40:14 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:40:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1531996211',display_name='tempest-ServersNegativeTestJSON-server-1531996211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1531996211',id=40,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fc1a673644b4227a3b00fcd84a68207',ramdisk_id='',reservation_id='r-nmjnigep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-704417429',owner_user_name='tempest-ServersNegativeTestJSON-704417429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:40:13Z,user_data=None,user_id='9a13b1e5b2494485aedb60ce10cdff29',uuid=01694067-eade-44d4-9866-c8c2a1cf412b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b12fd4c-6135-4479-80ff-7d9535b7e08d", "address": "fa:16:3e:26:68:62", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b12fd4c-61", "ovs_interfaceid": "8b12fd4c-6135-4479-80ff-7d9535b7e08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Converting VIF {"id": "8b12fd4c-6135-4479-80ff-7d9535b7e08d", "address": "fa:16:3e:26:68:62", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b12fd4c-61", "ovs_interfaceid": "8b12fd4c-6135-4479-80ff-7d9535b7e08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:68:62,bridge_name='br-int',has_traffic_filtering=True,id=8b12fd4c-6135-4479-80ff-7d9535b7e08d,network=Network(3b251e44-6e92-4252-8e46-710de94e597f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b12fd4c-61') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.objects.instance [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lazy-loading 'pci_devices' on Instance uuid 01694067-eade-44d4-9866-c8c2a1cf412b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:40:14 user nova-compute[74776]:   <uuid>01694067-eade-44d4-9866-c8c2a1cf412b</uuid>
Nov 22 14:40:14 user nova-compute[74776]:   <name>instance-00000028</name>
Nov 22 14:40:14 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:40:14 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:40:14 user nova-compute[74776]:   <metadata>
Nov 22 14:40:14 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:40:14 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:40:14 user nova-compute[74776]:       <nova:name>tempest-ServersNegativeTestJSON-server-1531996211</nova:name>
Nov 22 14:40:14 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:40:14</nova:creationTime>
Nov 22 14:40:14 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:40:14 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:40:14 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:40:14 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:40:14 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:40:14 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:40:14 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:40:14 user nova-compute[74776]:       <nova:owner>
Nov 22 14:40:14 user nova-compute[74776]:         <nova:user uuid="9a13b1e5b2494485aedb60ce10cdff29">tempest-ServersNegativeTestJSON-704417429-project-member</nova:user>
Nov 22 14:40:14 user nova-compute[74776]:         <nova:project uuid="9fc1a673644b4227a3b00fcd84a68207">tempest-ServersNegativeTestJSON-704417429</nova:project>
Nov 22 14:40:14 user nova-compute[74776]:       </nova:owner>
Nov 22 14:40:14 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:40:14 user nova-compute[74776]:       <nova:ports>
Nov 22 14:40:14 user nova-compute[74776]:         <nova:port uuid="8b12fd4c-6135-4479-80ff-7d9535b7e08d">
Nov 22 14:40:14 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 14:40:14 user nova-compute[74776]:         </nova:port>
Nov 22 14:40:14 user nova-compute[74776]:       </nova:ports>
Nov 22 14:40:14 user nova-compute[74776]:     </nova:instance>
Nov 22 14:40:14 user nova-compute[74776]:   </metadata>
Nov 22 14:40:14 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:40:14 user nova-compute[74776]:     <system>
Nov 22 14:40:14 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:40:14 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:40:14 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:40:14 user nova-compute[74776]:       <entry name="serial">01694067-eade-44d4-9866-c8c2a1cf412b</entry>
Nov 22 14:40:14 user nova-compute[74776]:       <entry name="uuid">01694067-eade-44d4-9866-c8c2a1cf412b</entry>
Nov 22 14:40:14 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:40:14 user nova-compute[74776]:     </system>
Nov 22 14:40:14 user nova-compute[74776]:   </sysinfo>
Nov 22 14:40:14 user nova-compute[74776]:   <os>
Nov 22 14:40:14 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:40:14 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:40:14 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:40:14 user nova-compute[74776]:   </os>
Nov 22 14:40:14 user nova-compute[74776]:   <features>
Nov 22 14:40:14 user nova-compute[74776]:     <acpi/>
Nov 22 14:40:14 user nova-compute[74776]:     <apic/>
Nov 22 14:40:14 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:40:14 user nova-compute[74776]:   </features>
Nov 22 14:40:14 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:40:14 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:40:14 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:40:14 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:40:14 user nova-compute[74776]:   </clock>
Nov 22 14:40:14 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:40:14 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:40:14 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:40:14 user nova-compute[74776]:   </cpu>
Nov 22 14:40:14 user nova-compute[74776]:   <devices>
Nov 22 14:40:14 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:40:14 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:40:14 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b/disk"/>
Nov 22 14:40:14 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:40:14 user nova-compute[74776]:     </disk>
Nov 22 14:40:14 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:40:14 user nova-compute[74776]:       <mac address="fa:16:3e:26:68:62"/>
Nov 22 14:40:14 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:40:14 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:40:14 user nova-compute[74776]:       <target dev="tap8b12fd4c-61"/>
Nov 22 14:40:14 user nova-compute[74776]:     </interface>
Nov 22 14:40:14 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:40:14 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b/console.log" append="off"/>
Nov 22 14:40:14 user nova-compute[74776]:     </serial>
Nov 22 14:40:14 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:40:14 user nova-compute[74776]:     <video>
Nov 22 14:40:14 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:40:14 user nova-compute[74776]:     </video>
Nov 22 14:40:14 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:40:14 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:40:14 user nova-compute[74776]:     </rng>
Nov 22 14:40:14 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:40:14 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:40:14 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:40:14 user nova-compute[74776]:     </memballoon>
Nov 22 14:40:14 user nova-compute[74776]:   </devices>
Nov 22 14:40:14 user nova-compute[74776]: </domain>
Nov 22 14:40:14 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1531996211',display_name='tempest-ServersNegativeTestJSON-server-1531996211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1531996211',id=40,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fc1a673644b4227a3b00fcd84a68207',ramdisk_id='',reservation_id='r-nmjnigep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-704417429',owner_user_name='tempest-ServersNegativeTestJSON-704417429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:40:13Z,user_data=None,user_id='9a13b1e5b2494485aedb60ce10cdff29',uuid=01694067-eade-44d4-9866-c8c2a1cf412b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b12fd4c-6135-4479-80ff-7d9535b7e08d", "address": "fa:16:3e:26:68:62", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b12fd4c-61", "ovs_interfaceid": "8b12fd4c-6135-4479-80ff-7d9535b7e08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Converting VIF {"id": "8b12fd4c-6135-4479-80ff-7d9535b7e08d", "address": "fa:16:3e:26:68:62", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b12fd4c-61", "ovs_interfaceid": "8b12fd4c-6135-4479-80ff-7d9535b7e08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:68:62,bridge_name='br-int',has_traffic_filtering=True,id=8b12fd4c-6135-4479-80ff-7d9535b7e08d,network=Network(3b251e44-6e92-4252-8e46-710de94e597f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b12fd4c-61') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG os_vif [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:68:62,bridge_name='br-int',has_traffic_filtering=True,id=8b12fd4c-6135-4479-80ff-7d9535b7e08d,network=Network(3b251e44-6e92-4252-8e46-710de94e597f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b12fd4c-61') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b071874a-453f-5138-ba0b-295a992d3a84', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b12fd4c-61, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b12fd4c-61, col_values=(('qos', UUID('30959242-636b-46a4-a9e9-cc76696eda36')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b12fd4c-61, col_values=(('external_ids', {'iface-id': '8b12fd4c-6135-4479-80ff-7d9535b7e08d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:68:62', 'vm-uuid': '01694067-eade-44d4-9866-c8c2a1cf412b'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:14 user nova-compute[74776]: INFO os_vif [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:68:62,bridge_name='br-int',has_traffic_filtering=True,id=8b12fd4c-6135-4479-80ff-7d9535b7e08d,network=Network(3b251e44-6e92-4252-8e46-710de94e597f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b12fd4c-61')
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-e190bb67-7550-4a00-a087-05b0fe37694d req-5c3abfdd-665a-4be8-a983-7817879a486e service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e190bb67-7550-4a00-a087-05b0fe37694d req-5c3abfdd-665a-4be8-a983-7817879a486e service nova] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e190bb67-7550-4a00-a087-05b0fe37694d req-5c3abfdd-665a-4be8-a983-7817879a486e service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e190bb67-7550-4a00-a087-05b0fe37694d req-5c3abfdd-665a-4be8-a983-7817879a486e service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-e190bb67-7550-4a00-a087-05b0fe37694d req-5c3abfdd-665a-4be8-a983-7817879a486e service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] No waiting events found dispatching network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:40:14 user nova-compute[74776]: WARNING nova.compute.manager [req-e190bb67-7550-4a00-a087-05b0fe37694d req-5c3abfdd-665a-4be8-a983-7817879a486e service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received unexpected event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 for instance with vm_state stopped and task_state powering-on.
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] No VIF found with MAC fa:16:3e:26:68:62, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.network.neutron [req-133e50a2-305f-4bc4-8ef3-05a15d26fb06 req-a6fb1df9-6147-47fd-bd1b-0fe77eeafa45 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Updated VIF entry in instance network info cache for port 8b12fd4c-6135-4479-80ff-7d9535b7e08d. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG nova.network.neutron [req-133e50a2-305f-4bc4-8ef3-05a15d26fb06 req-a6fb1df9-6147-47fd-bd1b-0fe77eeafa45 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Updating instance_info_cache with network_info: [{"id": "8b12fd4c-6135-4479-80ff-7d9535b7e08d", "address": "fa:16:3e:26:68:62", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b12fd4c-61", "ovs_interfaceid": "8b12fd4c-6135-4479-80ff-7d9535b7e08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-133e50a2-305f-4bc4-8ef3-05a15d26fb06 req-a6fb1df9-6147-47fd-bd1b-0fe77eeafa45 service nova] Releasing lock "refresh_cache-01694067-eade-44d4-9866-c8c2a1cf412b" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:16 user nova-compute[74776]: DEBUG nova.compute.manager [req-313a5d4d-6223-49e9-89f6-3ff6569b8390 req-ca01383c-f3e6-4f94-9bbc-fbbac8cb9b7a service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Received event network-vif-plugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:40:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-313a5d4d-6223-49e9-89f6-3ff6569b8390 req-ca01383c-f3e6-4f94-9bbc-fbbac8cb9b7a service nova] Acquiring lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:40:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-313a5d4d-6223-49e9-89f6-3ff6569b8390 req-ca01383c-f3e6-4f94-9bbc-fbbac8cb9b7a service nova] Lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:40:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-313a5d4d-6223-49e9-89f6-3ff6569b8390 req-ca01383c-f3e6-4f94-9bbc-fbbac8cb9b7a service nova] Lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:40:16 user nova-compute[74776]: DEBUG nova.compute.manager [req-313a5d4d-6223-49e9-89f6-3ff6569b8390 req-ca01383c-f3e6-4f94-9bbc-fbbac8cb9b7a service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] No waiting events found dispatching network-vif-plugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:40:16 user nova-compute[74776]: WARNING nova.compute.manager [req-313a5d4d-6223-49e9-89f6-3ff6569b8390 req-ca01383c-f3e6-4f94-9bbc-fbbac8cb9b7a service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Received unexpected event network-vif-plugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d for instance with vm_state building and task_state spawning.
Nov 22 14:40:16 user nova-compute[74776]: DEBUG nova.compute.manager [req-dde91882-f296-4aed-8dd7-3d9cbca21f73 req-6a215e8c-4bac-491e-8c87-c977e3f3f9aa service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:40:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dde91882-f296-4aed-8dd7-3d9cbca21f73 req-6a215e8c-4bac-491e-8c87-c977e3f3f9aa service nova] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:40:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dde91882-f296-4aed-8dd7-3d9cbca21f73 req-6a215e8c-4bac-491e-8c87-c977e3f3f9aa service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:40:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-dde91882-f296-4aed-8dd7-3d9cbca21f73 req-6a215e8c-4bac-491e-8c87-c977e3f3f9aa service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:40:16 user nova-compute[74776]: DEBUG nova.compute.manager [req-dde91882-f296-4aed-8dd7-3d9cbca21f73 req-6a215e8c-4bac-491e-8c87-c977e3f3f9aa service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] No waiting events found dispatching network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:40:16 user nova-compute[74776]: WARNING nova.compute.manager [req-dde91882-f296-4aed-8dd7-3d9cbca21f73 req-6a215e8c-4bac-491e-8c87-c977e3f3f9aa service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received unexpected event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 for instance with vm_state stopped and task_state powering-on.
Nov 22 14:40:17 user nova-compute[74776]: DEBUG nova.compute.manager [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:40:17 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Instance rebooted successfully.
Nov 22 14:40:17 user nova-compute[74776]: DEBUG nova.compute.manager [None req-626b1c2a-a93a-495a-9af8-af27fccc9e0c tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:40:17 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:40:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:40:17 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Instance spawned successfully.
Nov 22 14:40:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:40:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:40:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:40:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:40:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:40:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:40:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:40:17 user nova-compute[74776]: INFO nova.compute.manager [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 22 14:40:17 user nova-compute[74776]: DEBUG nova.compute.manager [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:40:18 user nova-compute[74776]: INFO nova.compute.manager [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Took 6.18 seconds to build instance.
Nov 22 14:40:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1552ab0a-4c6e-4583-810d-7768673c58ea tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "01694067-eade-44d4-9866-c8c2a1cf412b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.366s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:40:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-225b24f3-0025-40d3-b510-687b6fe438b2 req-bb445a39-e38a-4fd3-a94f-e70eb6484023 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Received event network-vif-plugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:40:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-225b24f3-0025-40d3-b510-687b6fe438b2 req-bb445a39-e38a-4fd3-a94f-e70eb6484023 service nova] Acquiring lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:40:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-225b24f3-0025-40d3-b510-687b6fe438b2 req-bb445a39-e38a-4fd3-a94f-e70eb6484023 service nova] Lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:40:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-225b24f3-0025-40d3-b510-687b6fe438b2 req-bb445a39-e38a-4fd3-a94f-e70eb6484023 service nova] Lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:40:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-225b24f3-0025-40d3-b510-687b6fe438b2 req-bb445a39-e38a-4fd3-a94f-e70eb6484023 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] No waiting events found dispatching network-vif-plugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:40:18 user nova-compute[74776]: WARNING nova.compute.manager [req-225b24f3-0025-40d3-b510-687b6fe438b2 req-bb445a39-e38a-4fd3-a94f-e70eb6484023 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Received unexpected event network-vif-plugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d for instance with vm_state active and task_state None.
Nov 22 14:40:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:20 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:40:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:24 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:40:25 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:40:25 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:40:25 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 14:40:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-f4f30fe7-b234-4f81-b081-3214f5ebe789" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:40:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-f4f30fe7-b234-4f81-b081-3214f5ebe789" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:40:25 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:40:25 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid f4f30fe7-b234-4f81-b081-3214f5ebe789 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:40:26 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Updating instance_info_cache with network_info: [{"id": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "address": "fa:16:3e:46:10:91", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669801ba-1e", "ovs_interfaceid": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:40:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-f4f30fe7-b234-4f81-b081-3214f5ebe789" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:40:26 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:40:27 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:40:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:29 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:40:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:40:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:40:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:40:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:40:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:40:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:40:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:40:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:40:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:40:32 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:40:32 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:40:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8206MB free_disk=24.867843627929688GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:40:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:40:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:40:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f4f30fe7-b234-4f81-b081-3214f5ebe789 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:40:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance bc98341b-ca28-4097-9887-16c8e8d7f9f7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:40:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 7819c3bf-bf3e-4012-8fcc-19226486de8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:40:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance a0fdd07c-7e30-449f-95c4-8c2560d760e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:40:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance c392a863-0d2f-492f-992d-13b21ebd385e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:40:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:40:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 01694067-eade-44d4-9866-c8c2a1cf412b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:40:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:40:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:40:32 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:40:32 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:40:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:40:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:40:33 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:40:33 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:40:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:40:33 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:40:33 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:40:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:39 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:40:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:40:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:41:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:41:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:41:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:41:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:41:22 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:41:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:41:24 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:41:25 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:41:25 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:41:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-bc98341b-ca28-4097-9887-16c8e8d7f9f7" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:41:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-bc98341b-ca28-4097-9887-16c8e8d7f9f7" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:41:25 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:41:26 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Updating instance_info_cache with network_info: [{"id": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "address": "fa:16:3e:5f:fc:12", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cec0cf0-89", "ovs_interfaceid": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:41:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-bc98341b-ca28-4097-9887-16c8e8d7f9f7" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:41:26 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:41:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:41:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:41:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:41:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:41:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:41:27 user nova-compute[74776]: INFO nova.compute.manager [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Terminating instance
Nov 22 14:41:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:41:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:41:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:41:27 user nova-compute[74776]: DEBUG nova.compute.manager [req-b7ab5df1-cda6-4f80-87b9-87ffbee48ab1 req-3ebdee83-7a85-4cca-8164-cbd9310ec59d service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received event network-vif-unplugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:41:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b7ab5df1-cda6-4f80-87b9-87ffbee48ab1 req-3ebdee83-7a85-4cca-8164-cbd9310ec59d service nova] Acquiring lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:41:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b7ab5df1-cda6-4f80-87b9-87ffbee48ab1 req-3ebdee83-7a85-4cca-8164-cbd9310ec59d service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:41:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b7ab5df1-cda6-4f80-87b9-87ffbee48ab1 req-3ebdee83-7a85-4cca-8164-cbd9310ec59d service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:41:27 user nova-compute[74776]: DEBUG nova.compute.manager [req-b7ab5df1-cda6-4f80-87b9-87ffbee48ab1 req-3ebdee83-7a85-4cca-8164-cbd9310ec59d service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] No waiting events found dispatching network-vif-unplugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:41:27 user nova-compute[74776]: DEBUG nova.compute.manager [req-b7ab5df1-cda6-4f80-87b9-87ffbee48ab1 req-3ebdee83-7a85-4cca-8164-cbd9310ec59d service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received event network-vif-unplugged-bd8f1cd4-9030-4326-946d-380263be6dca for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:41:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:41:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:41:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:41:28 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Instance destroyed successfully.
Nov 22 14:41:28 user nova-compute[74776]: DEBUG nova.objects.instance [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'resources' on Instance uuid a0fdd07c-7e30-449f-95c4-8c2560d760e1 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-460725042',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-460725042',id=37,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:37:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d359aba8e95e4090a02fb0a46012f20b',ramdisk_id='',reservation_id='r-k5u3k3yl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-202976361',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:39:41Z,user_data=None,user_id='dea876275c70471d9cba1c3158bd63e2',uuid=a0fdd07c-7e30-449f-95c4-8c2560d760e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd8f1cd4-9030-4326-946d-380263be6dca", "address": "fa:16:3e:6c:d1:a2", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8f1cd4-90", "ovs_interfaceid": "bd8f1cd4-9030-4326-946d-380263be6dca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converting VIF {"id": "bd8f1cd4-9030-4326-946d-380263be6dca", "address": "fa:16:3e:6c:d1:a2", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd8f1cd4-90", "ovs_interfaceid": "bd8f1cd4-9030-4326-946d-380263be6dca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:d1:a2,bridge_name='br-int',has_traffic_filtering=True,id=bd8f1cd4-9030-4326-946d-380263be6dca,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8f1cd4-90') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_vif [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:d1:a2,bridge_name='br-int',has_traffic_filtering=True,id=bd8f1cd4-9030-4326-946d-380263be6dca,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8f1cd4-90') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd8f1cd4-90, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=321fe42d-2e36-4c68-b734-196165d08dbe) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:41:28 user nova-compute[74776]: INFO os_vif [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:d1:a2,bridge_name='br-int',has_traffic_filtering=True,id=bd8f1cd4-9030-4326-946d-380263be6dca,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd8f1cd4-90')
Nov 22 14:41:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjWVmCuG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:41:28 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[972939d5-31fc-4076-96e7-28fb5d9f7da4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:41:28 user nova-compute[74776]: No targets found.
Nov 22 14:41:28 user nova-compute[74776]: iSNS:
Nov 22 14:41:28 user nova-compute[74776]: No targets found.
Nov 22 14:41:28 user nova-compute[74776]: STATIC:
Nov 22 14:41:28 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e
Nov 22 14:41:28 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:41:28 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:41:28 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261
Nov 22 14:41:28 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:41:28 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:41:28 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a
Nov 22 14:41:28 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:41:28 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:41:28 user nova-compute[74776]: FIRMWARE:
Nov 22 14:41:28 user nova-compute[74776]: No targets found.
Nov 22 14:41:28 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:41:28 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:41:28 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3682c553-7142-45d1-8989-40dd7892e87e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[89eaa20a-a1d2-47ad-a70c-91b42b4613f5]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:41:28 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:41:28 user nova-compute[74776]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e (non-flash)
Nov 22 14:41:28 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:41:28 user nova-compute[74776]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 (non-flash)
Nov 22 14:41:28 user nova-compute[74776]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e (non-flash)
Nov 22 14:41:28 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c581ff880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261'): ({'sdc'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Removing single pathed devices sdc {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[736b08a0-d5a8-44b5-a4f4-de938bb8c9c9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[73db4900-09e9-47f6-9382-b6815e920e61]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Flushing IO for device /dev/sdc {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f65b5f1-b06f-4199-a746-beba70ced881]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cdb745-cc15-4f23-bab0-52b8f668d865]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8129fbb-828d4cddddab480f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8129fbb', '/dev/disk/by-id/scsi-23832386434636464') {{(pid=85789) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21b8f71-7fd9-4aa7-8247-a37d4561e9af]: (4, None) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6409aad-ffeb-49ee-abd3-2299af61e23f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f98f50-ccfd-4def-b7a7-0901f167e433]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261, portal: 172.16.0.220,3260]
Nov 22 14:41:28 user nova-compute[74776]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261, portal: 172.16.0.220,3260] successful.
Nov 22 14:41:28 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7daa249b-815d-47f6-9c03-33cff794a261 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b80244c-481c-4863-9997-188a5eff8eeb]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] <== disconnect_volume: return (313ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:41:28 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Deleting instance files /opt/stack/data/nova/instances/a0fdd07c-7e30-449f-95c4-8c2560d760e1_del
Nov 22 14:41:28 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Deletion of /opt/stack/data/nova/instances/a0fdd07c-7e30-449f-95c4-8c2560d760e1_del complete
Nov 22 14:41:28 user nova-compute[74776]: INFO nova.compute.manager [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:41:28 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:41:29 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:41:29 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Took 0.62 seconds to deallocate network for instance.
Nov 22 14:41:29 user nova-compute[74776]: DEBUG nova.compute.manager [req-c2065889-5f0b-4645-9d1c-6b57a499b652 req-6255b3e4-86df-4f3f-a24d-1b086b6d648f service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received event network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:41:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c2065889-5f0b-4645-9d1c-6b57a499b652 req-6255b3e4-86df-4f3f-a24d-1b086b6d648f service nova] Acquiring lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:41:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c2065889-5f0b-4645-9d1c-6b57a499b652 req-6255b3e4-86df-4f3f-a24d-1b086b6d648f service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:41:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c2065889-5f0b-4645-9d1c-6b57a499b652 req-6255b3e4-86df-4f3f-a24d-1b086b6d648f service nova] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:41:29 user nova-compute[74776]: DEBUG nova.compute.manager [req-c2065889-5f0b-4645-9d1c-6b57a499b652 req-6255b3e4-86df-4f3f-a24d-1b086b6d648f service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] No waiting events found dispatching network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:41:29 user nova-compute[74776]: WARNING nova.compute.manager [req-c2065889-5f0b-4645-9d1c-6b57a499b652 req-6255b3e4-86df-4f3f-a24d-1b086b6d648f service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received unexpected event network-vif-plugged-bd8f1cd4-9030-4326-946d-380263be6dca for instance with vm_state active and task_state deleting.
Nov 22 14:41:29 user nova-compute[74776]: DEBUG nova.compute.manager [req-c2065889-5f0b-4645-9d1c-6b57a499b652 req-6255b3e4-86df-4f3f-a24d-1b086b6d648f service nova] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Received event network-vif-deleted-bd8f1cd4-9030-4326-946d-380263be6dca {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:41:29 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:41:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:41:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:41:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:41:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:41:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:41:29 user nova-compute[74776]: INFO nova.compute.manager [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: a0fdd07c-7e30-449f-95c4-8c2560d760e1] Took 0.77 seconds to detach 1 volumes for instance.
Nov 22 14:41:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:41:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:41:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:41:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:41:30 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:41:30 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:41:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:41:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:41:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:41:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:41:30 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Deleted allocations for instance a0fdd07c-7e30-449f-95c4-8c2560d760e1
Nov 22 14:41:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c451d62e-2779-4ca8-b605-e2915a9993c2 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "a0fdd07c-7e30-449f-95c4-8c2560d760e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.102s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:41:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:41:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:41:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:41:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:41:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:41:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:41:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:41:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:41:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:41:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:41:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:41:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:41:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:41:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:41:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:41:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:41:32 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:41:32 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:41:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8447MB free_disk=24.838977813720703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:41:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:41:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:41:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f4f30fe7-b234-4f81-b081-3214f5ebe789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:41:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance bc98341b-ca28-4097-9887-16c8e8d7f9f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:41:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 7819c3bf-bf3e-4012-8fcc-19226486de8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:41:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance c392a863-0d2f-492f-992d-13b21ebd385e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:41:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:41:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 01694067-eade-44d4-9866-c8c2a1cf412b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:41:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:41:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:41:32 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:41:32 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:41:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:41:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:41:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:41:34 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:41:34 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:41:34 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:41:35 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:41:35 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:41:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:41:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:41:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:41:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:41:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:42:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:42:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "c392a863-0d2f-492f-992d-13b21ebd385e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:42:01 user nova-compute[74776]: INFO nova.compute.manager [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Detaching volume 63f308c1-ecd0-4675-9d75-ec247693f59e
Nov 22 14:42:01 user nova-compute[74776]: INFO nova.virt.block_device [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Attempting to driver detach volume 63f308c1-ecd0-4675-9d75-ec247693f59e from mountpoint /dev/vdb
Nov 22 14:42:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Attempting to detach device vdb from instance c392a863-0d2f-492f-992d-13b21ebd385e from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:42:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:42:01 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:42:01 user nova-compute[74776]:   <source dev="/dev/sdd"/>
Nov 22 14:42:01 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:42:01 user nova-compute[74776]:   <serial>63f308c1-ecd0-4675-9d75-ec247693f59e</serial>
Nov 22 14:42:01 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 14:42:01 user nova-compute[74776]: </disk>
Nov 22 14:42:01 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:42:01 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Successfully detached device vdb from instance c392a863-0d2f-492f-992d-13b21ebd385e from the persistent domain config.
Nov 22 14:42:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c392a863-0d2f-492f-992d-13b21ebd385e from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:42:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:42:01 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:42:01 user nova-compute[74776]:   <source dev="/dev/sdd"/>
Nov 22 14:42:01 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:42:01 user nova-compute[74776]:   <serial>63f308c1-ecd0-4675-9d75-ec247693f59e</serial>
Nov 22 14:42:01 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 22 14:42:01 user nova-compute[74776]: </disk>
Nov 22 14:42:01 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Acquiring lock "01694067-eade-44d4-9866-c8c2a1cf412b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "01694067-eade-44d4-9866-c8c2a1cf412b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Acquiring lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:42:02 user nova-compute[74776]: INFO nova.compute.manager [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Terminating instance
Nov 22 14:42:02 user nova-compute[74776]: DEBUG nova.compute.manager [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-497f228e-04d5-47f7-83ea-1cde7ffefc17 req-c0f06ae5-fa5b-4aa4-aab7-df180d0b1c1c service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Received event network-vif-unplugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-497f228e-04d5-47f7-83ea-1cde7ffefc17 req-c0f06ae5-fa5b-4aa4-aab7-df180d0b1c1c service nova] Acquiring lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-497f228e-04d5-47f7-83ea-1cde7ffefc17 req-c0f06ae5-fa5b-4aa4-aab7-df180d0b1c1c service nova] Lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-497f228e-04d5-47f7-83ea-1cde7ffefc17 req-c0f06ae5-fa5b-4aa4-aab7-df180d0b1c1c service nova] Lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-497f228e-04d5-47f7-83ea-1cde7ffefc17 req-c0f06ae5-fa5b-4aa4-aab7-df180d0b1c1c service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] No waiting events found dispatching network-vif-unplugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-497f228e-04d5-47f7-83ea-1cde7ffefc17 req-c0f06ae5-fa5b-4aa4-aab7-df180d0b1c1c service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Received event network-vif-unplugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:02 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Instance destroyed successfully.
Nov 22 14:42:02 user nova-compute[74776]: DEBUG nova.objects.instance [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lazy-loading 'resources' on Instance uuid 01694067-eade-44d4-9866-c8c2a1cf412b {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1531996211',display_name='tempest-ServersNegativeTestJSON-server-1531996211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1531996211',id=40,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:40:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9fc1a673644b4227a3b00fcd84a68207',ramdisk_id='',reservation_id='r-nmjnigep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-704417429',owner_user_name='tempest-ServersNegativeTestJSON-704417429-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:40:18Z,user_data=None,user_id='9a13b1e5b2494485aedb60ce10cdff29',uuid=01694067-eade-44d4-9866-c8c2a1cf412b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b12fd4c-6135-4479-80ff-7d9535b7e08d", "address": "fa:16:3e:26:68:62", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b12fd4c-61", "ovs_interfaceid": "8b12fd4c-6135-4479-80ff-7d9535b7e08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Converting VIF {"id": "8b12fd4c-6135-4479-80ff-7d9535b7e08d", "address": "fa:16:3e:26:68:62", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b12fd4c-61", "ovs_interfaceid": "8b12fd4c-6135-4479-80ff-7d9535b7e08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:68:62,bridge_name='br-int',has_traffic_filtering=True,id=8b12fd4c-6135-4479-80ff-7d9535b7e08d,network=Network(3b251e44-6e92-4252-8e46-710de94e597f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b12fd4c-61') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG os_vif [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:68:62,bridge_name='br-int',has_traffic_filtering=True,id=8b12fd4c-6135-4479-80ff-7d9535b7e08d,network=Network(3b251e44-6e92-4252-8e46-710de94e597f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b12fd4c-61') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b12fd4c-61, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30959242-636b-46a4-a9e9-cc76696eda36) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:02 user nova-compute[74776]: INFO os_vif [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:68:62,bridge_name='br-int',has_traffic_filtering=True,id=8b12fd4c-6135-4479-80ff-7d9535b7e08d,network=Network(3b251e44-6e92-4252-8e46-710de94e597f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b12fd4c-61')
Nov 22 14:42:02 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Deleting instance files /opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b_del
Nov 22 14:42:02 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Deletion of /opt/stack/data/nova/instances/01694067-eade-44d4-9866-c8c2a1cf412b_del complete
Nov 22 14:42:02 user nova-compute[74776]: INFO nova.compute.manager [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 22 14:42:02 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:03 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:42:03 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Took 0.60 seconds to deallocate network for instance.
Nov 22 14:42:03 user nova-compute[74776]: DEBUG nova.compute.manager [req-617915a8-629e-4b15-a411-2cdd2d0ae917 req-190c541c-2caa-4058-8940-a66d26fdbe47 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Received event network-vif-deleted-8b12fd4c-6135-4479-80ff-7d9535b7e08d {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:42:03 user nova-compute[74776]: INFO nova.compute.manager [req-617915a8-629e-4b15-a411-2cdd2d0ae917 req-190c541c-2caa-4058-8940-a66d26fdbe47 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Neutron deleted interface 8b12fd4c-6135-4479-80ff-7d9535b7e08d; detaching it from the instance and deleting it from the info cache
Nov 22 14:42:03 user nova-compute[74776]: DEBUG nova.network.neutron [req-617915a8-629e-4b15-a411-2cdd2d0ae917 req-190c541c-2caa-4058-8940-a66d26fdbe47 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:42:03 user nova-compute[74776]: DEBUG nova.compute.manager [req-617915a8-629e-4b15-a411-2cdd2d0ae917 req-190c541c-2caa-4058-8940-a66d26fdbe47 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Detach interface failed, port_id=8b12fd4c-6135-4479-80ff-7d9535b7e08d, reason: Instance 01694067-eade-44d4-9866-c8c2a1cf412b could not be found. {{(pid=74776) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 14:42:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:42:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:42:03 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:42:03 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:42:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:42:03 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Deleted allocations for instance 01694067-eade-44d4-9866-c8c2a1cf412b
Nov 22 14:42:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-14178e82-2b33-4be5-a199-949099f9852a tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "01694067-eade-44d4-9866-c8c2a1cf412b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.755s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:42:04 user nova-compute[74776]: DEBUG nova.compute.manager [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Received event network-vif-plugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:42:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] Acquiring lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:42:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] Lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:42:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] Lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:42:04 user nova-compute[74776]: DEBUG nova.compute.manager [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] No waiting events found dispatching network-vif-plugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:42:04 user nova-compute[74776]: WARNING nova.compute.manager [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Received unexpected event network-vif-plugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d for instance with vm_state deleted and task_state None.
Nov 22 14:42:04 user nova-compute[74776]: DEBUG nova.compute.manager [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Received event network-vif-plugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:42:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] Acquiring lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:42:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] Lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:42:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] Lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:42:04 user nova-compute[74776]: DEBUG nova.compute.manager [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] No waiting events found dispatching network-vif-plugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:42:04 user nova-compute[74776]: WARNING nova.compute.manager [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Received unexpected event network-vif-plugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d for instance with vm_state deleted and task_state None.
Nov 22 14:42:04 user nova-compute[74776]: DEBUG nova.compute.manager [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Received event network-vif-plugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:42:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] Acquiring lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:42:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] Lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:42:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] Lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:42:04 user nova-compute[74776]: DEBUG nova.compute.manager [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] No waiting events found dispatching network-vif-plugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:42:04 user nova-compute[74776]: WARNING nova.compute.manager [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Received unexpected event network-vif-plugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d for instance with vm_state deleted and task_state None.
Nov 22 14:42:04 user nova-compute[74776]: DEBUG nova.compute.manager [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Received event network-vif-unplugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:42:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] Acquiring lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:42:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] Lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:42:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] Lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:42:04 user nova-compute[74776]: DEBUG nova.compute.manager [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] No waiting events found dispatching network-vif-unplugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:42:04 user nova-compute[74776]: WARNING nova.compute.manager [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Received unexpected event network-vif-unplugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d for instance with vm_state deleted and task_state None.
Nov 22 14:42:04 user nova-compute[74776]: DEBUG nova.compute.manager [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Received event network-vif-plugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:42:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] Acquiring lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:42:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] Lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:42:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] Lock "01694067-eade-44d4-9866-c8c2a1cf412b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:42:04 user nova-compute[74776]: DEBUG nova.compute.manager [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] No waiting events found dispatching network-vif-plugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:42:04 user nova-compute[74776]: WARNING nova.compute.manager [req-2c8ace18-7a90-450a-96f7-7c55e82348ce req-d35bbc4c-3fe4-4966-bc24-8e643465c5a4 service nova] [instance: 01694067-eade-44d4-9866-c8c2a1cf412b] Received unexpected event network-vif-plugged-8b12fd4c-6135-4479-80ff-7d9535b7e08d for instance with vm_state deleted and task_state None.
Nov 22 14:42:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:42:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:42:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:42:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:42:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:42:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "7819c3bf-bf3e-4012-8fcc-19226486de8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "7819c3bf-bf3e-4012-8fcc-19226486de8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "7819c3bf-bf3e-4012-8fcc-19226486de8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "7819c3bf-bf3e-4012-8fcc-19226486de8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "7819c3bf-bf3e-4012-8fcc-19226486de8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:42:18 user nova-compute[74776]: INFO nova.compute.manager [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Terminating instance
Nov 22 14:42:18 user nova-compute[74776]: DEBUG nova.compute.manager [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-52b853a9-7987-4512-a279-19486998b19c req-765b0723-990e-4961-be55-6fe881be1e7a service nova] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Received event network-vif-unplugged-09b0593b-ed06-4e2b-b80e-cf70bad2366c {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-52b853a9-7987-4512-a279-19486998b19c req-765b0723-990e-4961-be55-6fe881be1e7a service nova] Acquiring lock "7819c3bf-bf3e-4012-8fcc-19226486de8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-52b853a9-7987-4512-a279-19486998b19c req-765b0723-990e-4961-be55-6fe881be1e7a service nova] Lock "7819c3bf-bf3e-4012-8fcc-19226486de8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-52b853a9-7987-4512-a279-19486998b19c req-765b0723-990e-4961-be55-6fe881be1e7a service nova] Lock "7819c3bf-bf3e-4012-8fcc-19226486de8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-52b853a9-7987-4512-a279-19486998b19c req-765b0723-990e-4961-be55-6fe881be1e7a service nova] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] No waiting events found dispatching network-vif-unplugged-09b0593b-ed06-4e2b-b80e-cf70bad2366c {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-52b853a9-7987-4512-a279-19486998b19c req-765b0723-990e-4961-be55-6fe881be1e7a service nova] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Received event network-vif-unplugged-09b0593b-ed06-4e2b-b80e-cf70bad2366c for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:18 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Instance destroyed successfully.
Nov 22 14:42:18 user nova-compute[74776]: DEBUG nova.objects.instance [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'resources' on Instance uuid 7819c3bf-bf3e-4012-8fcc-19226486de8e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1282310158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1282310158',id=34,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:32:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d359aba8e95e4090a02fb0a46012f20b',ramdisk_id='',reservation_id='r-ejo1vh10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-202976361',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:34:03Z,user_data=None,user_id='dea876275c70471d9cba1c3158bd63e2',uuid=7819c3bf-bf3e-4012-8fcc-19226486de8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "address": "fa:16:3e:55:20:d3", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b0593b-ed", "ovs_interfaceid": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converting VIF {"id": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "address": "fa:16:3e:55:20:d3", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b0593b-ed", "ovs_interfaceid": "09b0593b-ed06-4e2b-b80e-cf70bad2366c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:20:d3,bridge_name='br-int',has_traffic_filtering=True,id=09b0593b-ed06-4e2b-b80e-cf70bad2366c,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b0593b-ed') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG os_vif [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:20:d3,bridge_name='br-int',has_traffic_filtering=True,id=09b0593b-ed06-4e2b-b80e-cf70bad2366c,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b0593b-ed') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09b0593b-ed, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea7dc58b-5c91-4664-8cd9-d8ecdd61ab69) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:42:18 user nova-compute[74776]: INFO os_vif [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:20:d3,bridge_name='br-int',has_traffic_filtering=True,id=09b0593b-ed06-4e2b-b80e-cf70bad2366c,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b0593b-ed')
Nov 22 14:42:18 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Deleting instance files /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e_del
Nov 22 14:42:18 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Deletion of /opt/stack/data/nova/instances/7819c3bf-bf3e-4012-8fcc-19226486de8e_del complete
Nov 22 14:42:18 user nova-compute[74776]: INFO nova.compute.manager [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 22 14:42:18 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:42:18 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:42:19 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:42:19 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Took 0.94 seconds to deallocate network for instance.
Nov 22 14:42:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:42:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:42:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-cbc16b88-3b78-4306-b112-4f88ecc766cf req-93121537-69de-421c-88a7-201fe27b5d27 service nova] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Received event network-vif-deleted-09b0593b-ed06-4e2b-b80e-cf70bad2366c {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:42:20 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:42:20 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:42:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:42:20 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Deleted allocations for instance 7819c3bf-bf3e-4012-8fcc-19226486de8e
Nov 22 14:42:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-70c2839b-18cb-4c97-847e-c1dcdfb726f0 tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "7819c3bf-bf3e-4012-8fcc-19226486de8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.064s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:42:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-cb4e8925-ad2a-4ab4-aa15-03618abe358e req-8900dd0c-c593-4ec4-908d-b05d9ba2f7eb service nova] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Received event network-vif-plugged-09b0593b-ed06-4e2b-b80e-cf70bad2366c {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:42:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cb4e8925-ad2a-4ab4-aa15-03618abe358e req-8900dd0c-c593-4ec4-908d-b05d9ba2f7eb service nova] Acquiring lock "7819c3bf-bf3e-4012-8fcc-19226486de8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:42:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cb4e8925-ad2a-4ab4-aa15-03618abe358e req-8900dd0c-c593-4ec4-908d-b05d9ba2f7eb service nova] Lock "7819c3bf-bf3e-4012-8fcc-19226486de8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:42:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cb4e8925-ad2a-4ab4-aa15-03618abe358e req-8900dd0c-c593-4ec4-908d-b05d9ba2f7eb service nova] Lock "7819c3bf-bf3e-4012-8fcc-19226486de8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:42:20 user nova-compute[74776]: DEBUG nova.compute.manager [req-cb4e8925-ad2a-4ab4-aa15-03618abe358e req-8900dd0c-c593-4ec4-908d-b05d9ba2f7eb service nova] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] No waiting events found dispatching network-vif-plugged-09b0593b-ed06-4e2b-b80e-cf70bad2366c {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:42:20 user nova-compute[74776]: WARNING nova.compute.manager [req-cb4e8925-ad2a-4ab4-aa15-03618abe358e req-8900dd0c-c593-4ec4-908d-b05d9ba2f7eb service nova] [instance: 7819c3bf-bf3e-4012-8fcc-19226486de8e] Received unexpected event network-vif-plugged-09b0593b-ed06-4e2b-b80e-cf70bad2366c for instance with vm_state deleted and task_state None.
Nov 22 14:42:22 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c392a863-0d2f-492f-992d-13b21ebd385e is timed out.
Nov 22 14:42:22 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Successfully detached device vdb from instance c392a863-0d2f-492f-992d-13b21ebd385e from the live domain config.
Nov 22 14:42:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EStVPghu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:42:22 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:42:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[762ac9b6-22b1-43ab-aa00-07cecbf376fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:42:22 user nova-compute[74776]: No targets found.
Nov 22 14:42:22 user nova-compute[74776]: iSNS:
Nov 22 14:42:22 user nova-compute[74776]: No targets found.
Nov 22 14:42:22 user nova-compute[74776]: STATIC:
Nov 22 14:42:22 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e
Nov 22 14:42:22 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:42:22 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:42:22 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a
Nov 22 14:42:22 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:42:22 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:42:22 user nova-compute[74776]: FIRMWARE:
Nov 22 14:42:22 user nova-compute[74776]: No targets found.
Nov 22 14:42:22 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:42:22 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:42:22 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f653a3c2-d22d-43c5-94b6-6e973c971e8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[31204008-a210-48a6-b123-219a7f7a8d7e]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:42:22 user nova-compute[74776]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e (non-flash)
Nov 22 14:42:22 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:42:22 user nova-compute[74776]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e (non-flash)
Nov 22 14:42:22 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c58254820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e'): ({'sdd'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Removing single pathed devices sdd {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e281c4-3c1e-4874-a251-1d9b9252c00f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26827cd-1201-4bfd-81f9-d149b472ec88]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Flushing IO for device /dev/sdd {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce6e380-7371-4f25-9ce0-d86678f708a6]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ef9030-3b5b-4aac-bcf8-a9fe7800f644]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] SCSI volumes sdd have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[719d8abb-b788-4fdd-b516-587b5785b00b]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9564e51b-899e-45e2-8509-eb1f27689e6b]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e, portal: 172.16.0.220,3260]
Nov 22 14:42:22 user nova-compute[74776]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e, portal: 172.16.0.220,3260] successful.
Nov 22 14:42:22 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:63f308c1-ecd0-4675-9d75-ec247693f59e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[683187e1-f5d3-44be-892e-dc2b039b37ae]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] <== disconnect_volume: return (311ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:42:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:42:23 user nova-compute[74776]: DEBUG nova.objects.instance [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'flavor' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:42:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-1ecb57d8-708e-4a04-b307-521c45d185f2 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "c392a863-0d2f-492f-992d-13b21ebd385e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.708s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:42:23 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:42:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4f7139ab-06b7-49b3-b315-f110062bb072 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:42:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4f7139ab-06b7-49b3-b315-f110062bb072 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "c392a863-0d2f-492f-992d-13b21ebd385e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:42:23 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4f7139ab-06b7-49b3-b315-f110062bb072 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:42:23 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4f7139ab-06b7-49b3-b315-f110062bb072 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74776) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 22 14:42:23 user nova-compute[74776]: DEBUG nova.objects.instance [None req-4f7139ab-06b7-49b3-b315-f110062bb072 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'flavor' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:42:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-5ae85292-7a50-4785-94a7-ed0956753ff4 req-d9aef33a-c64f-4325-aed8-6caa91449592 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received event network-vif-unplugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:42:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5ae85292-7a50-4785-94a7-ed0956753ff4 req-d9aef33a-c64f-4325-aed8-6caa91449592 service nova] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:42:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5ae85292-7a50-4785-94a7-ed0956753ff4 req-d9aef33a-c64f-4325-aed8-6caa91449592 service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:42:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5ae85292-7a50-4785-94a7-ed0956753ff4 req-d9aef33a-c64f-4325-aed8-6caa91449592 service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:42:24 user nova-compute[74776]: DEBUG nova.compute.manager [req-5ae85292-7a50-4785-94a7-ed0956753ff4 req-d9aef33a-c64f-4325-aed8-6caa91449592 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] No waiting events found dispatching network-vif-unplugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:42:24 user nova-compute[74776]: WARNING nova.compute.manager [req-5ae85292-7a50-4785-94a7-ed0956753ff4 req-d9aef33a-c64f-4325-aed8-6caa91449592 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received unexpected event network-vif-unplugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 for instance with vm_state active and task_state powering-off.
Nov 22 14:42:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:24 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Instance destroyed successfully.
Nov 22 14:42:24 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4f7139ab-06b7-49b3-b315-f110062bb072 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:42:24 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4f7139ab-06b7-49b3-b315-f110062bb072 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "c392a863-0d2f-492f-992d-13b21ebd385e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.811s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:42:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-7a4bf258-01b6-4e78-b2c6-50ee194d1177 req-0e246c26-e00c-4454-869d-6e9f0c035ac8 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:42:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7a4bf258-01b6-4e78-b2c6-50ee194d1177 req-0e246c26-e00c-4454-869d-6e9f0c035ac8 service nova] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:42:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7a4bf258-01b6-4e78-b2c6-50ee194d1177 req-0e246c26-e00c-4454-869d-6e9f0c035ac8 service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:42:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7a4bf258-01b6-4e78-b2c6-50ee194d1177 req-0e246c26-e00c-4454-869d-6e9f0c035ac8 service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:42:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-7a4bf258-01b6-4e78-b2c6-50ee194d1177 req-0e246c26-e00c-4454-869d-6e9f0c035ac8 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] No waiting events found dispatching network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:42:26 user nova-compute[74776]: WARNING nova.compute.manager [req-7a4bf258-01b6-4e78-b2c6-50ee194d1177 req-0e246c26-e00c-4454-869d-6e9f0c035ac8 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received unexpected event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 for instance with vm_state stopped and task_state None.
Nov 22 14:42:26 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:42:26 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:42:26 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:42:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-c392a863-0d2f-492f-992d-13b21ebd385e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:42:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-c392a863-0d2f-492f-992d-13b21ebd385e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:42:26 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:42:27 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Updating instance_info_cache with network_info: [{"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:42:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-c392a863-0d2f-492f-992d-13b21ebd385e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:42:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:42:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:29 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:42:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:42:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:42:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:42:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:42:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:42:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:42:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:42:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:42:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:42:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:42:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:42:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:42:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:42:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:42:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:42:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:42:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:42:31 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:42:31 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:42:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8787MB free_disk=24.990894317626953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:42:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:42:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:42:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f4f30fe7-b234-4f81-b081-3214f5ebe789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:42:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance bc98341b-ca28-4097-9887-16c8e8d7f9f7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:42:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance c392a863-0d2f-492f-992d-13b21ebd385e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:42:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:42:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:42:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:42:31 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing inventories for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 14:42:31 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating ProviderTree inventory for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 14:42:31 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating inventory in ProviderTree for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 14:42:31 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing aggregate associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, aggregates: None {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 14:42:31 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing trait associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 14:42:31 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:42:31 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:42:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:42:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.518s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:42:32 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:42:32 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:42:32 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:42:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:42:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:42:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:42:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:42:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:34 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:42:34 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:42:34 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74776) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 14:42:34 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:42:36 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:42:36 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:42:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:42:40 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:42:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:42:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:42:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:42:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:42:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:42:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:48 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:42:48 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 14:42:48 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] There are 0 instances to clean {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 14:42:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:42:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:42:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:42:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:42:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:42:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:42:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:42:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:43:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:43:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:43:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:43:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:06 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:43:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:43:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:43:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:43:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:43:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:43:08 user nova-compute[74776]: INFO nova.compute.manager [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Terminating instance
Nov 22 14:43:08 user nova-compute[74776]: DEBUG nova.compute.manager [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:43:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:43:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:43:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:43:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:43:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-1cc6c6e8-aa03-4c61-8aa8-6d2c724d4e36 req-4080b32a-d230-450c-81f9-a55492f906e8 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received event network-vif-unplugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1cc6c6e8-aa03-4c61-8aa8-6d2c724d4e36 req-4080b32a-d230-450c-81f9-a55492f906e8 service nova] Acquiring lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1cc6c6e8-aa03-4c61-8aa8-6d2c724d4e36 req-4080b32a-d230-450c-81f9-a55492f906e8 service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1cc6c6e8-aa03-4c61-8aa8-6d2c724d4e36 req-4080b32a-d230-450c-81f9-a55492f906e8 service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-1cc6c6e8-aa03-4c61-8aa8-6d2c724d4e36 req-4080b32a-d230-450c-81f9-a55492f906e8 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] No waiting events found dispatching network-vif-unplugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-1cc6c6e8-aa03-4c61-8aa8-6d2c724d4e36 req-4080b32a-d230-450c-81f9-a55492f906e8 service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received event network-vif-unplugged-5cec0cf0-892c-4c30-ae08-7e127098bccf for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:09 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Instance destroyed successfully.
Nov 22 14:43:09 user nova-compute[74776]: DEBUG nova.objects.instance [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'resources' on Instance uuid bc98341b-ca28-4097-9887-16c8e8d7f9f7 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:26:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-727985580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-727985580',id=25,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:28:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d359aba8e95e4090a02fb0a46012f20b',ramdisk_id='',reservation_id='r-vo0i4er5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-202976361',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:30:19Z,user_data=None,user_id='dea876275c70471d9cba1c3158bd63e2',uuid=bc98341b-ca28-4097-9887-16c8e8d7f9f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "address": "fa:16:3e:5f:fc:12", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cec0cf0-89", "ovs_interfaceid": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converting VIF {"id": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "address": "fa:16:3e:5f:fc:12", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cec0cf0-89", "ovs_interfaceid": "5cec0cf0-892c-4c30-ae08-7e127098bccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:fc:12,bridge_name='br-int',has_traffic_filtering=True,id=5cec0cf0-892c-4c30-ae08-7e127098bccf,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cec0cf0-89') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG os_vif [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:fc:12,bridge_name='br-int',has_traffic_filtering=True,id=5cec0cf0-892c-4c30-ae08-7e127098bccf,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cec0cf0-89') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cec0cf0-89, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25904b8f-d1b1-4756-991f-0a8ed25896a2) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:09 user nova-compute[74776]: INFO os_vif [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:fc:12,bridge_name='br-int',has_traffic_filtering=True,id=5cec0cf0-892c-4c30-ae08-7e127098bccf,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cec0cf0-89')
Nov 22 14:43:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'goChikQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:43:09 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:43:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab4b1bb-8f54-4b48-b6fe-4dd2a0958944]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:43:09 user nova-compute[74776]: No targets found.
Nov 22 14:43:09 user nova-compute[74776]: iSNS:
Nov 22 14:43:09 user nova-compute[74776]: No targets found.
Nov 22 14:43:09 user nova-compute[74776]: STATIC:
Nov 22 14:43:09 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a
Nov 22 14:43:09 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:43:09 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:43:09 user nova-compute[74776]: FIRMWARE:
Nov 22 14:43:09 user nova-compute[74776]: No targets found.
Nov 22 14:43:09 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:43:09 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:43:09 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce1ff35-bced-4043-a042-707e1d755a18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0903ac-a17a-407b-a4eb-5491eb3cced8]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:43:09 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a (non-flash)
Nov 22 14:43:09 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c38798790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a'): ({'sdb'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Removing single pathed devices sdb {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abaa23a-4986-48ba-b735-c08c8789d8aa]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2f9dc9-d114-401d-b009-bc7ca5de06f4]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Flushing IO for device /dev/sdb {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a77c0b2-ef70-4e83-9078-ad2d1e3ccf91]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[95699b2b-6053-4775-ab5d-611e383c17af]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b13153-9a9f-4cea-95ed-db4f8d05afac]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d110c82-2e3b-4533-bc31-7cdf6f7a086b]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a, portal: 172.16.0.220,3260]
Nov 22 14:43:09 user nova-compute[74776]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a, portal: 172.16.0.220,3260] successful.
Nov 22 14:43:09 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22f250eb-fa2e-4fbf-aede-ed3df4a3ac9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[94048b5e-9db5-4bc7-a37d-a18b42a90396]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] <== disconnect_volume: return (312ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:43:09 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Deleting instance files /opt/stack/data/nova/instances/bc98341b-ca28-4097-9887-16c8e8d7f9f7_del
Nov 22 14:43:09 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Deletion of /opt/stack/data/nova/instances/bc98341b-ca28-4097-9887-16c8e8d7f9f7_del complete
Nov 22 14:43:09 user nova-compute[74776]: INFO nova.compute.manager [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 22 14:43:09 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:43:09 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:43:10 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:43:10 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Took 0.48 seconds to deallocate network for instance.
Nov 22 14:43:11 user nova-compute[74776]: DEBUG nova.compute.manager [req-d1f38353-c596-4dfc-a80d-37f512abfe49 req-135d06ad-7668-4b64-bff5-c55657136dab service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received event network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:43:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d1f38353-c596-4dfc-a80d-37f512abfe49 req-135d06ad-7668-4b64-bff5-c55657136dab service nova] Acquiring lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:43:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d1f38353-c596-4dfc-a80d-37f512abfe49 req-135d06ad-7668-4b64-bff5-c55657136dab service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:43:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d1f38353-c596-4dfc-a80d-37f512abfe49 req-135d06ad-7668-4b64-bff5-c55657136dab service nova] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:43:11 user nova-compute[74776]: DEBUG nova.compute.manager [req-d1f38353-c596-4dfc-a80d-37f512abfe49 req-135d06ad-7668-4b64-bff5-c55657136dab service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] No waiting events found dispatching network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:43:11 user nova-compute[74776]: WARNING nova.compute.manager [req-d1f38353-c596-4dfc-a80d-37f512abfe49 req-135d06ad-7668-4b64-bff5-c55657136dab service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received unexpected event network-vif-plugged-5cec0cf0-892c-4c30-ae08-7e127098bccf for instance with vm_state active and task_state deleting.
Nov 22 14:43:11 user nova-compute[74776]: DEBUG nova.compute.manager [req-d1f38353-c596-4dfc-a80d-37f512abfe49 req-135d06ad-7668-4b64-bff5-c55657136dab service nova] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Received event network-vif-deleted-5cec0cf0-892c-4c30-ae08-7e127098bccf {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:43:11 user nova-compute[74776]: INFO nova.compute.manager [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: bc98341b-ca28-4097-9887-16c8e8d7f9f7] Took 0.86 seconds to detach 1 volumes for instance.
Nov 22 14:43:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:43:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:43:11 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:43:11 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:43:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:43:11 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Deleted allocations for instance bc98341b-ca28-4097-9887-16c8e8d7f9f7
Nov 22 14:43:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-611f1af2-1d05-450b-aba9-8de2c869b45e tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "bc98341b-ca28-4097-9887-16c8e8d7f9f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.799s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:43:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:43:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:43:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:43:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:43:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:43:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:24 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:43:27 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:43:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:43:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:43:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:43:27 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:43:28 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Updating instance_info_cache with network_info: [{"id": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "address": "fa:16:3e:1c:18:6c", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda635911-c5", "ovs_interfaceid": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:43:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:43:28 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:43:29 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:43:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:29 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:43:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:43:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:43:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:43:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:43:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:43:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:43:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:43:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:43:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:43:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:43:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:43:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:43:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:43:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:43:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:43:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:43:31 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:43:31 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:43:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8830MB free_disk=24.99004364013672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:43:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:43:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:43:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f4f30fe7-b234-4f81-b081-3214f5ebe789 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:43:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance c392a863-0d2f-492f-992d-13b21ebd385e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:43:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:43:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:43:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:43:31 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:43:31 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:43:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:43:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:43:33 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:43:33 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:43:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:43:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:36 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:43:36 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:43:38 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:43:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:43:45 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:43:45 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid f4f30fe7-b234-4f81-b081-3214f5ebe789 {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:43:45 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:43:45 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9 {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:43:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "f4f30fe7-b234-4f81-b081-3214f5ebe789" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:43:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "f4f30fe7-b234-4f81-b081-3214f5ebe789" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:43:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:43:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "c392a863-0d2f-492f-992d-13b21ebd385e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:43:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:43:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:43:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "f4f30fe7-b234-4f81-b081-3214f5ebe789" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:43:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "c392a863-0d2f-492f-992d-13b21ebd385e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:43:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:43:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:43:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "f4f30fe7-b234-4f81-b081-3214f5ebe789" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:43:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "f4f30fe7-b234-4f81-b081-3214f5ebe789" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:43:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "f4f30fe7-b234-4f81-b081-3214f5ebe789-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:43:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "f4f30fe7-b234-4f81-b081-3214f5ebe789-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:43:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "f4f30fe7-b234-4f81-b081-3214f5ebe789-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:43:59 user nova-compute[74776]: INFO nova.compute.manager [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Terminating instance
Nov 22 14:43:59 user nova-compute[74776]: DEBUG nova.compute.manager [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:43:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:43:59 user nova-compute[74776]: DEBUG nova.compute.manager [req-4d789552-634d-429a-93b8-82c3d821855b req-4518e826-10bf-486f-9aeb-d171bce3f35d service nova] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Received event network-vif-unplugged-669801ba-1e1d-4ef3-bad3-d1961e58f5af {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:43:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4d789552-634d-429a-93b8-82c3d821855b req-4518e826-10bf-486f-9aeb-d171bce3f35d service nova] Acquiring lock "f4f30fe7-b234-4f81-b081-3214f5ebe789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:43:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4d789552-634d-429a-93b8-82c3d821855b req-4518e826-10bf-486f-9aeb-d171bce3f35d service nova] Lock "f4f30fe7-b234-4f81-b081-3214f5ebe789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:43:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4d789552-634d-429a-93b8-82c3d821855b req-4518e826-10bf-486f-9aeb-d171bce3f35d service nova] Lock "f4f30fe7-b234-4f81-b081-3214f5ebe789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:43:59 user nova-compute[74776]: DEBUG nova.compute.manager [req-4d789552-634d-429a-93b8-82c3d821855b req-4518e826-10bf-486f-9aeb-d171bce3f35d service nova] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] No waiting events found dispatching network-vif-unplugged-669801ba-1e1d-4ef3-bad3-d1961e58f5af {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:43:59 user nova-compute[74776]: DEBUG nova.compute.manager [req-4d789552-634d-429a-93b8-82c3d821855b req-4518e826-10bf-486f-9aeb-d171bce3f35d service nova] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Received event network-vif-unplugged-669801ba-1e1d-4ef3-bad3-d1961e58f5af for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:44:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:00 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Instance destroyed successfully.
Nov 22 14:44:00 user nova-compute[74776]: DEBUG nova.objects.instance [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lazy-loading 'resources' on Instance uuid f4f30fe7-b234-4f81-b081-3214f5ebe789 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:44:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:23:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-935050610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-935050610',id=21,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:23:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d359aba8e95e4090a02fb0a46012f20b',ramdisk_id='',reservation_id='r-yqi145qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-202976361',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:25:29Z,user_data=None,user_id='dea876275c70471d9cba1c3158bd63e2',uuid=f4f30fe7-b234-4f81-b081-3214f5ebe789,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "address": "fa:16:3e:46:10:91", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669801ba-1e", "ovs_interfaceid": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:44:00 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converting VIF {"id": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "address": "fa:16:3e:46:10:91", "network": {"id": "723aacb0-2913-4b2e-ab00-3afec888fec4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-158744491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d359aba8e95e4090a02fb0a46012f20b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap669801ba-1e", "ovs_interfaceid": "669801ba-1e1d-4ef3-bad3-d1961e58f5af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:44:00 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:10:91,bridge_name='br-int',has_traffic_filtering=True,id=669801ba-1e1d-4ef3-bad3-d1961e58f5af,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap669801ba-1e') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:44:00 user nova-compute[74776]: DEBUG os_vif [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:10:91,bridge_name='br-int',has_traffic_filtering=True,id=669801ba-1e1d-4ef3-bad3-d1961e58f5af,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap669801ba-1e') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:44:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap669801ba-1e, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:44:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:44:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7341e2c1-6aa2-4d5c-9ac6-a55e502a6a6a) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:44:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:44:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:00 user nova-compute[74776]: INFO os_vif [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:10:91,bridge_name='br-int',has_traffic_filtering=True,id=669801ba-1e1d-4ef3-bad3-d1961e58f5af,network=Network(723aacb0-2913-4b2e-ab00-3afec888fec4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap669801ba-1e')
Nov 22 14:44:00 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Deleting instance files /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789_del
Nov 22 14:44:00 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Deletion of /opt/stack/data/nova/instances/f4f30fe7-b234-4f81-b081-3214f5ebe789_del complete
Nov 22 14:44:00 user nova-compute[74776]: INFO nova.compute.manager [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 22 14:44:00 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:44:00 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:44:00 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:44:00 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:44:00 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Took 0.47 seconds to deallocate network for instance.
Nov 22 14:44:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-fa66dfb1-47c5-48cf-af2a-2d9140c0f849 req-f1ea5202-9290-4376-989a-5e825049d033 service nova] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Received event network-vif-deleted-669801ba-1e1d-4ef3-bad3-d1961e58f5af {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:44:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:44:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:44:01 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:44:01 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:44:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:44:01 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Deleted allocations for instance f4f30fe7-b234-4f81-b081-3214f5ebe789
Nov 22 14:44:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2f46ba04-a342-4b93-ad25-bde04cde8b8a tempest-ServerBootFromVolumeStableRescueTest-202976361 tempest-ServerBootFromVolumeStableRescueTest-202976361-project-member] Lock "f4f30fe7-b234-4f81-b081-3214f5ebe789" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.714s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:44:01 user nova-compute[74776]: DEBUG nova.compute.manager [req-7efbf374-40fb-4982-a99d-bf986af29f72 req-17b928ec-1065-4d95-bca3-c767524c0fd6 service nova] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Received event network-vif-plugged-669801ba-1e1d-4ef3-bad3-d1961e58f5af {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:44:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7efbf374-40fb-4982-a99d-bf986af29f72 req-17b928ec-1065-4d95-bca3-c767524c0fd6 service nova] Acquiring lock "f4f30fe7-b234-4f81-b081-3214f5ebe789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:44:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7efbf374-40fb-4982-a99d-bf986af29f72 req-17b928ec-1065-4d95-bca3-c767524c0fd6 service nova] Lock "f4f30fe7-b234-4f81-b081-3214f5ebe789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:44:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7efbf374-40fb-4982-a99d-bf986af29f72 req-17b928ec-1065-4d95-bca3-c767524c0fd6 service nova] Lock "f4f30fe7-b234-4f81-b081-3214f5ebe789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:44:01 user nova-compute[74776]: DEBUG nova.compute.manager [req-7efbf374-40fb-4982-a99d-bf986af29f72 req-17b928ec-1065-4d95-bca3-c767524c0fd6 service nova] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] No waiting events found dispatching network-vif-plugged-669801ba-1e1d-4ef3-bad3-d1961e58f5af {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:44:01 user nova-compute[74776]: WARNING nova.compute.manager [req-7efbf374-40fb-4982-a99d-bf986af29f72 req-17b928ec-1065-4d95-bca3-c767524c0fd6 service nova] [instance: f4f30fe7-b234-4f81-b081-3214f5ebe789] Received unexpected event network-vif-plugged-669801ba-1e1d-4ef3-bad3-d1961e58f5af for instance with vm_state deleted and task_state None.
Nov 22 14:44:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.objects.instance [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'flavor' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "refresh_cache-c392a863-0d2f-492f-992d-13b21ebd385e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquired lock "refresh_cache-c392a863-0d2f-492f-992d-13b21ebd385e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.network.neutron [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.objects.instance [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'info_cache' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.objects.base [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Object Instance<c392a863-0d2f-492f-992d-13b21ebd385e> lazy-loaded attributes: flavor,info_cache {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.network.neutron [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Updating instance_info_cache with network_info: [{"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Releasing lock "refresh_cache-c392a863-0d2f-492f-992d-13b21ebd385e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:44:14 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Instance destroyed successfully.
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.objects.instance [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'resources' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.objects.base [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Object Instance<c392a863-0d2f-492f-992d-13b21ebd385e> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1939367355',display_name='tempest-AttachVolumeTestJSON-server-1939367355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1939367355',id=38,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuY5HJNrsYIY3niBmAsaghDVb+I+PBVWqd4MNCFlVINDMvlQLejGFXaXFFq/GrQzsAXjCAdhFS5NiuyPPLqWUQW2pA/3La+hbQ6NADZBNvomwBj1xOQ0pH4ACvIkEkbcw==',key_name='tempest-keypair-1181685632',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:36:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='801e8ed62c734be5945d8fbf307aa1d2',ramdisk_id='',reservation_id='r-d95rnpuu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1546562861',owner_user_name='tempest-AttachVolumeTestJSON-1546562861-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2494e8b489ea48f1a6b3b19eb87b6306',uuid=c392a863-0d2f-492f-992d-13b21ebd385e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converting VIF {"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:95:20,bridge_name='br-int',has_traffic_filtering=True,id=365c5ef1-7abf-4102-a6aa-be03a4f325f2,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365c5ef1-7a') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG os_vif [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:95:20,bridge_name='br-int',has_traffic_filtering=True,id=365c5ef1-7abf-4102-a6aa-be03a4f325f2,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365c5ef1-7a') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap365c5ef1-7a, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b783a107-7998-41a9-b25e-8355e73a91f5) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:14 user nova-compute[74776]: INFO os_vif [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:95:20,bridge_name='br-int',has_traffic_filtering=True,id=365c5ef1-7abf-4102-a6aa-be03a4f325f2,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365c5ef1-7a')
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Start _get_guest_xml network_info=[{"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.objects.instance [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'numa_topology' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.objects.base [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Object Instance<c392a863-0d2f-492f-992d-13b21ebd385e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:44:14 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:44:14 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.objects.instance [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'vcpu_model' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:44:14 user nova-compute[74776]: DEBUG nova.objects.base [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Object Instance<c392a863-0d2f-492f-992d-13b21ebd385e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1939367355',display_name='tempest-AttachVolumeTestJSON-server-1939367355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1939367355',id=38,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuY5HJNrsYIY3niBmAsaghDVb+I+PBVWqd4MNCFlVINDMvlQLejGFXaXFFq/GrQzsAXjCAdhFS5NiuyPPLqWUQW2pA/3La+hbQ6NADZBNvomwBj1xOQ0pH4ACvIkEkbcw==',key_name='tempest-keypair-1181685632',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:36:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='801e8ed62c734be5945d8fbf307aa1d2',ramdisk_id='',reservation_id='r-d95rnpuu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1546562861',owner_user_name='tempest-AttachVolumeTestJSON-1546562861-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2494e8b489ea48f1a6b3b19eb87b6306',uuid=c392a863-0d2f-492f-992d-13b21ebd385e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converting VIF {"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:95:20,bridge_name='br-int',has_traffic_filtering=True,id=365c5ef1-7abf-4102-a6aa-be03a4f325f2,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365c5ef1-7a') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG nova.objects.instance [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'pci_devices' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG nova.objects.base [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Object Instance<c392a863-0d2f-492f-992d-13b21ebd385e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:44:15 user nova-compute[74776]:   <uuid>c392a863-0d2f-492f-992d-13b21ebd385e</uuid>
Nov 22 14:44:15 user nova-compute[74776]:   <name>instance-00000026</name>
Nov 22 14:44:15 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:44:15 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:44:15 user nova-compute[74776]:   <metadata>
Nov 22 14:44:15 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:44:15 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:44:15 user nova-compute[74776]:       <nova:name>tempest-AttachVolumeTestJSON-server-1939367355</nova:name>
Nov 22 14:44:15 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:44:14</nova:creationTime>
Nov 22 14:44:15 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:44:15 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:44:15 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:44:15 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:44:15 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:44:15 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:44:15 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:44:15 user nova-compute[74776]:       <nova:owner>
Nov 22 14:44:15 user nova-compute[74776]:         <nova:user uuid="2494e8b489ea48f1a6b3b19eb87b6306">tempest-AttachVolumeTestJSON-1546562861-project-member</nova:user>
Nov 22 14:44:15 user nova-compute[74776]:         <nova:project uuid="801e8ed62c734be5945d8fbf307aa1d2">tempest-AttachVolumeTestJSON-1546562861</nova:project>
Nov 22 14:44:15 user nova-compute[74776]:       </nova:owner>
Nov 22 14:44:15 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:44:15 user nova-compute[74776]:       <nova:ports>
Nov 22 14:44:15 user nova-compute[74776]:         <nova:port uuid="365c5ef1-7abf-4102-a6aa-be03a4f325f2">
Nov 22 14:44:15 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 22 14:44:15 user nova-compute[74776]:         </nova:port>
Nov 22 14:44:15 user nova-compute[74776]:       </nova:ports>
Nov 22 14:44:15 user nova-compute[74776]:     </nova:instance>
Nov 22 14:44:15 user nova-compute[74776]:   </metadata>
Nov 22 14:44:15 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:44:15 user nova-compute[74776]:     <system>
Nov 22 14:44:15 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:44:15 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:44:15 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:44:15 user nova-compute[74776]:       <entry name="serial">c392a863-0d2f-492f-992d-13b21ebd385e</entry>
Nov 22 14:44:15 user nova-compute[74776]:       <entry name="uuid">c392a863-0d2f-492f-992d-13b21ebd385e</entry>
Nov 22 14:44:15 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:44:15 user nova-compute[74776]:     </system>
Nov 22 14:44:15 user nova-compute[74776]:   </sysinfo>
Nov 22 14:44:15 user nova-compute[74776]:   <os>
Nov 22 14:44:15 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:44:15 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:44:15 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:44:15 user nova-compute[74776]:   </os>
Nov 22 14:44:15 user nova-compute[74776]:   <features>
Nov 22 14:44:15 user nova-compute[74776]:     <acpi/>
Nov 22 14:44:15 user nova-compute[74776]:     <apic/>
Nov 22 14:44:15 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:44:15 user nova-compute[74776]:   </features>
Nov 22 14:44:15 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:44:15 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:44:15 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:44:15 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:44:15 user nova-compute[74776]:   </clock>
Nov 22 14:44:15 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:44:15 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:44:15 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:44:15 user nova-compute[74776]:   </cpu>
Nov 22 14:44:15 user nova-compute[74776]:   <devices>
Nov 22 14:44:15 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:44:15 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:44:15 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk"/>
Nov 22 14:44:15 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:44:15 user nova-compute[74776]:     </disk>
Nov 22 14:44:15 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:44:15 user nova-compute[74776]:       <mac address="fa:16:3e:61:95:20"/>
Nov 22 14:44:15 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:44:15 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:44:15 user nova-compute[74776]:       <target dev="tap365c5ef1-7a"/>
Nov 22 14:44:15 user nova-compute[74776]:     </interface>
Nov 22 14:44:15 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:44:15 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/console.log" append="off"/>
Nov 22 14:44:15 user nova-compute[74776]:     </serial>
Nov 22 14:44:15 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:44:15 user nova-compute[74776]:     <video>
Nov 22 14:44:15 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:44:15 user nova-compute[74776]:     </video>
Nov 22 14:44:15 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:44:15 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:44:15 user nova-compute[74776]:     </rng>
Nov 22 14:44:15 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:44:15 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:44:15 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:44:15 user nova-compute[74776]:     </memballoon>
Nov 22 14:44:15 user nova-compute[74776]:   </devices>
Nov 22 14:44:15 user nova-compute[74776]: </domain>
Nov 22 14:44:15 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG nova.objects.instance [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'trusted_certs' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG nova.objects.base [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Object Instance<c392a863-0d2f-492f-992d-13b21ebd385e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Cannot resize image /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG nova.objects.instance [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'migration_context' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG nova.objects.base [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Object Instance<c392a863-0d2f-492f-992d-13b21ebd385e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74776) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1939367355',display_name='tempest-AttachVolumeTestJSON-server-1939367355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1939367355',id=38,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuY5HJNrsYIY3niBmAsaghDVb+I+PBVWqd4MNCFlVINDMvlQLejGFXaXFFq/GrQzsAXjCAdhFS5NiuyPPLqWUQW2pA/3La+hbQ6NADZBNvomwBj1xOQ0pH4ACvIkEkbcw==',key_name='tempest-keypair-1181685632',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:36:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='801e8ed62c734be5945d8fbf307aa1d2',ramdisk_id='',reservation_id='r-d95rnpuu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1546562861',owner_user_name='tempest-AttachVolumeTestJSON-1546562861-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2494e8b489ea48f1a6b3b19eb87b6306',uuid=c392a863-0d2f-492f-992d-13b21ebd385e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converting VIF {"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:95:20,bridge_name='br-int',has_traffic_filtering=True,id=365c5ef1-7abf-4102-a6aa-be03a4f325f2,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365c5ef1-7a') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG os_vif [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:95:20,bridge_name='br-int',has_traffic_filtering=True,id=365c5ef1-7abf-4102-a6aa-be03a4f325f2,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365c5ef1-7a') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0697e9ec-a934-56c0-83ca-babb9e51e3a7', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap365c5ef1-7a, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap365c5ef1-7a, col_values=(('qos', UUID('11f1b0b8-ce0c-4b97-b5c7-15fe1bbfe445')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap365c5ef1-7a, col_values=(('external_ids', {'iface-id': '365c5ef1-7abf-4102-a6aa-be03a4f325f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:95:20', 'vm-uuid': 'c392a863-0d2f-492f-992d-13b21ebd385e'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:44:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:15 user nova-compute[74776]: INFO os_vif [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:95:20,bridge_name='br-int',has_traffic_filtering=True,id=365c5ef1-7abf-4102-a6aa-be03a4f325f2,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365c5ef1-7a')
Nov 22 14:44:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-f0c86ea8-3b1d-4073-bab2-871416978fe8 req-55db92de-c22c-4be0-a46b-9d25d66733b8 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:44:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f0c86ea8-3b1d-4073-bab2-871416978fe8 req-55db92de-c22c-4be0-a46b-9d25d66733b8 service nova] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:44:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f0c86ea8-3b1d-4073-bab2-871416978fe8 req-55db92de-c22c-4be0-a46b-9d25d66733b8 service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:44:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f0c86ea8-3b1d-4073-bab2-871416978fe8 req-55db92de-c22c-4be0-a46b-9d25d66733b8 service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:44:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-f0c86ea8-3b1d-4073-bab2-871416978fe8 req-55db92de-c22c-4be0-a46b-9d25d66733b8 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] No waiting events found dispatching network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:44:17 user nova-compute[74776]: WARNING nova.compute.manager [req-f0c86ea8-3b1d-4073-bab2-871416978fe8 req-55db92de-c22c-4be0-a46b-9d25d66733b8 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received unexpected event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 for instance with vm_state stopped and task_state powering-on.
Nov 22 14:44:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:44:19 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Instance rebooted successfully.
Nov 22 14:44:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-6f040bea-33d6-42e3-ae0c-38297ae8bbf7 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:44:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-341be717-f97a-460d-b196-20f0415ea49c req-6b4a5665-1de6-4ac1-8db7-0d4ce30bcf39 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:44:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-341be717-f97a-460d-b196-20f0415ea49c req-6b4a5665-1de6-4ac1-8db7-0d4ce30bcf39 service nova] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:44:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-341be717-f97a-460d-b196-20f0415ea49c req-6b4a5665-1de6-4ac1-8db7-0d4ce30bcf39 service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:44:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-341be717-f97a-460d-b196-20f0415ea49c req-6b4a5665-1de6-4ac1-8db7-0d4ce30bcf39 service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:44:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-341be717-f97a-460d-b196-20f0415ea49c req-6b4a5665-1de6-4ac1-8db7-0d4ce30bcf39 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] No waiting events found dispatching network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:44:19 user nova-compute[74776]: WARNING nova.compute.manager [req-341be717-f97a-460d-b196-20f0415ea49c req-6b4a5665-1de6-4ac1-8db7-0d4ce30bcf39 service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received unexpected event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 for instance with vm_state active and task_state None.
Nov 22 14:44:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:26 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:44:27 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:44:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:44:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Didn't find any instances for network info cache update. {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 14:44:29 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:44:29 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:44:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:44:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:44:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:44:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:44:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:44:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:44:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:44:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:44:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:44:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:44:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:44:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:44:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:30 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:44:30 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:44:30 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8784MB free_disk=25.106067657470703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:44:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:44:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:44:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance c392a863-0d2f-492f-992d-13b21ebd385e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:44:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:44:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:44:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:44:31 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:44:31 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:44:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:44:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:44:34 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:44:34 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:44:34 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:44:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:44:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:44:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:44:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:44:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:36 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:44:36 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:44:40 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:44:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:42 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:44:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:44:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:45:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:45:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:45:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:45:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:45:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:45:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:45:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:45:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:45:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:45:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:45:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:45:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:45:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:45:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:45:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:45:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:45:26 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:45:27 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:45:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:45:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 14:45:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-c392a863-0d2f-492f-992d-13b21ebd385e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:45:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-c392a863-0d2f-492f-992d-13b21ebd385e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:45:27 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:45:27 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:45:28 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Updating instance_info_cache with network_info: [{"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:45:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-c392a863-0d2f-492f-992d-13b21ebd385e" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:45:28 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:45:29 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:45:29 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:45:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:45:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:45:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:45:29 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:45:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:45:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:45:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:45:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:45:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:45:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:45:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:45:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:45:30 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:45:30 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:45:30 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8829MB free_disk=25.104095458984375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:45:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:45:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:45:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:45:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:45:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:45:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:45:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:45:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:45:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance c392a863-0d2f-492f-992d-13b21ebd385e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:45:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:45:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:45:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:45:31 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:45:31 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:45:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:45:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:45:34 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:45:34 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:45:35 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:45:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:45:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:45:37 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:45:38 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:45:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:45:42 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:45:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:45:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:45:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:45:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:45:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:45:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:45:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:45:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:45:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:45:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:45:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:45:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:45:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:46:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:46:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:46:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:46:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:46:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "c392a863-0d2f-492f-992d-13b21ebd385e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:46:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:46:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:46:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:46:05 user nova-compute[74776]: INFO nova.compute.manager [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Terminating instance
Nov 22 14:46:05 user nova-compute[74776]: DEBUG nova.compute.manager [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:46:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-6d5a7126-9f8c-4a1e-9e9c-998377cd99b6 req-271c0901-e1ae-45fa-99ac-4ff05a701e8a service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received event network-vif-unplugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:46:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6d5a7126-9f8c-4a1e-9e9c-998377cd99b6 req-271c0901-e1ae-45fa-99ac-4ff05a701e8a service nova] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:46:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6d5a7126-9f8c-4a1e-9e9c-998377cd99b6 req-271c0901-e1ae-45fa-99ac-4ff05a701e8a service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:46:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6d5a7126-9f8c-4a1e-9e9c-998377cd99b6 req-271c0901-e1ae-45fa-99ac-4ff05a701e8a service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:46:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-6d5a7126-9f8c-4a1e-9e9c-998377cd99b6 req-271c0901-e1ae-45fa-99ac-4ff05a701e8a service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] No waiting events found dispatching network-vif-unplugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:46:06 user nova-compute[74776]: DEBUG nova.compute.manager [req-6d5a7126-9f8c-4a1e-9e9c-998377cd99b6 req-271c0901-e1ae-45fa-99ac-4ff05a701e8a service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received event network-vif-unplugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:46:06 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Instance destroyed successfully.
Nov 22 14:46:06 user nova-compute[74776]: DEBUG nova.objects.instance [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'resources' on Instance uuid c392a863-0d2f-492f-992d-13b21ebd385e {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:46:06 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1939367355',display_name='tempest-AttachVolumeTestJSON-server-1939367355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1939367355',id=38,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuY5HJNrsYIY3niBmAsaghDVb+I+PBVWqd4MNCFlVINDMvlQLejGFXaXFFq/GrQzsAXjCAdhFS5NiuyPPLqWUQW2pA/3La+hbQ6NADZBNvomwBj1xOQ0pH4ACvIkEkbcw==',key_name='tempest-keypair-1181685632',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:36:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='801e8ed62c734be5945d8fbf307aa1d2',ramdisk_id='',reservation_id='r-d95rnpuu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1546562861',owner_user_name='tempest-AttachVolumeTestJSON-1546562861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2494e8b489ea48f1a6b3b19eb87b6306',uuid=c392a863-0d2f-492f-992d-13b21ebd385e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:46:06 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converting VIF {"id": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "address": "fa:16:3e:61:95:20", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365c5ef1-7a", "ovs_interfaceid": "365c5ef1-7abf-4102-a6aa-be03a4f325f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:46:06 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:95:20,bridge_name='br-int',has_traffic_filtering=True,id=365c5ef1-7abf-4102-a6aa-be03a4f325f2,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365c5ef1-7a') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:46:06 user nova-compute[74776]: DEBUG os_vif [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:95:20,bridge_name='br-int',has_traffic_filtering=True,id=365c5ef1-7abf-4102-a6aa-be03a4f325f2,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365c5ef1-7a') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:46:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap365c5ef1-7a, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:46:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:46:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11f1b0b8-ce0c-4b97-b5c7-15fe1bbfe445) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:46:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:06 user nova-compute[74776]: INFO os_vif [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:95:20,bridge_name='br-int',has_traffic_filtering=True,id=365c5ef1-7abf-4102-a6aa-be03a4f325f2,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365c5ef1-7a')
Nov 22 14:46:06 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Deleting instance files /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e_del
Nov 22 14:46:06 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Deletion of /opt/stack/data/nova/instances/c392a863-0d2f-492f-992d-13b21ebd385e_del complete
Nov 22 14:46:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:06 user nova-compute[74776]: INFO nova.compute.manager [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 22 14:46:06 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:46:06 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:46:06 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:46:07 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:46:07 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Took 0.89 seconds to deallocate network for instance.
Nov 22 14:46:07 user nova-compute[74776]: DEBUG nova.compute.manager [req-4e5b11e6-033f-47ca-b873-0e483acc43a2 req-04b333e7-6dee-4f1c-b8c0-2d87d684065f service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received event network-vif-deleted-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:46:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:46:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:46:07 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:46:07 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:46:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:46:07 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Deleted allocations for instance c392a863-0d2f-492f-992d-13b21ebd385e
Nov 22 14:46:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-c751f2f2-85fe-4bdd-9f6d-6cf3864a9094 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "c392a863-0d2f-492f-992d-13b21ebd385e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.890s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:46:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-05b5eaea-5d6f-44a0-ad9f-739f3bb753f1 req-a1e49c31-2d41-48b0-9c62-8e002af7e44f service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:46:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-05b5eaea-5d6f-44a0-ad9f-739f3bb753f1 req-a1e49c31-2d41-48b0-9c62-8e002af7e44f service nova] Acquiring lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:46:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-05b5eaea-5d6f-44a0-ad9f-739f3bb753f1 req-a1e49c31-2d41-48b0-9c62-8e002af7e44f service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:46:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-05b5eaea-5d6f-44a0-ad9f-739f3bb753f1 req-a1e49c31-2d41-48b0-9c62-8e002af7e44f service nova] Lock "c392a863-0d2f-492f-992d-13b21ebd385e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:46:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-05b5eaea-5d6f-44a0-ad9f-739f3bb753f1 req-a1e49c31-2d41-48b0-9c62-8e002af7e44f service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] No waiting events found dispatching network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:46:08 user nova-compute[74776]: WARNING nova.compute.manager [req-05b5eaea-5d6f-44a0-ad9f-739f3bb753f1 req-a1e49c31-2d41-48b0-9c62-8e002af7e44f service nova] [instance: c392a863-0d2f-492f-992d-13b21ebd385e] Received unexpected event network-vif-plugged-365c5ef1-7abf-4102-a6aa-be03a4f325f2 for instance with vm_state deleted and task_state None.
Nov 22 14:46:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Acquiring lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:46:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:46:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:46:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:46:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:46:19 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:46:19 user nova-compute[74776]: INFO nova.compute.claims [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Claim successful on node user
Nov 22 14:46:19 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:46:19 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:46:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:46:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:46:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:46:19 user nova-compute[74776]: DEBUG nova.network.neutron [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:46:19 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:46:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:46:19 user nova-compute[74776]: DEBUG nova.policy [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd712ee1bb0f74569bf4d9bacef98f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a3c6e5ffb6642bb82ddff083bd606bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:46:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:46:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:46:19 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Creating image(s)
Nov 22 14:46:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Acquiring lock "/opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:46:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "/opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:46:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "/opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.033s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:46:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:46:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:46:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:46:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:46:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:46:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:46:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:46:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk 1073741824" returned: 0 in 0.048s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:46:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:46:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:46:20 user nova-compute[74776]: DEBUG nova.network.neutron [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Successfully created port: 4c2013ce-d3fe-430a-87af-311f123db153 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:46:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.181s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:46:20 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:46:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:46:20 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:46:20 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Cannot resize image /opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:46:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:46:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Ensure instance console log exists: /opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:46:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:46:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:46:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.network.neutron [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Successfully updated port: 4c2013ce-d3fe-430a-87af-311f123db153 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Acquiring lock "refresh_cache-f35efb39-5a5e-4537-a850-0a2ea6b79b7d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Acquired lock "refresh_cache-f35efb39-5a5e-4537-a850-0a2ea6b79b7d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.network.neutron [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-88ec4bc6-ccca-45f1-817f-53a56680e3f1 req-4add4fce-063f-4305-a671-7c0ac45866d2 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Received event network-changed-4c2013ce-d3fe-430a-87af-311f123db153 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-88ec4bc6-ccca-45f1-817f-53a56680e3f1 req-4add4fce-063f-4305-a671-7c0ac45866d2 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Refreshing instance network info cache due to event network-changed-4c2013ce-d3fe-430a-87af-311f123db153. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-88ec4bc6-ccca-45f1-817f-53a56680e3f1 req-4add4fce-063f-4305-a671-7c0ac45866d2 service nova] Acquiring lock "refresh_cache-f35efb39-5a5e-4537-a850-0a2ea6b79b7d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.network.neutron [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.network.neutron [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Updating instance_info_cache with network_info: [{"id": "4c2013ce-d3fe-430a-87af-311f123db153", "address": "fa:16:3e:bf:29:ab", "network": {"id": "0bcb9014-e3d9-4689-b5a2-72e16976a3d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1051624854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3c6e5ffb6642bb82ddff083bd606bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2013ce-d3", "ovs_interfaceid": "4c2013ce-d3fe-430a-87af-311f123db153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Releasing lock "refresh_cache-f35efb39-5a5e-4537-a850-0a2ea6b79b7d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.compute.manager [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Instance network_info: |[{"id": "4c2013ce-d3fe-430a-87af-311f123db153", "address": "fa:16:3e:bf:29:ab", "network": {"id": "0bcb9014-e3d9-4689-b5a2-72e16976a3d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1051624854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3c6e5ffb6642bb82ddff083bd606bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2013ce-d3", "ovs_interfaceid": "4c2013ce-d3fe-430a-87af-311f123db153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-88ec4bc6-ccca-45f1-817f-53a56680e3f1 req-4add4fce-063f-4305-a671-7c0ac45866d2 service nova] Acquired lock "refresh_cache-f35efb39-5a5e-4537-a850-0a2ea6b79b7d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.network.neutron [req-88ec4bc6-ccca-45f1-817f-53a56680e3f1 req-4add4fce-063f-4305-a671-7c0ac45866d2 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Refreshing network info cache for port 4c2013ce-d3fe-430a-87af-311f123db153 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Start _get_guest_xml network_info=[{"id": "4c2013ce-d3fe-430a-87af-311f123db153", "address": "fa:16:3e:bf:29:ab", "network": {"id": "0bcb9014-e3d9-4689-b5a2-72e16976a3d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1051624854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3c6e5ffb6642bb82ddff083bd606bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2013ce-d3", "ovs_interfaceid": "4c2013ce-d3fe-430a-87af-311f123db153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:46:21 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:46:21 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-821003110',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-821003110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8210031',id=41,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoGLcIFl1s504E5cD8SH4eC1OOdNL19jFtv9kVp5d8vjDkNt4Ok3wiztc3G57qU6xA2sQHcWSvY6QEXTtmTLxmBsEwxDwzP7UmT9iRx7MrlMHOcaYy4o+tMAyc7fP8PZw==',key_name='tempest-keypair-918485921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a3c6e5ffb6642bb82ddff083bd606bf',ramdisk_id='',reservation_id='r-fei0m1wu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1589252934',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:46:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d712ee1bb0f74569bf4d9bacef98f885',uuid=f35efb39-5a5e-4537-a850-0a2ea6b79b7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c2013ce-d3fe-430a-87af-311f123db153", "address": "fa:16:3e:bf:29:ab", "network": {"id": "0bcb9014-e3d9-4689-b5a2-72e16976a3d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1051624854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3c6e5ffb6642bb82ddff083bd606bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2013ce-d3", "ovs_interfaceid": "4c2013ce-d3fe-430a-87af-311f123db153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Converting VIF {"id": "4c2013ce-d3fe-430a-87af-311f123db153", "address": "fa:16:3e:bf:29:ab", "network": {"id": "0bcb9014-e3d9-4689-b5a2-72e16976a3d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1051624854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3c6e5ffb6642bb82ddff083bd606bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2013ce-d3", "ovs_interfaceid": "4c2013ce-d3fe-430a-87af-311f123db153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:29:ab,bridge_name='br-int',has_traffic_filtering=True,id=4c2013ce-d3fe-430a-87af-311f123db153,network=Network(0bcb9014-e3d9-4689-b5a2-72e16976a3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c2013ce-d3') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.objects.instance [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lazy-loading 'pci_devices' on Instance uuid f35efb39-5a5e-4537-a850-0a2ea6b79b7d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:46:21 user nova-compute[74776]:   <uuid>f35efb39-5a5e-4537-a850-0a2ea6b79b7d</uuid>
Nov 22 14:46:21 user nova-compute[74776]:   <name>instance-00000029</name>
Nov 22 14:46:21 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:46:21 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:46:21 user nova-compute[74776]:   <metadata>
Nov 22 14:46:21 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:46:21 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:46:21 user nova-compute[74776]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-821003110</nova:name>
Nov 22 14:46:21 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:46:21</nova:creationTime>
Nov 22 14:46:21 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:46:21 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:46:21 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:46:21 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:46:21 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:46:21 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:46:21 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:46:21 user nova-compute[74776]:       <nova:owner>
Nov 22 14:46:21 user nova-compute[74776]:         <nova:user uuid="d712ee1bb0f74569bf4d9bacef98f885">tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member</nova:user>
Nov 22 14:46:21 user nova-compute[74776]:         <nova:project uuid="8a3c6e5ffb6642bb82ddff083bd606bf">tempest-TestServerVolumeAttachScenarioOldVersion-1589252934</nova:project>
Nov 22 14:46:21 user nova-compute[74776]:       </nova:owner>
Nov 22 14:46:21 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:46:21 user nova-compute[74776]:       <nova:ports>
Nov 22 14:46:21 user nova-compute[74776]:         <nova:port uuid="4c2013ce-d3fe-430a-87af-311f123db153">
Nov 22 14:46:21 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 22 14:46:21 user nova-compute[74776]:         </nova:port>
Nov 22 14:46:21 user nova-compute[74776]:       </nova:ports>
Nov 22 14:46:21 user nova-compute[74776]:     </nova:instance>
Nov 22 14:46:21 user nova-compute[74776]:   </metadata>
Nov 22 14:46:21 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:46:21 user nova-compute[74776]:     <system>
Nov 22 14:46:21 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:46:21 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:46:21 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:46:21 user nova-compute[74776]:       <entry name="serial">f35efb39-5a5e-4537-a850-0a2ea6b79b7d</entry>
Nov 22 14:46:21 user nova-compute[74776]:       <entry name="uuid">f35efb39-5a5e-4537-a850-0a2ea6b79b7d</entry>
Nov 22 14:46:21 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:46:21 user nova-compute[74776]:     </system>
Nov 22 14:46:21 user nova-compute[74776]:   </sysinfo>
Nov 22 14:46:21 user nova-compute[74776]:   <os>
Nov 22 14:46:21 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:46:21 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:46:21 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:46:21 user nova-compute[74776]:   </os>
Nov 22 14:46:21 user nova-compute[74776]:   <features>
Nov 22 14:46:21 user nova-compute[74776]:     <acpi/>
Nov 22 14:46:21 user nova-compute[74776]:     <apic/>
Nov 22 14:46:21 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:46:21 user nova-compute[74776]:   </features>
Nov 22 14:46:21 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:46:21 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:46:21 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:46:21 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:46:21 user nova-compute[74776]:   </clock>
Nov 22 14:46:21 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:46:21 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:46:21 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:46:21 user nova-compute[74776]:   </cpu>
Nov 22 14:46:21 user nova-compute[74776]:   <devices>
Nov 22 14:46:21 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:46:21 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:46:21 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk"/>
Nov 22 14:46:21 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:46:21 user nova-compute[74776]:     </disk>
Nov 22 14:46:21 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:46:21 user nova-compute[74776]:       <mac address="fa:16:3e:bf:29:ab"/>
Nov 22 14:46:21 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:46:21 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:46:21 user nova-compute[74776]:       <target dev="tap4c2013ce-d3"/>
Nov 22 14:46:21 user nova-compute[74776]:     </interface>
Nov 22 14:46:21 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:46:21 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/console.log" append="off"/>
Nov 22 14:46:21 user nova-compute[74776]:     </serial>
Nov 22 14:46:21 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:46:21 user nova-compute[74776]:     <video>
Nov 22 14:46:21 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:46:21 user nova-compute[74776]:     </video>
Nov 22 14:46:21 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:46:21 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:46:21 user nova-compute[74776]:     </rng>
Nov 22 14:46:21 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:46:21 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:46:21 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:46:21 user nova-compute[74776]:     </memballoon>
Nov 22 14:46:21 user nova-compute[74776]:   </devices>
Nov 22 14:46:21 user nova-compute[74776]: </domain>
Nov 22 14:46:21 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-821003110',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-821003110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8210031',id=41,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoGLcIFl1s504E5cD8SH4eC1OOdNL19jFtv9kVp5d8vjDkNt4Ok3wiztc3G57qU6xA2sQHcWSvY6QEXTtmTLxmBsEwxDwzP7UmT9iRx7MrlMHOcaYy4o+tMAyc7fP8PZw==',key_name='tempest-keypair-918485921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a3c6e5ffb6642bb82ddff083bd606bf',ramdisk_id='',reservation_id='r-fei0m1wu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1589252934',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:46:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d712ee1bb0f74569bf4d9bacef98f885',uuid=f35efb39-5a5e-4537-a850-0a2ea6b79b7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c2013ce-d3fe-430a-87af-311f123db153", "address": "fa:16:3e:bf:29:ab", "network": {"id": "0bcb9014-e3d9-4689-b5a2-72e16976a3d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1051624854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3c6e5ffb6642bb82ddff083bd606bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2013ce-d3", "ovs_interfaceid": "4c2013ce-d3fe-430a-87af-311f123db153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Converting VIF {"id": "4c2013ce-d3fe-430a-87af-311f123db153", "address": "fa:16:3e:bf:29:ab", "network": {"id": "0bcb9014-e3d9-4689-b5a2-72e16976a3d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1051624854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3c6e5ffb6642bb82ddff083bd606bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2013ce-d3", "ovs_interfaceid": "4c2013ce-d3fe-430a-87af-311f123db153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:29:ab,bridge_name='br-int',has_traffic_filtering=True,id=4c2013ce-d3fe-430a-87af-311f123db153,network=Network(0bcb9014-e3d9-4689-b5a2-72e16976a3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c2013ce-d3') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG os_vif [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:29:ab,bridge_name='br-int',has_traffic_filtering=True,id=4c2013ce-d3fe-430a-87af-311f123db153,network=Network(0bcb9014-e3d9-4689-b5a2-72e16976a3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c2013ce-d3') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8bfcd772-09c3-57eb-8cf6-e1aab9a5959a', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c2013ce-d3, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c2013ce-d3, col_values=(('qos', UUID('4a780fec-e2ff-45df-b7fc-6f6316e038a9')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c2013ce-d3, col_values=(('external_ids', {'iface-id': '4c2013ce-d3fe-430a-87af-311f123db153', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:29:ab', 'vm-uuid': 'f35efb39-5a5e-4537-a850-0a2ea6b79b7d'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:21 user nova-compute[74776]: INFO os_vif [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:29:ab,bridge_name='br-int',has_traffic_filtering=True,id=4c2013ce-d3fe-430a-87af-311f123db153,network=Network(0bcb9014-e3d9-4689-b5a2-72e16976a3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c2013ce-d3')
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] No VIF found with MAC fa:16:3e:bf:29:ab, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.network.neutron [req-88ec4bc6-ccca-45f1-817f-53a56680e3f1 req-4add4fce-063f-4305-a671-7c0ac45866d2 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Updated VIF entry in instance network info cache for port 4c2013ce-d3fe-430a-87af-311f123db153. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG nova.network.neutron [req-88ec4bc6-ccca-45f1-817f-53a56680e3f1 req-4add4fce-063f-4305-a671-7c0ac45866d2 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Updating instance_info_cache with network_info: [{"id": "4c2013ce-d3fe-430a-87af-311f123db153", "address": "fa:16:3e:bf:29:ab", "network": {"id": "0bcb9014-e3d9-4689-b5a2-72e16976a3d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1051624854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3c6e5ffb6642bb82ddff083bd606bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2013ce-d3", "ovs_interfaceid": "4c2013ce-d3fe-430a-87af-311f123db153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:46:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-88ec4bc6-ccca-45f1-817f-53a56680e3f1 req-4add4fce-063f-4305-a671-7c0ac45866d2 service nova] Releasing lock "refresh_cache-f35efb39-5a5e-4537-a850-0a2ea6b79b7d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:46:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:22 user nova-compute[74776]: DEBUG nova.compute.manager [req-3f91fa6b-ef81-4378-8143-eeb494638da5 req-8bcc679e-0d49-412b-b134-24cd3f576d46 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Received event network-vif-plugged-4c2013ce-d3fe-430a-87af-311f123db153 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:46:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3f91fa6b-ef81-4378-8143-eeb494638da5 req-8bcc679e-0d49-412b-b134-24cd3f576d46 service nova] Acquiring lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:46:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3f91fa6b-ef81-4378-8143-eeb494638da5 req-8bcc679e-0d49-412b-b134-24cd3f576d46 service nova] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:46:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-3f91fa6b-ef81-4378-8143-eeb494638da5 req-8bcc679e-0d49-412b-b134-24cd3f576d46 service nova] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:46:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-3f91fa6b-ef81-4378-8143-eeb494638da5 req-8bcc679e-0d49-412b-b134-24cd3f576d46 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] No waiting events found dispatching network-vif-plugged-4c2013ce-d3fe-430a-87af-311f123db153 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:46:23 user nova-compute[74776]: WARNING nova.compute.manager [req-3f91fa6b-ef81-4378-8143-eeb494638da5 req-8bcc679e-0d49-412b-b134-24cd3f576d46 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Received unexpected event network-vif-plugged-4c2013ce-d3fe-430a-87af-311f123db153 for instance with vm_state building and task_state spawning.
Nov 22 14:46:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:24 user nova-compute[74776]: DEBUG nova.compute.manager [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:46:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:46:24 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Instance spawned successfully.
Nov 22 14:46:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:46:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:46:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:46:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:46:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:46:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:46:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:46:25 user nova-compute[74776]: INFO nova.compute.manager [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 22 14:46:25 user nova-compute[74776]: DEBUG nova.compute.manager [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:46:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-1f6773ba-dcb9-4948-aae3-39797138491b req-320a4354-a3a5-43ca-aff8-2734ffbb3e79 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Received event network-vif-plugged-4c2013ce-d3fe-430a-87af-311f123db153 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:46:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1f6773ba-dcb9-4948-aae3-39797138491b req-320a4354-a3a5-43ca-aff8-2734ffbb3e79 service nova] Acquiring lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:46:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1f6773ba-dcb9-4948-aae3-39797138491b req-320a4354-a3a5-43ca-aff8-2734ffbb3e79 service nova] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:46:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1f6773ba-dcb9-4948-aae3-39797138491b req-320a4354-a3a5-43ca-aff8-2734ffbb3e79 service nova] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:46:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-1f6773ba-dcb9-4948-aae3-39797138491b req-320a4354-a3a5-43ca-aff8-2734ffbb3e79 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] No waiting events found dispatching network-vif-plugged-4c2013ce-d3fe-430a-87af-311f123db153 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:46:25 user nova-compute[74776]: WARNING nova.compute.manager [req-1f6773ba-dcb9-4948-aae3-39797138491b req-320a4354-a3a5-43ca-aff8-2734ffbb3e79 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Received unexpected event network-vif-plugged-4c2013ce-d3fe-430a-87af-311f123db153 for instance with vm_state building and task_state spawning.
Nov 22 14:46:25 user nova-compute[74776]: INFO nova.compute.manager [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Took 5.71 seconds to build instance.
Nov 22 14:46:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-11a2cb9a-3f4e-46a6-b333-e6c42691e010 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.800s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:46:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:27 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:46:27 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:46:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:46:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:46:27 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:46:28 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Updating instance_info_cache with network_info: [{"id": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "address": "fa:16:3e:1c:18:6c", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda635911-c5", "ovs_interfaceid": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:46:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:46:28 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:46:28 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:46:30 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:46:30 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:46:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:46:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:46:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:46:30 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:46:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:46:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:46:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:46:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:46:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:46:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:46:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:46:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:46:31 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:46:31 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:46:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8828MB free_disk=25.12802505493164GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:46:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:46:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:46:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:46:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f35efb39-5a5e-4537-a850-0a2ea6b79b7d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:46:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:46:31 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:46:32 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:46:32 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:46:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:46:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:46:35 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:46:35 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:46:35 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:46:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:46:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:46:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:46:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:46:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:38 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:46:39 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:46:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:42 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:46:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:46 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:46:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:46:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "98710934-6b96-477b-b4d6-d0d416de3a21" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:46:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "98710934-6b96-477b-b4d6-d0d416de3a21" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:46:59 user nova-compute[74776]: DEBUG nova.compute.manager [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:46:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:46:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:46:59 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:46:59 user nova-compute[74776]: INFO nova.compute.claims [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Claim successful on node user
Nov 22 14:46:59 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:46:59 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:46:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:46:59 user nova-compute[74776]: DEBUG nova.compute.manager [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG nova.compute.manager [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG nova.network.neutron [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:47:00 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:47:00 user nova-compute[74776]: DEBUG nova.compute.manager [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG nova.policy [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2494e8b489ea48f1a6b3b19eb87b6306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e8ed62c734be5945d8fbf307aa1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG nova.compute.manager [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:47:00 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Creating image(s)
Nov 22 14:47:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "/opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "/opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "/opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.185s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.193s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk 1073741824" returned: 0 in 0.052s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG nova.network.neutron [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Successfully created port: 8996253c-5555-4f6a-b018-2be387ee55b8 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.185s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Cannot resize image /opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Ensure instance console log exists: /opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:47:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.network.neutron [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Successfully updated port: 8996253c-5555-4f6a-b018-2be387ee55b8 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "refresh_cache-98710934-6b96-477b-b4d6-d0d416de3a21" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquired lock "refresh_cache-98710934-6b96-477b-b4d6-d0d416de3a21" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.network.neutron [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.compute.manager [req-efcd72a7-2fa2-45ee-af3d-053f10139871 req-367115c2-000a-479f-856d-93af9ac3e5de service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Received event network-changed-8996253c-5555-4f6a-b018-2be387ee55b8 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.compute.manager [req-efcd72a7-2fa2-45ee-af3d-053f10139871 req-367115c2-000a-479f-856d-93af9ac3e5de service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Refreshing instance network info cache due to event network-changed-8996253c-5555-4f6a-b018-2be387ee55b8. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-efcd72a7-2fa2-45ee-af3d-053f10139871 req-367115c2-000a-479f-856d-93af9ac3e5de service nova] Acquiring lock "refresh_cache-98710934-6b96-477b-b4d6-d0d416de3a21" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.network.neutron [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.network.neutron [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Updating instance_info_cache with network_info: [{"id": "8996253c-5555-4f6a-b018-2be387ee55b8", "address": "fa:16:3e:ae:f2:3b", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8996253c-55", "ovs_interfaceid": "8996253c-5555-4f6a-b018-2be387ee55b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Releasing lock "refresh_cache-98710934-6b96-477b-b4d6-d0d416de3a21" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.compute.manager [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Instance network_info: |[{"id": "8996253c-5555-4f6a-b018-2be387ee55b8", "address": "fa:16:3e:ae:f2:3b", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8996253c-55", "ovs_interfaceid": "8996253c-5555-4f6a-b018-2be387ee55b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-efcd72a7-2fa2-45ee-af3d-053f10139871 req-367115c2-000a-479f-856d-93af9ac3e5de service nova] Acquired lock "refresh_cache-98710934-6b96-477b-b4d6-d0d416de3a21" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.network.neutron [req-efcd72a7-2fa2-45ee-af3d-053f10139871 req-367115c2-000a-479f-856d-93af9ac3e5de service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Refreshing network info cache for port 8996253c-5555-4f6a-b018-2be387ee55b8 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Start _get_guest_xml network_info=[{"id": "8996253c-5555-4f6a-b018-2be387ee55b8", "address": "fa:16:3e:ae:f2:3b", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8996253c-55", "ovs_interfaceid": "8996253c-5555-4f6a-b018-2be387ee55b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:47:01 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:47:01 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:46:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1657137372',display_name='tempest-AttachVolumeTestJSON-server-1657137372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1657137372',id=42,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9PJvae8bimOZzh6noy9gYYVV/QbOEUnlmktJvExfKs+DecUXkupBkRkDKj2iJ8c+QUxWpu+j5SWF2EHRmxiHzYTz8GGI8lWt+wI7LlSjAtYdTTB+0jv8vCu/KA4vlRIg==',key_name='tempest-keypair-1906724194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='801e8ed62c734be5945d8fbf307aa1d2',ramdisk_id='',reservation_id='r-4xlwasel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1546562861',owner_user_name='tempest-AttachVolumeTestJSON-1546562861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2494e8b489ea48f1a6b3b19eb87b6306',uuid=98710934-6b96-477b-b4d6-d0d416de3a21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8996253c-5555-4f6a-b018-2be387ee55b8", "address": "fa:16:3e:ae:f2:3b", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8996253c-55", "ovs_interfaceid": "8996253c-5555-4f6a-b018-2be387ee55b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converting VIF {"id": "8996253c-5555-4f6a-b018-2be387ee55b8", "address": "fa:16:3e:ae:f2:3b", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8996253c-55", "ovs_interfaceid": "8996253c-5555-4f6a-b018-2be387ee55b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:f2:3b,bridge_name='br-int',has_traffic_filtering=True,id=8996253c-5555-4f6a-b018-2be387ee55b8,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8996253c-55') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.objects.instance [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'pci_devices' on Instance uuid 98710934-6b96-477b-b4d6-d0d416de3a21 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:47:01 user nova-compute[74776]:   <uuid>98710934-6b96-477b-b4d6-d0d416de3a21</uuid>
Nov 22 14:47:01 user nova-compute[74776]:   <name>instance-0000002a</name>
Nov 22 14:47:01 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:47:01 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:47:01 user nova-compute[74776]:   <metadata>
Nov 22 14:47:01 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:47:01 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:47:01 user nova-compute[74776]:       <nova:name>tempest-AttachVolumeTestJSON-server-1657137372</nova:name>
Nov 22 14:47:01 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:47:01</nova:creationTime>
Nov 22 14:47:01 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:47:01 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:47:01 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:47:01 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:47:01 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:47:01 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:47:01 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:47:01 user nova-compute[74776]:       <nova:owner>
Nov 22 14:47:01 user nova-compute[74776]:         <nova:user uuid="2494e8b489ea48f1a6b3b19eb87b6306">tempest-AttachVolumeTestJSON-1546562861-project-member</nova:user>
Nov 22 14:47:01 user nova-compute[74776]:         <nova:project uuid="801e8ed62c734be5945d8fbf307aa1d2">tempest-AttachVolumeTestJSON-1546562861</nova:project>
Nov 22 14:47:01 user nova-compute[74776]:       </nova:owner>
Nov 22 14:47:01 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:47:01 user nova-compute[74776]:       <nova:ports>
Nov 22 14:47:01 user nova-compute[74776]:         <nova:port uuid="8996253c-5555-4f6a-b018-2be387ee55b8">
Nov 22 14:47:01 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 22 14:47:01 user nova-compute[74776]:         </nova:port>
Nov 22 14:47:01 user nova-compute[74776]:       </nova:ports>
Nov 22 14:47:01 user nova-compute[74776]:     </nova:instance>
Nov 22 14:47:01 user nova-compute[74776]:   </metadata>
Nov 22 14:47:01 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:47:01 user nova-compute[74776]:     <system>
Nov 22 14:47:01 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:47:01 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:47:01 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:47:01 user nova-compute[74776]:       <entry name="serial">98710934-6b96-477b-b4d6-d0d416de3a21</entry>
Nov 22 14:47:01 user nova-compute[74776]:       <entry name="uuid">98710934-6b96-477b-b4d6-d0d416de3a21</entry>
Nov 22 14:47:01 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:47:01 user nova-compute[74776]:     </system>
Nov 22 14:47:01 user nova-compute[74776]:   </sysinfo>
Nov 22 14:47:01 user nova-compute[74776]:   <os>
Nov 22 14:47:01 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:47:01 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:47:01 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:47:01 user nova-compute[74776]:   </os>
Nov 22 14:47:01 user nova-compute[74776]:   <features>
Nov 22 14:47:01 user nova-compute[74776]:     <acpi/>
Nov 22 14:47:01 user nova-compute[74776]:     <apic/>
Nov 22 14:47:01 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:47:01 user nova-compute[74776]:   </features>
Nov 22 14:47:01 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:47:01 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:47:01 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:47:01 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:47:01 user nova-compute[74776]:   </clock>
Nov 22 14:47:01 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:47:01 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:47:01 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:47:01 user nova-compute[74776]:   </cpu>
Nov 22 14:47:01 user nova-compute[74776]:   <devices>
Nov 22 14:47:01 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:47:01 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:47:01 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk"/>
Nov 22 14:47:01 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:47:01 user nova-compute[74776]:     </disk>
Nov 22 14:47:01 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:47:01 user nova-compute[74776]:       <mac address="fa:16:3e:ae:f2:3b"/>
Nov 22 14:47:01 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:47:01 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:47:01 user nova-compute[74776]:       <target dev="tap8996253c-55"/>
Nov 22 14:47:01 user nova-compute[74776]:     </interface>
Nov 22 14:47:01 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:47:01 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/console.log" append="off"/>
Nov 22 14:47:01 user nova-compute[74776]:     </serial>
Nov 22 14:47:01 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:47:01 user nova-compute[74776]:     <video>
Nov 22 14:47:01 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:47:01 user nova-compute[74776]:     </video>
Nov 22 14:47:01 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:47:01 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:47:01 user nova-compute[74776]:     </rng>
Nov 22 14:47:01 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:47:01 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:47:01 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:47:01 user nova-compute[74776]:     </memballoon>
Nov 22 14:47:01 user nova-compute[74776]:   </devices>
Nov 22 14:47:01 user nova-compute[74776]: </domain>
Nov 22 14:47:01 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:46:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1657137372',display_name='tempest-AttachVolumeTestJSON-server-1657137372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1657137372',id=42,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9PJvae8bimOZzh6noy9gYYVV/QbOEUnlmktJvExfKs+DecUXkupBkRkDKj2iJ8c+QUxWpu+j5SWF2EHRmxiHzYTz8GGI8lWt+wI7LlSjAtYdTTB+0jv8vCu/KA4vlRIg==',key_name='tempest-keypair-1906724194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='801e8ed62c734be5945d8fbf307aa1d2',ramdisk_id='',reservation_id='r-4xlwasel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1546562861',owner_user_name='tempest-AttachVolumeTestJSON-1546562861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2494e8b489ea48f1a6b3b19eb87b6306',uuid=98710934-6b96-477b-b4d6-d0d416de3a21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8996253c-5555-4f6a-b018-2be387ee55b8", "address": "fa:16:3e:ae:f2:3b", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8996253c-55", "ovs_interfaceid": "8996253c-5555-4f6a-b018-2be387ee55b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converting VIF {"id": "8996253c-5555-4f6a-b018-2be387ee55b8", "address": "fa:16:3e:ae:f2:3b", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8996253c-55", "ovs_interfaceid": "8996253c-5555-4f6a-b018-2be387ee55b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:f2:3b,bridge_name='br-int',has_traffic_filtering=True,id=8996253c-5555-4f6a-b018-2be387ee55b8,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8996253c-55') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG os_vif [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:f2:3b,bridge_name='br-int',has_traffic_filtering=True,id=8996253c-5555-4f6a-b018-2be387ee55b8,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8996253c-55') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32bf8c92-f88c-5b10-aeb9-78bd6221358d', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8996253c-55, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8996253c-55, col_values=(('qos', UUID('814d32ec-bc8f-4dd5-8001-df6a80beb7bc')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8996253c-55, col_values=(('external_ids', {'iface-id': '8996253c-5555-4f6a-b018-2be387ee55b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:f2:3b', 'vm-uuid': '98710934-6b96-477b-b4d6-d0d416de3a21'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:47:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:01 user nova-compute[74776]: INFO os_vif [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:f2:3b,bridge_name='br-int',has_traffic_filtering=True,id=8996253c-5555-4f6a-b018-2be387ee55b8,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8996253c-55')
Nov 22 14:47:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:47:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] No VIF found with MAC fa:16:3e:ae:f2:3b, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:47:02 user nova-compute[74776]: DEBUG nova.network.neutron [req-efcd72a7-2fa2-45ee-af3d-053f10139871 req-367115c2-000a-479f-856d-93af9ac3e5de service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Updated VIF entry in instance network info cache for port 8996253c-5555-4f6a-b018-2be387ee55b8. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:47:02 user nova-compute[74776]: DEBUG nova.network.neutron [req-efcd72a7-2fa2-45ee-af3d-053f10139871 req-367115c2-000a-479f-856d-93af9ac3e5de service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Updating instance_info_cache with network_info: [{"id": "8996253c-5555-4f6a-b018-2be387ee55b8", "address": "fa:16:3e:ae:f2:3b", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8996253c-55", "ovs_interfaceid": "8996253c-5555-4f6a-b018-2be387ee55b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:47:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-efcd72a7-2fa2-45ee-af3d-053f10139871 req-367115c2-000a-479f-856d-93af9ac3e5de service nova] Releasing lock "refresh_cache-98710934-6b96-477b-b4d6-d0d416de3a21" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:47:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:03 user nova-compute[74776]: DEBUG nova.compute.manager [req-0b001095-73d7-4e96-8df2-4ba5f8081e51 req-c4d5f61f-6a46-492d-9d13-c9638779d5d6 service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Received event network-vif-plugged-8996253c-5555-4f6a-b018-2be387ee55b8 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:47:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0b001095-73d7-4e96-8df2-4ba5f8081e51 req-c4d5f61f-6a46-492d-9d13-c9638779d5d6 service nova] Acquiring lock "98710934-6b96-477b-b4d6-d0d416de3a21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:47:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0b001095-73d7-4e96-8df2-4ba5f8081e51 req-c4d5f61f-6a46-492d-9d13-c9638779d5d6 service nova] Lock "98710934-6b96-477b-b4d6-d0d416de3a21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:47:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0b001095-73d7-4e96-8df2-4ba5f8081e51 req-c4d5f61f-6a46-492d-9d13-c9638779d5d6 service nova] Lock "98710934-6b96-477b-b4d6-d0d416de3a21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:47:03 user nova-compute[74776]: DEBUG nova.compute.manager [req-0b001095-73d7-4e96-8df2-4ba5f8081e51 req-c4d5f61f-6a46-492d-9d13-c9638779d5d6 service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] No waiting events found dispatching network-vif-plugged-8996253c-5555-4f6a-b018-2be387ee55b8 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:47:03 user nova-compute[74776]: WARNING nova.compute.manager [req-0b001095-73d7-4e96-8df2-4ba5f8081e51 req-c4d5f61f-6a46-492d-9d13-c9638779d5d6 service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Received unexpected event network-vif-plugged-8996253c-5555-4f6a-b018-2be387ee55b8 for instance with vm_state building and task_state spawning.
Nov 22 14:47:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:05 user nova-compute[74776]: DEBUG nova.compute.manager [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:47:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:47:05 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Instance spawned successfully.
Nov 22 14:47:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:47:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:47:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:47:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:47:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:47:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:47:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:47:05 user nova-compute[74776]: INFO nova.compute.manager [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 22 14:47:05 user nova-compute[74776]: DEBUG nova.compute.manager [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:47:05 user nova-compute[74776]: DEBUG nova.compute.manager [req-7c589b93-fd2b-42f7-b28b-5d2f8271d916 req-84f96ccb-0414-487d-b0a3-c7936234acd6 service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Received event network-vif-plugged-8996253c-5555-4f6a-b018-2be387ee55b8 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:47:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7c589b93-fd2b-42f7-b28b-5d2f8271d916 req-84f96ccb-0414-487d-b0a3-c7936234acd6 service nova] Acquiring lock "98710934-6b96-477b-b4d6-d0d416de3a21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:47:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7c589b93-fd2b-42f7-b28b-5d2f8271d916 req-84f96ccb-0414-487d-b0a3-c7936234acd6 service nova] Lock "98710934-6b96-477b-b4d6-d0d416de3a21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:47:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7c589b93-fd2b-42f7-b28b-5d2f8271d916 req-84f96ccb-0414-487d-b0a3-c7936234acd6 service nova] Lock "98710934-6b96-477b-b4d6-d0d416de3a21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:47:05 user nova-compute[74776]: DEBUG nova.compute.manager [req-7c589b93-fd2b-42f7-b28b-5d2f8271d916 req-84f96ccb-0414-487d-b0a3-c7936234acd6 service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] No waiting events found dispatching network-vif-plugged-8996253c-5555-4f6a-b018-2be387ee55b8 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:47:05 user nova-compute[74776]: WARNING nova.compute.manager [req-7c589b93-fd2b-42f7-b28b-5d2f8271d916 req-84f96ccb-0414-487d-b0a3-c7936234acd6 service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Received unexpected event network-vif-plugged-8996253c-5555-4f6a-b018-2be387ee55b8 for instance with vm_state building and task_state spawning.
Nov 22 14:47:05 user nova-compute[74776]: INFO nova.compute.manager [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Took 6.14 seconds to build instance.
Nov 22 14:47:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2e16ec58-b9ce-4c91-a0e1-a8cf64f04489 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "98710934-6b96-477b-b4d6-d0d416de3a21" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.233s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:47:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Acquiring lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:47:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:47:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Acquiring lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:47:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:47:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:47:08 user nova-compute[74776]: INFO nova.compute.manager [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Terminating instance
Nov 22 14:47:08 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:47:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-499bb505-fa1f-4b7e-9647-4dd12c770b7c req-68726f9b-7c7b-46d1-b23c-70161f8e4380 service nova] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Received event network-vif-unplugged-da635911-c5a6-4a05-a14f-f19d94a6e6fd {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:47:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-499bb505-fa1f-4b7e-9647-4dd12c770b7c req-68726f9b-7c7b-46d1-b23c-70161f8e4380 service nova] Acquiring lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:47:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-499bb505-fa1f-4b7e-9647-4dd12c770b7c req-68726f9b-7c7b-46d1-b23c-70161f8e4380 service nova] Lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:47:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-499bb505-fa1f-4b7e-9647-4dd12c770b7c req-68726f9b-7c7b-46d1-b23c-70161f8e4380 service nova] Lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:47:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-499bb505-fa1f-4b7e-9647-4dd12c770b7c req-68726f9b-7c7b-46d1-b23c-70161f8e4380 service nova] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] No waiting events found dispatching network-vif-unplugged-da635911-c5a6-4a05-a14f-f19d94a6e6fd {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:47:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-499bb505-fa1f-4b7e-9647-4dd12c770b7c req-68726f9b-7c7b-46d1-b23c-70161f8e4380 service nova] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Received event network-vif-unplugged-da635911-c5a6-4a05-a14f-f19d94a6e6fd for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:47:09 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Instance destroyed successfully.
Nov 22 14:47:09 user nova-compute[74776]: DEBUG nova.objects.instance [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lazy-loading 'resources' on Instance uuid dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:47:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:38:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1956793021',display_name='tempest-ServersNegativeTestJSON-server-1956793021',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1956793021',id=39,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:38:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9fc1a673644b4227a3b00fcd84a68207',ramdisk_id='',reservation_id='r-t4z2v6cv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-704417429',owner_user_name='tempest-ServersNegativeTestJSON-704417429-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:38:27Z,user_data=None,user_id='9a13b1e5b2494485aedb60ce10cdff29',uuid=dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "address": "fa:16:3e:1c:18:6c", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda635911-c5", "ovs_interfaceid": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:47:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Converting VIF {"id": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "address": "fa:16:3e:1c:18:6c", "network": {"id": "3b251e44-6e92-4252-8e46-710de94e597f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1901171854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fc1a673644b4227a3b00fcd84a68207", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda635911-c5", "ovs_interfaceid": "da635911-c5a6-4a05-a14f-f19d94a6e6fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:47:09 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:18:6c,bridge_name='br-int',has_traffic_filtering=True,id=da635911-c5a6-4a05-a14f-f19d94a6e6fd,network=Network(3b251e44-6e92-4252-8e46-710de94e597f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda635911-c5') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:47:09 user nova-compute[74776]: DEBUG os_vif [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:18:6c,bridge_name='br-int',has_traffic_filtering=True,id=da635911-c5a6-4a05-a14f-f19d94a6e6fd,network=Network(3b251e44-6e92-4252-8e46-710de94e597f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda635911-c5') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:47:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda635911-c5, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:47:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:47:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7641622-ef49-4185-9f0b-b1ffc9f30a59) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:47:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:09 user nova-compute[74776]: INFO os_vif [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:18:6c,bridge_name='br-int',has_traffic_filtering=True,id=da635911-c5a6-4a05-a14f-f19d94a6e6fd,network=Network(3b251e44-6e92-4252-8e46-710de94e597f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda635911-c5')
Nov 22 14:47:09 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Deleting instance files /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9_del
Nov 22 14:47:09 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Deletion of /opt/stack/data/nova/instances/dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9_del complete
Nov 22 14:47:09 user nova-compute[74776]: INFO nova.compute.manager [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 22 14:47:09 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:47:09 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:47:09 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:47:09 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:47:10 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Took 0.50 seconds to deallocate network for instance.
Nov 22 14:47:10 user nova-compute[74776]: DEBUG nova.compute.manager [req-fc8a24f9-20fe-4394-9b0c-b15c58744cb0 req-22cfa6d6-fffd-46a5-8fe3-8740338e9d2b service nova] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Received event network-vif-deleted-da635911-c5a6-4a05-a14f-f19d94a6e6fd {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:47:10 user nova-compute[74776]: INFO nova.compute.manager [req-fc8a24f9-20fe-4394-9b0c-b15c58744cb0 req-22cfa6d6-fffd-46a5-8fe3-8740338e9d2b service nova] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Neutron deleted interface da635911-c5a6-4a05-a14f-f19d94a6e6fd; detaching it from the instance and deleting it from the info cache
Nov 22 14:47:10 user nova-compute[74776]: DEBUG nova.network.neutron [req-fc8a24f9-20fe-4394-9b0c-b15c58744cb0 req-22cfa6d6-fffd-46a5-8fe3-8740338e9d2b service nova] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:47:10 user nova-compute[74776]: DEBUG nova.compute.manager [req-fc8a24f9-20fe-4394-9b0c-b15c58744cb0 req-22cfa6d6-fffd-46a5-8fe3-8740338e9d2b service nova] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Detach interface failed, port_id=da635911-c5a6-4a05-a14f-f19d94a6e6fd, reason: Instance dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9 could not be found. {{(pid=74776) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 14:47:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:47:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:47:10 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:47:10 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:47:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:47:10 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Deleted allocations for instance dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9
Nov 22 14:47:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4ce9aee2-2b82-44c5-a96a-58fb1d154e40 tempest-ServersNegativeTestJSON-704417429 tempest-ServersNegativeTestJSON-704417429-project-member] Lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.075s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:47:10 user nova-compute[74776]: DEBUG nova.compute.manager [req-5da92001-25ca-45a9-ac4d-dae4c5116cab req-771b223e-d9e7-4649-8f9f-a6cc9fe2c21c service nova] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Received event network-vif-plugged-da635911-c5a6-4a05-a14f-f19d94a6e6fd {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:47:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5da92001-25ca-45a9-ac4d-dae4c5116cab req-771b223e-d9e7-4649-8f9f-a6cc9fe2c21c service nova] Acquiring lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:47:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5da92001-25ca-45a9-ac4d-dae4c5116cab req-771b223e-d9e7-4649-8f9f-a6cc9fe2c21c service nova] Lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:47:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5da92001-25ca-45a9-ac4d-dae4c5116cab req-771b223e-d9e7-4649-8f9f-a6cc9fe2c21c service nova] Lock "dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:47:10 user nova-compute[74776]: DEBUG nova.compute.manager [req-5da92001-25ca-45a9-ac4d-dae4c5116cab req-771b223e-d9e7-4649-8f9f-a6cc9fe2c21c service nova] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] No waiting events found dispatching network-vif-plugged-da635911-c5a6-4a05-a14f-f19d94a6e6fd {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:47:10 user nova-compute[74776]: WARNING nova.compute.manager [req-5da92001-25ca-45a9-ac4d-dae4c5116cab req-771b223e-d9e7-4649-8f9f-a6cc9fe2c21c service nova] [instance: dd7c8580-f9bc-47f7-9ed6-ea7d0723e1f9] Received unexpected event network-vif-plugged-da635911-c5a6-4a05-a14f-f19d94a6e6fd for instance with vm_state deleted and task_state None.
Nov 22 14:47:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:28 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:47:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:29 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:47:29 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:47:29 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 14:47:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-f35efb39-5a5e-4537-a850-0a2ea6b79b7d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:47:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-f35efb39-5a5e-4537-a850-0a2ea6b79b7d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:47:29 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:47:29 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid f35efb39-5a5e-4537-a850-0a2ea6b79b7d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:47:30 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Updating instance_info_cache with network_info: [{"id": "4c2013ce-d3fe-430a-87af-311f123db153", "address": "fa:16:3e:bf:29:ab", "network": {"id": "0bcb9014-e3d9-4689-b5a2-72e16976a3d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1051624854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3c6e5ffb6642bb82ddff083bd606bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2013ce-d3", "ovs_interfaceid": "4c2013ce-d3fe-430a-87af-311f123db153", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:47:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-f35efb39-5a5e-4537-a850-0a2ea6b79b7d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:47:30 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:47:30 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:47:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:47:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:47:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:47:30 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:47:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:47:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:47:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:47:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:47:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:47:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:47:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:47:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:47:32 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:47:32 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:47:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8710MB free_disk=25.098217010498047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:47:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:47:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:47:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f35efb39-5a5e-4537-a850-0a2ea6b79b7d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:47:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 98710934-6b96-477b-b4d6-d0d416de3a21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:47:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:47:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:47:32 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing inventories for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 14:47:32 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating ProviderTree inventory for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 14:47:32 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating inventory in ProviderTree for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 14:47:32 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing aggregate associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, aggregates: None {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 14:47:32 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing trait associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 14:47:32 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:47:32 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:47:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:47:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.451s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:47:33 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:47:33 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:47:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:47:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:35 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:47:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:36 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:47:38 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:47:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:39 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:47:39 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:47:39 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74776) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 14:47:42 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:47:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:47:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:47:51 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:47:51 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 14:47:51 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] There are 0 instances to clean {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 14:47:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:47:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:48:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:48:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:48:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:48:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:48:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:10 user nova-compute[74776]: DEBUG nova.compute.manager [req-62f8b33d-224b-4828-9d9e-5a92f3d0b90d req-797898e3-c81d-486e-a3e1-ee73d685d1b2 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Received event network-changed-4c2013ce-d3fe-430a-87af-311f123db153 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:48:10 user nova-compute[74776]: DEBUG nova.compute.manager [req-62f8b33d-224b-4828-9d9e-5a92f3d0b90d req-797898e3-c81d-486e-a3e1-ee73d685d1b2 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Refreshing instance network info cache due to event network-changed-4c2013ce-d3fe-430a-87af-311f123db153. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:48:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-62f8b33d-224b-4828-9d9e-5a92f3d0b90d req-797898e3-c81d-486e-a3e1-ee73d685d1b2 service nova] Acquiring lock "refresh_cache-f35efb39-5a5e-4537-a850-0a2ea6b79b7d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:48:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-62f8b33d-224b-4828-9d9e-5a92f3d0b90d req-797898e3-c81d-486e-a3e1-ee73d685d1b2 service nova] Acquired lock "refresh_cache-f35efb39-5a5e-4537-a850-0a2ea6b79b7d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:48:10 user nova-compute[74776]: DEBUG nova.network.neutron [req-62f8b33d-224b-4828-9d9e-5a92f3d0b90d req-797898e3-c81d-486e-a3e1-ee73d685d1b2 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Refreshing network info cache for port 4c2013ce-d3fe-430a-87af-311f123db153 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:48:10 user nova-compute[74776]: DEBUG nova.network.neutron [req-62f8b33d-224b-4828-9d9e-5a92f3d0b90d req-797898e3-c81d-486e-a3e1-ee73d685d1b2 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Updated VIF entry in instance network info cache for port 4c2013ce-d3fe-430a-87af-311f123db153. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:48:10 user nova-compute[74776]: DEBUG nova.network.neutron [req-62f8b33d-224b-4828-9d9e-5a92f3d0b90d req-797898e3-c81d-486e-a3e1-ee73d685d1b2 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Updating instance_info_cache with network_info: [{"id": "4c2013ce-d3fe-430a-87af-311f123db153", "address": "fa:16:3e:bf:29:ab", "network": {"id": "0bcb9014-e3d9-4689-b5a2-72e16976a3d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1051624854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3c6e5ffb6642bb82ddff083bd606bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2013ce-d3", "ovs_interfaceid": "4c2013ce-d3fe-430a-87af-311f123db153", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:48:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-62f8b33d-224b-4828-9d9e-5a92f3d0b90d req-797898e3-c81d-486e-a3e1-ee73d685d1b2 service nova] Releasing lock "refresh_cache-f35efb39-5a5e-4537-a850-0a2ea6b79b7d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:48:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Acquiring lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG nova.objects.instance [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lazy-loading 'flavor' on Instance uuid f35efb39-5a5e-4537-a850-0a2ea6b79b7d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Acquiring lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:48:14 user nova-compute[74776]: INFO nova.compute.manager [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Attaching volume bfe98943-6c53-47e6-8cf7-0ff3e9671bff to /dev/vdb
Nov 22 14:48:14 user nova-compute[74776]: DEBUG os_brick.utils [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea72330-7f8d-4952-9f31-32663cff3baf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[46738c01-0db4-4976-8530-a2d0d3543ff9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[583fbca4-9f64-491b-9fc5-a6aff5e87d56]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa01496-2ecd-4dea-8afc-1263122f53a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:48:14 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:48:14 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bf97c3-dc55-4bcb-8fef-82051cd9e276]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG os_brick.utils [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:48:14 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Updating existing volume attachment record: ad604569-6a1c-4d57-8c03-7bff5a080897 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:48:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crUstGRm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:48:23 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:48:23 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:48:23 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[570f6ae7-3f95-4cdd-8ec7-43332b506d61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:48:23 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a17349-4635-445b-9d8b-7272746170b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff] added
Nov 22 14:48:23 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d763f93c-007f-4b4c-9b5b-e70fd91a53a5]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47488dd-117b-4080-b9ac-11ca243c8966]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v crUstGRm {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v crUstGRm" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f20197a-e027-4a6b-8dea-d421481afb3c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'crUstGRm'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b392a6-8d95-4257-b6fe-e5bfee03a09f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b89462-d595-4b95-93d0-6758a050152a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 14:48:23 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 14:48:23 user nova-compute[74776]:  {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:48:23 user nova-compute[74776]: WARNING os_brick.initiator.connectors.iscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 14:48:23 user nova-compute[74776]: 
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a201173-70d0-478c-83a8-f784494da966]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff, portal: 172.16.0.220,3260]
Nov 22 14:48:23 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff, portal: 172.16.0.220,3260] successful.
Nov 22 14:48:23 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[412f7b20-c45a-4403-bbfe-f440997f8372]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbd2718-864c-4c3b-b2ee-ffcd6ff59001]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff (non-flash)
Nov 22 14:48:23 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff (non-flash)
Nov 22 14:48:23 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c1d910-23ac-40b5-b2e6-bb5e1ca6162b]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:48:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crUstGRm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:48:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:48:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26234363766646436', 'path': '/dev/sdb'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:48:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234363766646436', 'path': '/dev/sdb'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:48:24 user nova-compute[74776]: DEBUG nova.objects.instance [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lazy-loading 'flavor' on Instance uuid f35efb39-5a5e-4537-a850-0a2ea6b79b7d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:48:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:48:25 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:48:25 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 14:48:25 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:48:25 user nova-compute[74776]:   <serial>bfe98943-6c53-47e6-8cf7-0ff3e9671bff</serial>
Nov 22 14:48:25 user nova-compute[74776]: </disk>
Nov 22 14:48:25 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:48:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:48:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:48:25 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] No VIF found with MAC fa:16:3e:bf:29:ab, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:48:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-03d64f8f-dade-4261-85fb-bbb8ff7f57de tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.167s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:48:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Acquiring lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:48:27 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:48:27 user nova-compute[74776]: INFO nova.compute.manager [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Detaching volume bfe98943-6c53-47e6-8cf7-0ff3e9671bff
Nov 22 14:48:27 user nova-compute[74776]: INFO nova.virt.block_device [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Attempting to driver detach volume bfe98943-6c53-47e6-8cf7-0ff3e9671bff from mountpoint /dev/vdb
Nov 22 14:48:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Attempting to detach device vdb from instance f35efb39-5a5e-4537-a850-0a2ea6b79b7d from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:48:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:48:27 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:48:27 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 14:48:27 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:48:27 user nova-compute[74776]:   <serial>bfe98943-6c53-47e6-8cf7-0ff3e9671bff</serial>
Nov 22 14:48:27 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:48:27 user nova-compute[74776]: </disk>
Nov 22 14:48:27 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:48:27 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Successfully detached device vdb from instance f35efb39-5a5e-4537-a850-0a2ea6b79b7d from the persistent domain config.
Nov 22 14:48:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f35efb39-5a5e-4537-a850-0a2ea6b79b7d from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:48:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:48:27 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:48:27 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 14:48:27 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:48:27 user nova-compute[74776]:   <serial>bfe98943-6c53-47e6-8cf7-0ff3e9671bff</serial>
Nov 22 14:48:27 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:48:27 user nova-compute[74776]: </disk>
Nov 22 14:48:27 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:48:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f35efb39-5a5e-4537-a850-0a2ea6b79b7d {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:48:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:29 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:48:31 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:48:31 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:48:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-98710934-6b96-477b-b4d6-d0d416de3a21" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:48:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-98710934-6b96-477b-b4d6-d0d416de3a21" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:48:31 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:48:32 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Updating instance_info_cache with network_info: [{"id": "8996253c-5555-4f6a-b018-2be387ee55b8", "address": "fa:16:3e:ae:f2:3b", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8996253c-55", "ovs_interfaceid": "8996253c-5555-4f6a-b018-2be387ee55b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:48:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-98710934-6b96-477b-b4d6-d0d416de3a21" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:48:32 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:48:32 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:48:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:48:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:48:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:48:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:48:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:33 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:48:33 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:48:33 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8815MB free_disk=25.079967498779297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:48:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:48:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:48:33 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance f35efb39-5a5e-4537-a850-0a2ea6b79b7d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:48:33 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 98710934-6b96-477b-b4d6-d0d416de3a21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:48:33 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:48:33 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:48:33 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:48:33 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:48:33 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:48:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:48:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:48:35 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:48:35 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:48:35 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:48:37 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:48:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:39 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:48:40 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:48:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:42 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:48:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:48 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f35efb39-5a5e-4537-a850-0a2ea6b79b7d is timed out.
Nov 22 14:48:48 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Successfully detached device vdb from instance f35efb39-5a5e-4537-a850-0a2ea6b79b7d from the live domain config.
Nov 22 14:48:48 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'crUstGRm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:48:48 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:48:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[150ca0f3-65c5-4dfa-9f87-1e6e6afa1578]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:48:48 user nova-compute[74776]: No targets found.
Nov 22 14:48:48 user nova-compute[74776]: iSNS:
Nov 22 14:48:48 user nova-compute[74776]: No targets found.
Nov 22 14:48:48 user nova-compute[74776]: STATIC:
Nov 22 14:48:48 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff
Nov 22 14:48:48 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:48:48 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:48:48 user nova-compute[74776]: FIRMWARE:
Nov 22 14:48:48 user nova-compute[74776]: No targets found.
Nov 22 14:48:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:48:48 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:48:48 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e57720-75ce-48c6-998f-3d9725207162]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cdca76-34bc-4236-a3ec-d398b5b69dab]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff (non-flash)
Nov 22 14:48:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff (non-flash)
Nov 22 14:48:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c586509d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff'): ({'sdb'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Removing single pathed devices sdb {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa5f780-ca2f-44d6-9eac-8d31503af449]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[087d3f4a-047f-43a7-828b-725fbd74cf51]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Flushing IO for device /dev/sdb {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfacbaf-6e5e-41b0-a83f-62de21c5c1c0]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef6c5cc-65ba-416d-8b2f-6e8921afd7ab]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2c30ee-01a0-4da9-adb9-35a2519904e7]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fe3bf1-2f4d-4532-960c-ed412c1ad158]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff, portal: 172.16.0.220,3260]
Nov 22 14:48:48 user nova-compute[74776]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff, portal: 172.16.0.220,3260] successful.
Nov 22 14:48:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfe98943-6c53-47e6-8cf7-0ff3e9671bff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2463c7-cd21-496c-a48c-2b07600e0196]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] <== disconnect_volume: return (300ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:48:48 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:48:49 user nova-compute[74776]: DEBUG nova.objects.instance [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lazy-loading 'flavor' on Instance uuid f35efb39-5a5e-4537-a850-0a2ea6b79b7d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:48:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e58ab307-f739-4238-b887-256d778b3b35 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.664s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:48:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquiring lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:48:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:48:49 user nova-compute[74776]: DEBUG nova.compute.manager [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:48:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:48:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:48:49 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:48:49 user nova-compute[74776]: INFO nova.compute.claims [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Claim successful on node user
Nov 22 14:48:50 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:48:50 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:48:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.272s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:48:50 user nova-compute[74776]: DEBUG nova.compute.manager [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:48:50 user nova-compute[74776]: DEBUG nova.compute.manager [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:48:50 user nova-compute[74776]: DEBUG nova.network.neutron [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:48:50 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:48:50 user nova-compute[74776]: DEBUG nova.compute.manager [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:48:50 user nova-compute[74776]: DEBUG nova.policy [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f90520f80b3442c5b1be4ea77adb866e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd43e8bdb8d4525a32d7f1216856b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:48:50 user nova-compute[74776]: DEBUG nova.compute.manager [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:48:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:48:50 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Creating image(s)
Nov 22 14:48:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquiring lock "/opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:48:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "/opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:48:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "/opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:48:50 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:50 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:48:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:48:50 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:50 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.194s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:50 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:50 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk 1073741824" returned: 0 in 0.057s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:48:50 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:50 user nova-compute[74776]: DEBUG nova.network.neutron [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Successfully created port: e337e003-094f-4871-862a-1a1ffc4414f2 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG nova.compute.manager [req-794284d9-76e5-4f95-9212-42039a525307 req-d3effdcf-e7da-4ed3-a104-bcd3e2f4a008 service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Received event network-changed-8996253c-5555-4f6a-b018-2be387ee55b8 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG nova.compute.manager [req-794284d9-76e5-4f95-9212-42039a525307 req-d3effdcf-e7da-4ed3-a104-bcd3e2f4a008 service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Refreshing instance network info cache due to event network-changed-8996253c-5555-4f6a-b018-2be387ee55b8. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-794284d9-76e5-4f95-9212-42039a525307 req-d3effdcf-e7da-4ed3-a104-bcd3e2f4a008 service nova] Acquiring lock "refresh_cache-98710934-6b96-477b-b4d6-d0d416de3a21" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-794284d9-76e5-4f95-9212-42039a525307 req-d3effdcf-e7da-4ed3-a104-bcd3e2f4a008 service nova] Acquired lock "refresh_cache-98710934-6b96-477b-b4d6-d0d416de3a21" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG nova.network.neutron [req-794284d9-76e5-4f95-9212-42039a525307 req-d3effdcf-e7da-4ed3-a104-bcd3e2f4a008 service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Refreshing network info cache for port 8996253c-5555-4f6a-b018-2be387ee55b8 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Cannot resize image /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Ensure instance console log exists: /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG nova.network.neutron [req-794284d9-76e5-4f95-9212-42039a525307 req-d3effdcf-e7da-4ed3-a104-bcd3e2f4a008 service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Updated VIF entry in instance network info cache for port 8996253c-5555-4f6a-b018-2be387ee55b8. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG nova.network.neutron [req-794284d9-76e5-4f95-9212-42039a525307 req-d3effdcf-e7da-4ed3-a104-bcd3e2f4a008 service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Updating instance_info_cache with network_info: [{"id": "8996253c-5555-4f6a-b018-2be387ee55b8", "address": "fa:16:3e:ae:f2:3b", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8996253c-55", "ovs_interfaceid": "8996253c-5555-4f6a-b018-2be387ee55b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-794284d9-76e5-4f95-9212-42039a525307 req-d3effdcf-e7da-4ed3-a104-bcd3e2f4a008 service nova] Releasing lock "refresh_cache-98710934-6b96-477b-b4d6-d0d416de3a21" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG nova.network.neutron [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Successfully updated port: e337e003-094f-4871-862a-1a1ffc4414f2 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquiring lock "refresh_cache-a85f1006-d456-4d9d-aa2f-de57dc7c42f3" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquired lock "refresh_cache-a85f1006-d456-4d9d-aa2f-de57dc7c42f3" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG nova.network.neutron [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG nova.compute.manager [req-641f8028-73a6-40ae-b5f0-8fa3c36d13b6 req-c90bf799-5021-4227-9b2f-9d515caee9bf service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Received event network-changed-e337e003-094f-4871-862a-1a1ffc4414f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG nova.compute.manager [req-641f8028-73a6-40ae-b5f0-8fa3c36d13b6 req-c90bf799-5021-4227-9b2f-9d515caee9bf service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Refreshing instance network info cache due to event network-changed-e337e003-094f-4871-862a-1a1ffc4414f2. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-641f8028-73a6-40ae-b5f0-8fa3c36d13b6 req-c90bf799-5021-4227-9b2f-9d515caee9bf service nova] Acquiring lock "refresh_cache-a85f1006-d456-4d9d-aa2f-de57dc7c42f3" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:48:51 user nova-compute[74776]: DEBUG nova.network.neutron [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.network.neutron [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Updating instance_info_cache with network_info: [{"id": "e337e003-094f-4871-862a-1a1ffc4414f2", "address": "fa:16:3e:ea:e5:e3", "network": {"id": "8c42bd23-eb1f-408f-b07b-2ac01b738ca0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2136861231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd43e8bdb8d4525a32d7f1216856b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape337e003-09", "ovs_interfaceid": "e337e003-094f-4871-862a-1a1ffc4414f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Releasing lock "refresh_cache-a85f1006-d456-4d9d-aa2f-de57dc7c42f3" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.compute.manager [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Instance network_info: |[{"id": "e337e003-094f-4871-862a-1a1ffc4414f2", "address": "fa:16:3e:ea:e5:e3", "network": {"id": "8c42bd23-eb1f-408f-b07b-2ac01b738ca0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2136861231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd43e8bdb8d4525a32d7f1216856b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape337e003-09", "ovs_interfaceid": "e337e003-094f-4871-862a-1a1ffc4414f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-641f8028-73a6-40ae-b5f0-8fa3c36d13b6 req-c90bf799-5021-4227-9b2f-9d515caee9bf service nova] Acquired lock "refresh_cache-a85f1006-d456-4d9d-aa2f-de57dc7c42f3" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.network.neutron [req-641f8028-73a6-40ae-b5f0-8fa3c36d13b6 req-c90bf799-5021-4227-9b2f-9d515caee9bf service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Refreshing network info cache for port e337e003-094f-4871-862a-1a1ffc4414f2 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Start _get_guest_xml network_info=[{"id": "e337e003-094f-4871-862a-1a1ffc4414f2", "address": "fa:16:3e:ea:e5:e3", "network": {"id": "8c42bd23-eb1f-408f-b07b-2ac01b738ca0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2136861231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd43e8bdb8d4525a32d7f1216856b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape337e003-09", "ovs_interfaceid": "e337e003-094f-4871-862a-1a1ffc4414f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:48:52 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:48:52 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:48:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1962000405',display_name='tempest-TestServerVolumeAttachmentScenario-server-1962000405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1962000405',id=43,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBID6HP9+Q1C0/6NMIv3+R95pYi287JO2vr9/bNp0fjNmWVL4Joe7U9nEVKKAN0NaIxcO7ik8Q7dk+spqqKVelvr8plsTr2Pwvc9KwBLOQPBBss6hihdmFsBz6cxww/F/Gg==',key_name='tempest-keypair-1431043020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcd43e8bdb8d4525a32d7f1216856b38',ramdisk_id='',reservation_id='r-l4y2xg20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-700338326',owner_user_name='tempest-TestServerVolumeAttachmentScenario-700338326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f90520f80b3442c5b1be4ea77adb866e',uuid=a85f1006-d456-4d9d-aa2f-de57dc7c42f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e337e003-094f-4871-862a-1a1ffc4414f2", "address": "fa:16:3e:ea:e5:e3", "network": {"id": "8c42bd23-eb1f-408f-b07b-2ac01b738ca0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2136861231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd43e8bdb8d4525a32d7f1216856b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape337e003-09", "ovs_interfaceid": "e337e003-094f-4871-862a-1a1ffc4414f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Converting VIF {"id": "e337e003-094f-4871-862a-1a1ffc4414f2", "address": "fa:16:3e:ea:e5:e3", "network": {"id": "8c42bd23-eb1f-408f-b07b-2ac01b738ca0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2136861231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd43e8bdb8d4525a32d7f1216856b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape337e003-09", "ovs_interfaceid": "e337e003-094f-4871-862a-1a1ffc4414f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e5:e3,bridge_name='br-int',has_traffic_filtering=True,id=e337e003-094f-4871-862a-1a1ffc4414f2,network=Network(8c42bd23-eb1f-408f-b07b-2ac01b738ca0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape337e003-09') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.objects.instance [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lazy-loading 'pci_devices' on Instance uuid a85f1006-d456-4d9d-aa2f-de57dc7c42f3 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:48:52 user nova-compute[74776]:   <uuid>a85f1006-d456-4d9d-aa2f-de57dc7c42f3</uuid>
Nov 22 14:48:52 user nova-compute[74776]:   <name>instance-0000002b</name>
Nov 22 14:48:52 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:48:52 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:48:52 user nova-compute[74776]:   <metadata>
Nov 22 14:48:52 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:48:52 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:48:52 user nova-compute[74776]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1962000405</nova:name>
Nov 22 14:48:52 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:48:52</nova:creationTime>
Nov 22 14:48:52 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:48:52 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:48:52 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:48:52 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:48:52 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:48:52 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:48:52 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:48:52 user nova-compute[74776]:       <nova:owner>
Nov 22 14:48:52 user nova-compute[74776]:         <nova:user uuid="f90520f80b3442c5b1be4ea77adb866e">tempest-TestServerVolumeAttachmentScenario-700338326-project-member</nova:user>
Nov 22 14:48:52 user nova-compute[74776]:         <nova:project uuid="bcd43e8bdb8d4525a32d7f1216856b38">tempest-TestServerVolumeAttachmentScenario-700338326</nova:project>
Nov 22 14:48:52 user nova-compute[74776]:       </nova:owner>
Nov 22 14:48:52 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:48:52 user nova-compute[74776]:       <nova:ports>
Nov 22 14:48:52 user nova-compute[74776]:         <nova:port uuid="e337e003-094f-4871-862a-1a1ffc4414f2">
Nov 22 14:48:52 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 22 14:48:52 user nova-compute[74776]:         </nova:port>
Nov 22 14:48:52 user nova-compute[74776]:       </nova:ports>
Nov 22 14:48:52 user nova-compute[74776]:     </nova:instance>
Nov 22 14:48:52 user nova-compute[74776]:   </metadata>
Nov 22 14:48:52 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:48:52 user nova-compute[74776]:     <system>
Nov 22 14:48:52 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:48:52 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:48:52 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:48:52 user nova-compute[74776]:       <entry name="serial">a85f1006-d456-4d9d-aa2f-de57dc7c42f3</entry>
Nov 22 14:48:52 user nova-compute[74776]:       <entry name="uuid">a85f1006-d456-4d9d-aa2f-de57dc7c42f3</entry>
Nov 22 14:48:52 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:48:52 user nova-compute[74776]:     </system>
Nov 22 14:48:52 user nova-compute[74776]:   </sysinfo>
Nov 22 14:48:52 user nova-compute[74776]:   <os>
Nov 22 14:48:52 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:48:52 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:48:52 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:48:52 user nova-compute[74776]:   </os>
Nov 22 14:48:52 user nova-compute[74776]:   <features>
Nov 22 14:48:52 user nova-compute[74776]:     <acpi/>
Nov 22 14:48:52 user nova-compute[74776]:     <apic/>
Nov 22 14:48:52 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:48:52 user nova-compute[74776]:   </features>
Nov 22 14:48:52 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:48:52 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:48:52 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:48:52 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:48:52 user nova-compute[74776]:   </clock>
Nov 22 14:48:52 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:48:52 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:48:52 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:48:52 user nova-compute[74776]:   </cpu>
Nov 22 14:48:52 user nova-compute[74776]:   <devices>
Nov 22 14:48:52 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:48:52 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:48:52 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk"/>
Nov 22 14:48:52 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:48:52 user nova-compute[74776]:     </disk>
Nov 22 14:48:52 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:48:52 user nova-compute[74776]:       <mac address="fa:16:3e:ea:e5:e3"/>
Nov 22 14:48:52 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:48:52 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:48:52 user nova-compute[74776]:       <target dev="tape337e003-09"/>
Nov 22 14:48:52 user nova-compute[74776]:     </interface>
Nov 22 14:48:52 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:48:52 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/console.log" append="off"/>
Nov 22 14:48:52 user nova-compute[74776]:     </serial>
Nov 22 14:48:52 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:48:52 user nova-compute[74776]:     <video>
Nov 22 14:48:52 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:48:52 user nova-compute[74776]:     </video>
Nov 22 14:48:52 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:48:52 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:48:52 user nova-compute[74776]:     </rng>
Nov 22 14:48:52 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:48:52 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:48:52 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:48:52 user nova-compute[74776]:     </memballoon>
Nov 22 14:48:52 user nova-compute[74776]:   </devices>
Nov 22 14:48:52 user nova-compute[74776]: </domain>
Nov 22 14:48:52 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:48:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1962000405',display_name='tempest-TestServerVolumeAttachmentScenario-server-1962000405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1962000405',id=43,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBID6HP9+Q1C0/6NMIv3+R95pYi287JO2vr9/bNp0fjNmWVL4Joe7U9nEVKKAN0NaIxcO7ik8Q7dk+spqqKVelvr8plsTr2Pwvc9KwBLOQPBBss6hihdmFsBz6cxww/F/Gg==',key_name='tempest-keypair-1431043020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcd43e8bdb8d4525a32d7f1216856b38',ramdisk_id='',reservation_id='r-l4y2xg20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-700338326',owner_user_name='tempest-TestServerVolumeAttachmentScenario-700338326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f90520f80b3442c5b1be4ea77adb866e',uuid=a85f1006-d456-4d9d-aa2f-de57dc7c42f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e337e003-094f-4871-862a-1a1ffc4414f2", "address": "fa:16:3e:ea:e5:e3", "network": {"id": "8c42bd23-eb1f-408f-b07b-2ac01b738ca0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2136861231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd43e8bdb8d4525a32d7f1216856b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape337e003-09", "ovs_interfaceid": "e337e003-094f-4871-862a-1a1ffc4414f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Converting VIF {"id": "e337e003-094f-4871-862a-1a1ffc4414f2", "address": "fa:16:3e:ea:e5:e3", "network": {"id": "8c42bd23-eb1f-408f-b07b-2ac01b738ca0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2136861231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd43e8bdb8d4525a32d7f1216856b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape337e003-09", "ovs_interfaceid": "e337e003-094f-4871-862a-1a1ffc4414f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e5:e3,bridge_name='br-int',has_traffic_filtering=True,id=e337e003-094f-4871-862a-1a1ffc4414f2,network=Network(8c42bd23-eb1f-408f-b07b-2ac01b738ca0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape337e003-09') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG os_vif [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e5:e3,bridge_name='br-int',has_traffic_filtering=True,id=e337e003-094f-4871-862a-1a1ffc4414f2,network=Network(8c42bd23-eb1f-408f-b07b-2ac01b738ca0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape337e003-09') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11bd686c-f309-5908-8335-2a1d22d3c9ba', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape337e003-09, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape337e003-09, col_values=(('qos', UUID('ca622e10-206f-49d1-b980-f7f7ccb11760')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape337e003-09, col_values=(('external_ids', {'iface-id': 'e337e003-094f-4871-862a-1a1ffc4414f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:e5:e3', 'vm-uuid': 'a85f1006-d456-4d9d-aa2f-de57dc7c42f3'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:52 user nova-compute[74776]: INFO os_vif [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e5:e3,bridge_name='br-int',has_traffic_filtering=True,id=e337e003-094f-4871-862a-1a1ffc4414f2,network=Network(8c42bd23-eb1f-408f-b07b-2ac01b738ca0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape337e003-09')
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] No VIF found with MAC fa:16:3e:ea:e5:e3, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.network.neutron [req-641f8028-73a6-40ae-b5f0-8fa3c36d13b6 req-c90bf799-5021-4227-9b2f-9d515caee9bf service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Updated VIF entry in instance network info cache for port e337e003-094f-4871-862a-1a1ffc4414f2. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG nova.network.neutron [req-641f8028-73a6-40ae-b5f0-8fa3c36d13b6 req-c90bf799-5021-4227-9b2f-9d515caee9bf service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Updating instance_info_cache with network_info: [{"id": "e337e003-094f-4871-862a-1a1ffc4414f2", "address": "fa:16:3e:ea:e5:e3", "network": {"id": "8c42bd23-eb1f-408f-b07b-2ac01b738ca0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2136861231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd43e8bdb8d4525a32d7f1216856b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape337e003-09", "ovs_interfaceid": "e337e003-094f-4871-862a-1a1ffc4414f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:48:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-641f8028-73a6-40ae-b5f0-8fa3c36d13b6 req-c90bf799-5021-4227-9b2f-9d515caee9bf service nova] Releasing lock "refresh_cache-a85f1006-d456-4d9d-aa2f-de57dc7c42f3" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "98710934-6b96-477b-b4d6-d0d416de3a21" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "98710934-6b96-477b-b4d6-d0d416de3a21" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG nova.objects.instance [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'flavor' on Instance uuid 98710934-6b96-477b-b4d6-d0d416de3a21 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "98710934-6b96-477b-b4d6-d0d416de3a21" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-d8ac5ea1-5531-46ed-80ae-257985000f91 req-b8bc81f2-b9b1-4713-86c0-8aaeb48cb5bd service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Received event network-vif-plugged-e337e003-094f-4871-862a-1a1ffc4414f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d8ac5ea1-5531-46ed-80ae-257985000f91 req-b8bc81f2-b9b1-4713-86c0-8aaeb48cb5bd service nova] Acquiring lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d8ac5ea1-5531-46ed-80ae-257985000f91 req-b8bc81f2-b9b1-4713-86c0-8aaeb48cb5bd service nova] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-d8ac5ea1-5531-46ed-80ae-257985000f91 req-b8bc81f2-b9b1-4713-86c0-8aaeb48cb5bd service nova] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-d8ac5ea1-5531-46ed-80ae-257985000f91 req-b8bc81f2-b9b1-4713-86c0-8aaeb48cb5bd service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] No waiting events found dispatching network-vif-plugged-e337e003-094f-4871-862a-1a1ffc4414f2 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:48:53 user nova-compute[74776]: WARNING nova.compute.manager [req-d8ac5ea1-5531-46ed-80ae-257985000f91 req-b8bc81f2-b9b1-4713-86c0-8aaeb48cb5bd service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Received unexpected event network-vif-plugged-e337e003-094f-4871-862a-1a1ffc4414f2 for instance with vm_state building and task_state spawning.
Nov 22 14:48:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "98710934-6b96-477b-b4d6-d0d416de3a21" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "98710934-6b96-477b-b4d6-d0d416de3a21" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:48:53 user nova-compute[74776]: INFO nova.compute.manager [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Attaching volume 659952e5-706f-49a8-99aa-22a2736fe7a5 to /dev/vdb
Nov 22 14:48:53 user nova-compute[74776]: DEBUG os_brick.utils [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f888fa99-8d44-42d1-9d91-987bb84f53dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a20787-2bc7-4fbc-bb3d-2e6b3f03c025]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cb7cc2-de04-424a-87ba-de561057571b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b58d5a-6f27-4717-9f07-7be694b34a82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:48:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:48:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:48:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:48:54 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:48:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2d77a3-7674-476f-a442-2c09b387b459]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:48:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:48:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:48:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:48:54 user nova-compute[74776]: DEBUG os_brick.utils [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:48:54 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Updating existing volume attachment record: 18369cd9-7d6c-4572-8014-b013aa16097f {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:48:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:55 user nova-compute[74776]: DEBUG nova.compute.manager [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:48:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:48:55 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Instance spawned successfully.
Nov 22 14:48:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:48:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:48:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:48:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:48:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:48:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:48:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:48:55 user nova-compute[74776]: DEBUG nova.compute.manager [req-e73c9269-77df-4038-8952-ed436bceb048 req-4f0089b5-22f3-4977-be48-16456ab2ca0f service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Received event network-vif-plugged-e337e003-094f-4871-862a-1a1ffc4414f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:48:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e73c9269-77df-4038-8952-ed436bceb048 req-4f0089b5-22f3-4977-be48-16456ab2ca0f service nova] Acquiring lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:48:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e73c9269-77df-4038-8952-ed436bceb048 req-4f0089b5-22f3-4977-be48-16456ab2ca0f service nova] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:48:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e73c9269-77df-4038-8952-ed436bceb048 req-4f0089b5-22f3-4977-be48-16456ab2ca0f service nova] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:48:55 user nova-compute[74776]: DEBUG nova.compute.manager [req-e73c9269-77df-4038-8952-ed436bceb048 req-4f0089b5-22f3-4977-be48-16456ab2ca0f service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] No waiting events found dispatching network-vif-plugged-e337e003-094f-4871-862a-1a1ffc4414f2 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:48:55 user nova-compute[74776]: WARNING nova.compute.manager [req-e73c9269-77df-4038-8952-ed436bceb048 req-4f0089b5-22f3-4977-be48-16456ab2ca0f service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Received unexpected event network-vif-plugged-e337e003-094f-4871-862a-1a1ffc4414f2 for instance with vm_state building and task_state spawning.
Nov 22 14:48:55 user nova-compute[74776]: INFO nova.compute.manager [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 22 14:48:55 user nova-compute[74776]: DEBUG nova.compute.manager [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:48:55 user nova-compute[74776]: INFO nova.compute.manager [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Took 5.97 seconds to build instance.
Nov 22 14:48:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-2cfb11c4-54b3-4101-9d0c-12371c97d67c tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.065s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:48:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:48:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CKHhnFvW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:49:00 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:49:00 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:49:00 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a657fe2-4d34-4485-83a9-32ced2fb1b36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:49:00 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13e22dd-ccda-4eda-9680-16f8c418cb8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5] added
Nov 22 14:49:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b88bf34-9f93-466b-be73-06448227a74d]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06c959c-5117-41a2-b6bf-b873ef4037dd]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CKHhnFvW {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CKHhnFvW" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9f2261-9df7-4590-ae11-95c171e554f4]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CKHhnFvW'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[91709d01-475c-4ead-98e5-a42b56bb6f1a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[99633e37-f5ea-4309-a21f-e9229edd02b1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 14:49:00 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 14:49:00 user nova-compute[74776]:  {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:49:00 user nova-compute[74776]: WARNING os_brick.initiator.connectors.iscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 14:49:00 user nova-compute[74776]: 
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e299dff-f602-40a2-b311-2cd16877fde6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5, portal: 172.16.0.220,3260]
Nov 22 14:49:00 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5, portal: 172.16.0.220,3260] successful.
Nov 22 14:49:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6cf754-afac-4afe-8c21-88348a85cb4b]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f176ff24-6d8b-4ebf-b0b6-86050321c204]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 (non-flash)
Nov 22 14:49:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 (non-flash)
Nov 22 14:49:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.233s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6eb800a-7eda-4ed8-9d5c-fbe2072edddb]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:00 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:49:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:01 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:49:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CKHhnFvW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:49:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.261s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:49:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] <== connect_volume: return (1262ms) {'type': 'block', 'scsi_wwn': '23032353535323265', 'path': '/dev/sdb'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:49:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032353535323265', 'path': '/dev/sdb'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:49:01 user nova-compute[74776]: DEBUG nova.objects.instance [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'flavor' on Instance uuid 98710934-6b96-477b-b4d6-d0d416de3a21 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:49:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:49:01 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:49:01 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 14:49:01 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:49:01 user nova-compute[74776]:   <serial>659952e5-706f-49a8-99aa-22a2736fe7a5</serial>
Nov 22 14:49:01 user nova-compute[74776]: </disk>
Nov 22 14:49:01 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:49:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:49:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:49:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] No VIF found with MAC fa:16:3e:ae:f2:3b, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:49:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-406d8f67-fb9b-4699-8f10-26fe0610c8ff tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "98710934-6b96-477b-b4d6-d0d416de3a21" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.336s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:49:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "98710934-6b96-477b-b4d6-d0d416de3a21" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "98710934-6b96-477b-b4d6-d0d416de3a21" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG nova.objects.instance [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'flavor' on Instance uuid 98710934-6b96-477b-b4d6-d0d416de3a21 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "98710934-6b96-477b-b4d6-d0d416de3a21" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "98710934-6b96-477b-b4d6-d0d416de3a21" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "98710934-6b96-477b-b4d6-d0d416de3a21" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:49:05 user nova-compute[74776]: INFO nova.compute.manager [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Attaching volume 17dc5978-15f8-42b2-85f0-a367e2b77743 to /dev/vdc
Nov 22 14:49:05 user nova-compute[74776]: DEBUG os_brick.utils [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf7ab4d-87ea-4087-98da-6fd042f72a1a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[35860962-8196-48c6-a0ee-409b1c4d9c9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59aaf3e-7222-45aa-9ba4-92f95b20ba9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cecb45-dfb8-41db-a0d1-fa3600d1da88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:49:05 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:49:05 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[85daea0d-0c0f-4438-9697-cd53c113e746]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG os_brick.utils [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:49:05 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Updating existing volume attachment record: 7b12df79-bfc5-49cd-a3fe-4390dbe2b987 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:49:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrSdyKDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:49:11 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:49:11 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:49:11 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e01178-8706-476c-8682-cd3b97c8f03d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:49:11 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[31092e4d-d7b3-4947-8c95-5c286f1573b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743] added
Nov 22 14:49:11 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f536f95a-3981-4214-98cf-a508c3eabed9]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafebd05-493b-44eb-91d9-844eb6e1afcf]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrSdyKDb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrSdyKDb" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8708616e-1967-426d-b4a8-a2952fe3a1ab]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HrSdyKDb'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f541e8-909d-4490-ae75-8e9ba082d71d]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd549a6-d727-4482-b44c-8023ebec8cad]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 (non-flash)
Nov 22 14:49:11 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 (non-flash)
Nov 22 14:49:11 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1467f1a2-d84a-4a2e-a07b-ff284640347d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743, portal: 172.16.0.220,3260]
Nov 22 14:49:11 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743, portal: 172.16.0.220,3260] successful.
Nov 22 14:49:11 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cc99f0-7e67-4eb7-bc61-3bf572b7f58f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6041bcc-0774-4dfd-a8e0-cdb49c99b9ff]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 (non-flash)
Nov 22 14:49:11 user nova-compute[74776]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 (non-flash)
Nov 22 14:49:11 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 (non-flash)
Nov 22 14:49:11 user nova-compute[74776]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 (non-flash)
Nov 22 14:49:11 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[808130df-85ba-49dc-bab2-0aa74643c6b8]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:11 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: None {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:49:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:12 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:49:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrSdyKDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:49:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:49:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23631353665623632', 'path': '/dev/sdc'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:49:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631353665623632', 'path': '/dev/sdc'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:49:12 user nova-compute[74776]: DEBUG nova.objects.instance [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'flavor' on Instance uuid 98710934-6b96-477b-b4d6-d0d416de3a21 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:49:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:49:12 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:49:12 user nova-compute[74776]:   <source dev="/dev/sdc"/>
Nov 22 14:49:12 user nova-compute[74776]:   <target dev="vdc" bus="virtio"/>
Nov 22 14:49:12 user nova-compute[74776]:   <serial>17dc5978-15f8-42b2-85f0-a367e2b77743</serial>
Nov 22 14:49:12 user nova-compute[74776]: </disk>
Nov 22 14:49:12 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:49:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:49:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:49:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:49:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] No VIF found with MAC fa:16:3e:ae:f2:3b, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:49:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-12f1d620-8a2b-468a-adf2-155619f39d83 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "98710934-6b96-477b-b4d6-d0d416de3a21" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.888s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:49:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "98710934-6b96-477b-b4d6-d0d416de3a21" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:49:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "98710934-6b96-477b-b4d6-d0d416de3a21" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:49:14 user nova-compute[74776]: INFO nova.compute.manager [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Detaching volume 659952e5-706f-49a8-99aa-22a2736fe7a5
Nov 22 14:49:14 user nova-compute[74776]: INFO nova.virt.block_device [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Attempting to driver detach volume 659952e5-706f-49a8-99aa-22a2736fe7a5 from mountpoint /dev/vdb
Nov 22 14:49:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Attempting to detach device vdb from instance 98710934-6b96-477b-b4d6-d0d416de3a21 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:49:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:49:14 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:49:14 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 14:49:14 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:49:14 user nova-compute[74776]:   <serial>659952e5-706f-49a8-99aa-22a2736fe7a5</serial>
Nov 22 14:49:14 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:49:14 user nova-compute[74776]: </disk>
Nov 22 14:49:14 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:49:14 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Successfully detached device vdb from instance 98710934-6b96-477b-b4d6-d0d416de3a21 from the persistent domain config.
Nov 22 14:49:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98710934-6b96-477b-b4d6-d0d416de3a21 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:49:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:49:14 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:49:14 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 14:49:14 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:49:14 user nova-compute[74776]:   <serial>659952e5-706f-49a8-99aa-22a2736fe7a5</serial>
Nov 22 14:49:14 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:49:14 user nova-compute[74776]: </disk>
Nov 22 14:49:14 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:49:15 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98710934-6b96-477b-b4d6-d0d416de3a21 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:49:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Acquiring lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:49:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:49:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Acquiring lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:49:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:49:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:49:21 user nova-compute[74776]: INFO nova.compute.manager [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Terminating instance
Nov 22 14:49:21 user nova-compute[74776]: DEBUG nova.compute.manager [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:49:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-a932ef5d-1208-4635-aa3c-06b8be0fed08 req-c9449f1e-f616-42e0-9d38-f88f6a35393f service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Received event network-vif-unplugged-4c2013ce-d3fe-430a-87af-311f123db153 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:49:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-a932ef5d-1208-4635-aa3c-06b8be0fed08 req-c9449f1e-f616-42e0-9d38-f88f6a35393f service nova] Acquiring lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:49:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-a932ef5d-1208-4635-aa3c-06b8be0fed08 req-c9449f1e-f616-42e0-9d38-f88f6a35393f service nova] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:49:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-a932ef5d-1208-4635-aa3c-06b8be0fed08 req-c9449f1e-f616-42e0-9d38-f88f6a35393f service nova] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:49:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-a932ef5d-1208-4635-aa3c-06b8be0fed08 req-c9449f1e-f616-42e0-9d38-f88f6a35393f service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] No waiting events found dispatching network-vif-unplugged-4c2013ce-d3fe-430a-87af-311f123db153 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:49:21 user nova-compute[74776]: DEBUG nova.compute.manager [req-a932ef5d-1208-4635-aa3c-06b8be0fed08 req-c9449f1e-f616-42e0-9d38-f88f6a35393f service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Received event network-vif-unplugged-4c2013ce-d3fe-430a-87af-311f123db153 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:22 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Instance destroyed successfully.
Nov 22 14:49:22 user nova-compute[74776]: DEBUG nova.objects.instance [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lazy-loading 'resources' on Instance uuid f35efb39-5a5e-4537-a850-0a2ea6b79b7d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-821003110',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-821003110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-8210031',id=41,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoGLcIFl1s504E5cD8SH4eC1OOdNL19jFtv9kVp5d8vjDkNt4Ok3wiztc3G57qU6xA2sQHcWSvY6QEXTtmTLxmBsEwxDwzP7UmT9iRx7MrlMHOcaYy4o+tMAyc7fP8PZw==',key_name='tempest-keypair-918485921',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:46:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a3c6e5ffb6642bb82ddff083bd606bf',ramdisk_id='',reservation_id='r-fei0m1wu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1589252934',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:46:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d712ee1bb0f74569bf4d9bacef98f885',uuid=f35efb39-5a5e-4537-a850-0a2ea6b79b7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c2013ce-d3fe-430a-87af-311f123db153", "address": "fa:16:3e:bf:29:ab", "network": {"id": "0bcb9014-e3d9-4689-b5a2-72e16976a3d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1051624854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3c6e5ffb6642bb82ddff083bd606bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2013ce-d3", "ovs_interfaceid": "4c2013ce-d3fe-430a-87af-311f123db153", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Converting VIF {"id": "4c2013ce-d3fe-430a-87af-311f123db153", "address": "fa:16:3e:bf:29:ab", "network": {"id": "0bcb9014-e3d9-4689-b5a2-72e16976a3d9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1051624854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a3c6e5ffb6642bb82ddff083bd606bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c2013ce-d3", "ovs_interfaceid": "4c2013ce-d3fe-430a-87af-311f123db153", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:29:ab,bridge_name='br-int',has_traffic_filtering=True,id=4c2013ce-d3fe-430a-87af-311f123db153,network=Network(0bcb9014-e3d9-4689-b5a2-72e16976a3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c2013ce-d3') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG os_vif [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:29:ab,bridge_name='br-int',has_traffic_filtering=True,id=4c2013ce-d3fe-430a-87af-311f123db153,network=Network(0bcb9014-e3d9-4689-b5a2-72e16976a3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c2013ce-d3') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c2013ce-d3, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a780fec-e2ff-45df-b7fc-6f6316e038a9) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:22 user nova-compute[74776]: INFO os_vif [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:29:ab,bridge_name='br-int',has_traffic_filtering=True,id=4c2013ce-d3fe-430a-87af-311f123db153,network=Network(0bcb9014-e3d9-4689-b5a2-72e16976a3d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c2013ce-d3')
Nov 22 14:49:22 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Deleting instance files /opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d_del
Nov 22 14:49:22 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Deletion of /opt/stack/data/nova/instances/f35efb39-5a5e-4537-a850-0a2ea6b79b7d_del complete
Nov 22 14:49:22 user nova-compute[74776]: INFO nova.compute.manager [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 22 14:49:22 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:49:23 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Took 0.86 seconds to deallocate network for instance.
Nov 22 14:49:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-be29f98a-a7bf-47c9-9ffc-e2ca7ab6d4d4 req-4e229e7b-3b96-4f53-8a70-b0d1aa64a8be service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Received event network-vif-deleted-4c2013ce-d3fe-430a-87af-311f123db153 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:49:23 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Deleted allocations for instance f35efb39-5a5e-4537-a850-0a2ea6b79b7d
Nov 22 14:49:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-03468ae1-d79b-4299-b3f9-84d32452a5ed tempest-TestServerVolumeAttachScenarioOldVersion-1589252934 tempest-TestServerVolumeAttachScenarioOldVersion-1589252934-project-member] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.086s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Received event network-vif-plugged-4c2013ce-d3fe-430a-87af-311f123db153 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] Acquiring lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] No waiting events found dispatching network-vif-plugged-4c2013ce-d3fe-430a-87af-311f123db153 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:49:23 user nova-compute[74776]: WARNING nova.compute.manager [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Received unexpected event network-vif-plugged-4c2013ce-d3fe-430a-87af-311f123db153 for instance with vm_state deleted and task_state None.
Nov 22 14:49:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Received event network-vif-plugged-4c2013ce-d3fe-430a-87af-311f123db153 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] Acquiring lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] No waiting events found dispatching network-vif-plugged-4c2013ce-d3fe-430a-87af-311f123db153 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:49:23 user nova-compute[74776]: WARNING nova.compute.manager [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Received unexpected event network-vif-plugged-4c2013ce-d3fe-430a-87af-311f123db153 for instance with vm_state deleted and task_state None.
Nov 22 14:49:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Received event network-vif-plugged-4c2013ce-d3fe-430a-87af-311f123db153 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] Acquiring lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] No waiting events found dispatching network-vif-plugged-4c2013ce-d3fe-430a-87af-311f123db153 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:49:23 user nova-compute[74776]: WARNING nova.compute.manager [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Received unexpected event network-vif-plugged-4c2013ce-d3fe-430a-87af-311f123db153 for instance with vm_state deleted and task_state None.
Nov 22 14:49:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Received event network-vif-plugged-4c2013ce-d3fe-430a-87af-311f123db153 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] Acquiring lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] Lock "f35efb39-5a5e-4537-a850-0a2ea6b79b7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:49:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] No waiting events found dispatching network-vif-plugged-4c2013ce-d3fe-430a-87af-311f123db153 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:49:23 user nova-compute[74776]: WARNING nova.compute.manager [req-1e5cfead-a99f-4f7f-8d0a-e5b1b36943ca req-15c085a8-b498-4ef7-9656-5f62ecea46b0 service nova] [instance: f35efb39-5a5e-4537-a850-0a2ea6b79b7d] Received unexpected event network-vif-plugged-4c2013ce-d3fe-430a-87af-311f123db153 for instance with vm_state deleted and task_state None.
Nov 22 14:49:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:30 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:49:31 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:49:31 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:49:31 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 14:49:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-98710934-6b96-477b-b4d6-d0d416de3a21" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:49:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-98710934-6b96-477b-b4d6-d0d416de3a21" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:49:31 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:49:31 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid 98710934-6b96-477b-b4d6-d0d416de3a21 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:49:32 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Updating instance_info_cache with network_info: [{"id": "8996253c-5555-4f6a-b018-2be387ee55b8", "address": "fa:16:3e:ae:f2:3b", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8996253c-55", "ovs_interfaceid": "8996253c-5555-4f6a-b018-2be387ee55b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:49:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-98710934-6b96-477b-b4d6-d0d416de3a21" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:49:32 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:49:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:32 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:49:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:49:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:49:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:49:32 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:49:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:49:33 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:49:33 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:49:33 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8715MB free_disk=25.06808090209961GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:49:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:49:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:49:34 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 98710934-6b96-477b-b4d6-d0d416de3a21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:49:34 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance a85f1006-d456-4d9d-aa2f-de57dc7c42f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:49:34 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:49:34 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:49:34 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:49:34 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:49:34 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:49:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:49:35 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 98710934-6b96-477b-b4d6-d0d416de3a21 is timed out.
Nov 22 14:49:35 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Successfully detached device vdb from instance 98710934-6b96-477b-b4d6-d0d416de3a21 from the live domain config.
Nov 22 14:49:35 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CKHhnFvW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:49:35 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:49:35 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ef207e-bba0-491b-b15d-b636cfddf875]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:49:35 user nova-compute[74776]: No targets found.
Nov 22 14:49:35 user nova-compute[74776]: iSNS:
Nov 22 14:49:35 user nova-compute[74776]: No targets found.
Nov 22 14:49:35 user nova-compute[74776]: STATIC:
Nov 22 14:49:35 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5
Nov 22 14:49:35 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:49:35 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:49:35 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743
Nov 22 14:49:35 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:49:35 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:49:35 user nova-compute[74776]: FIRMWARE:
Nov 22 14:49:35 user nova-compute[74776]: No targets found.
Nov 22 14:49:35 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:49:35 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:49:35 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca69ea5-034a-4233-a0be-50b6e68e5306]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23bfdf7-69a6-4d28-829e-fb5c47b13b14]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 (non-flash)
Nov 22 14:49:35 user nova-compute[74776]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 (non-flash)
Nov 22 14:49:35 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 (non-flash)
Nov 22 14:49:35 user nova-compute[74776]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 (non-flash)
Nov 22 14:49:35 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c7bee68c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5'): ({'sdb'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Removing single pathed devices sdb {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[be632cf2-8a13-413d-9e1b-33324bfc78b8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f6a81a-ef69-439b-a79f-336a564c8bba]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Flushing IO for device /dev/sdb {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[195af494-8192-459b-b03d-21175df1cc8b]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83ecec9-8c18-4489-8a73-7ebdf054bb05]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb14b91-d443-47ce-bac9-c9b065f49e04]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[655eccdd-51b5-4b39-a766-bd508f2e9de4]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5, portal: 172.16.0.220,3260]
Nov 22 14:49:35 user nova-compute[74776]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5, portal: 172.16.0.220,3260] successful.
Nov 22 14:49:35 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:659952e5-706f-49a8-99aa-22a2736fe7a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f012ef61-a6b1-4ffd-b441-36d8407f5246]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] <== disconnect_volume: return (294ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:49:35 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:49:36 user nova-compute[74776]: DEBUG nova.objects.instance [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'flavor' on Instance uuid 98710934-6b96-477b-b4d6-d0d416de3a21 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:49:36 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:49:36 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:49:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:49:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-66de2a8a-bf03-41a8-83a8-d085a3cafa28 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "98710934-6b96-477b-b4d6-d0d416de3a21" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.607s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:49:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "98710934-6b96-477b-b4d6-d0d416de3a21" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:49:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "98710934-6b96-477b-b4d6-d0d416de3a21" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:49:37 user nova-compute[74776]: INFO nova.compute.manager [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Detaching volume 17dc5978-15f8-42b2-85f0-a367e2b77743
Nov 22 14:49:37 user nova-compute[74776]: INFO nova.virt.block_device [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Attempting to driver detach volume 17dc5978-15f8-42b2-85f0-a367e2b77743 from mountpoint /dev/vdc
Nov 22 14:49:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Attempting to detach device vdc from instance 98710934-6b96-477b-b4d6-d0d416de3a21 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:49:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:49:37 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:49:37 user nova-compute[74776]:   <source dev="/dev/sdc"/>
Nov 22 14:49:37 user nova-compute[74776]:   <target dev="vdc" bus="virtio"/>
Nov 22 14:49:37 user nova-compute[74776]:   <serial>17dc5978-15f8-42b2-85f0-a367e2b77743</serial>
Nov 22 14:49:37 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 22 14:49:37 user nova-compute[74776]: </disk>
Nov 22 14:49:37 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:49:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:49:37 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Successfully detached device vdc from instance 98710934-6b96-477b-b4d6-d0d416de3a21 from the persistent domain config.
Nov 22 14:49:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 98710934-6b96-477b-b4d6-d0d416de3a21 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:49:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:49:37 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:49:37 user nova-compute[74776]:   <source dev="/dev/sdc"/>
Nov 22 14:49:37 user nova-compute[74776]:   <target dev="vdc" bus="virtio"/>
Nov 22 14:49:37 user nova-compute[74776]:   <serial>17dc5978-15f8-42b2-85f0-a367e2b77743</serial>
Nov 22 14:49:37 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 22 14:49:37 user nova-compute[74776]: </disk>
Nov 22 14:49:37 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:49:37 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:49:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 98710934-6b96-477b-b4d6-d0d416de3a21 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:49:39 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:49:41 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:49:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:43 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:49:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:49:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:49:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:49:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:49:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:49:57 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 98710934-6b96-477b-b4d6-d0d416de3a21 is timed out.
Nov 22 14:49:57 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Successfully detached device vdc from instance 98710934-6b96-477b-b4d6-d0d416de3a21 from the live domain config.
Nov 22 14:49:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrSdyKDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:49:57 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:49:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dd2a6b-e890-4a3a-9079-cf0fb9a72a93]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:49:57 user nova-compute[74776]: No targets found.
Nov 22 14:49:57 user nova-compute[74776]: iSNS:
Nov 22 14:49:57 user nova-compute[74776]: No targets found.
Nov 22 14:49:57 user nova-compute[74776]: STATIC:
Nov 22 14:49:57 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743
Nov 22 14:49:57 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:49:57 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:49:57 user nova-compute[74776]: FIRMWARE:
Nov 22 14:49:57 user nova-compute[74776]: No targets found.
Nov 22 14:49:57 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:49:57 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:49:57 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[592ba749-88e3-4db7-bb61-1a529c39fbdf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[44211379-0b68-4fed-ac1d-24ba396970fa]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 (non-flash)
Nov 22 14:49:57 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 (non-flash)
Nov 22 14:49:57 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c38660d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743'): ({'sdc'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Removing single pathed devices sdc {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eae831c-1e38-4d1e-a3e4-5ef8aafd05d5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8b19b0-86cb-44d2-a675-dd7a4fc1ab69]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Flushing IO for device /dev/sdc {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f0e0b2-2e34-424a-9c3d-4b932e2ea8a6]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[92304f4b-4e83-477a-ba91-dce968dcbafc]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b7d676-e3ca-413e-893a-aa39c4131f58]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab3c93d-42c7-4a16-9327-a5d00f784d2b]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743, portal: 172.16.0.220,3260]
Nov 22 14:49:57 user nova-compute[74776]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743, portal: 172.16.0.220,3260] successful.
Nov 22 14:49:57 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17dc5978-15f8-42b2-85f0-a367e2b77743 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c76f668-f037-422b-bbd8-7cd017ecfa3a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] <== disconnect_volume: return (267ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:49:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:49:58 user nova-compute[74776]: DEBUG nova.objects.instance [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'flavor' on Instance uuid 98710934-6b96-477b-b4d6-d0d416de3a21 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:49:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b7d0de1c-f7d2-4cbb-a35c-7d1101591897 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "98710934-6b96-477b-b4d6-d0d416de3a21" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.576s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:49:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "98710934-6b96-477b-b4d6-d0d416de3a21" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:49:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "98710934-6b96-477b-b4d6-d0d416de3a21" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:49:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "98710934-6b96-477b-b4d6-d0d416de3a21-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:49:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "98710934-6b96-477b-b4d6-d0d416de3a21-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:49:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "98710934-6b96-477b-b4d6-d0d416de3a21-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:49:59 user nova-compute[74776]: INFO nova.compute.manager [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Terminating instance
Nov 22 14:49:59 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-983b7b83-5b40-47db-8a2d-b39e717255df req-c5494a30-b5d8-413b-8e77-1b8dd87f8d40 service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Received event network-vif-unplugged-8996253c-5555-4f6a-b018-2be387ee55b8 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-983b7b83-5b40-47db-8a2d-b39e717255df req-c5494a30-b5d8-413b-8e77-1b8dd87f8d40 service nova] Acquiring lock "98710934-6b96-477b-b4d6-d0d416de3a21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-983b7b83-5b40-47db-8a2d-b39e717255df req-c5494a30-b5d8-413b-8e77-1b8dd87f8d40 service nova] Lock "98710934-6b96-477b-b4d6-d0d416de3a21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-983b7b83-5b40-47db-8a2d-b39e717255df req-c5494a30-b5d8-413b-8e77-1b8dd87f8d40 service nova] Lock "98710934-6b96-477b-b4d6-d0d416de3a21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-983b7b83-5b40-47db-8a2d-b39e717255df req-c5494a30-b5d8-413b-8e77-1b8dd87f8d40 service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] No waiting events found dispatching network-vif-unplugged-8996253c-5555-4f6a-b018-2be387ee55b8 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-983b7b83-5b40-47db-8a2d-b39e717255df req-c5494a30-b5d8-413b-8e77-1b8dd87f8d40 service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Received event network-vif-unplugged-8996253c-5555-4f6a-b018-2be387ee55b8 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:50:00 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Instance destroyed successfully.
Nov 22 14:50:00 user nova-compute[74776]: DEBUG nova.objects.instance [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lazy-loading 'resources' on Instance uuid 98710934-6b96-477b-b4d6-d0d416de3a21 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:46:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1657137372',display_name='tempest-AttachVolumeTestJSON-server-1657137372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1657137372',id=42,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9PJvae8bimOZzh6noy9gYYVV/QbOEUnlmktJvExfKs+DecUXkupBkRkDKj2iJ8c+QUxWpu+j5SWF2EHRmxiHzYTz8GGI8lWt+wI7LlSjAtYdTTB+0jv8vCu/KA4vlRIg==',key_name='tempest-keypair-1906724194',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:47:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='801e8ed62c734be5945d8fbf307aa1d2',ramdisk_id='',reservation_id='r-4xlwasel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1546562861',owner_user_name='tempest-AttachVolumeTestJSON-1546562861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:47:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2494e8b489ea48f1a6b3b19eb87b6306',uuid=98710934-6b96-477b-b4d6-d0d416de3a21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8996253c-5555-4f6a-b018-2be387ee55b8", "address": "fa:16:3e:ae:f2:3b", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8996253c-55", "ovs_interfaceid": "8996253c-5555-4f6a-b018-2be387ee55b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converting VIF {"id": "8996253c-5555-4f6a-b018-2be387ee55b8", "address": "fa:16:3e:ae:f2:3b", "network": {"id": "16b828fb-3496-49a3-a0fe-9c0fd51122a0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-761378961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "801e8ed62c734be5945d8fbf307aa1d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8996253c-55", "ovs_interfaceid": "8996253c-5555-4f6a-b018-2be387ee55b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:f2:3b,bridge_name='br-int',has_traffic_filtering=True,id=8996253c-5555-4f6a-b018-2be387ee55b8,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8996253c-55') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG os_vif [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:f2:3b,bridge_name='br-int',has_traffic_filtering=True,id=8996253c-5555-4f6a-b018-2be387ee55b8,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8996253c-55') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8996253c-55, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=814d32ec-bc8f-4dd5-8001-df6a80beb7bc) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:50:00 user nova-compute[74776]: INFO os_vif [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:f2:3b,bridge_name='br-int',has_traffic_filtering=True,id=8996253c-5555-4f6a-b018-2be387ee55b8,network=Network(16b828fb-3496-49a3-a0fe-9c0fd51122a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8996253c-55')
Nov 22 14:50:00 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Deleting instance files /opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21_del
Nov 22 14:50:00 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Deletion of /opt/stack/data/nova/instances/98710934-6b96-477b-b4d6-d0d416de3a21_del complete
Nov 22 14:50:00 user nova-compute[74776]: INFO nova.compute.manager [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 22 14:50:00 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:50:00 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:50:01 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:50:01 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Took 0.79 seconds to deallocate network for instance.
Nov 22 14:50:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:50:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:50:01 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:50:01 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:50:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:50:01 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Deleted allocations for instance 98710934-6b96-477b-b4d6-d0d416de3a21
Nov 22 14:50:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0465c436-cf4a-4035-84e8-ad8af0d41852 tempest-AttachVolumeTestJSON-1546562861 tempest-AttachVolumeTestJSON-1546562861-project-member] Lock "98710934-6b96-477b-b4d6-d0d416de3a21" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.988s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:50:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-718ee4ce-ea2b-4d2b-a659-2f37e9689e5d req-ebb15231-ff39-409e-83d5-dd461487f44b service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Received event network-vif-plugged-8996253c-5555-4f6a-b018-2be387ee55b8 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:50:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-718ee4ce-ea2b-4d2b-a659-2f37e9689e5d req-ebb15231-ff39-409e-83d5-dd461487f44b service nova] Acquiring lock "98710934-6b96-477b-b4d6-d0d416de3a21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:50:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-718ee4ce-ea2b-4d2b-a659-2f37e9689e5d req-ebb15231-ff39-409e-83d5-dd461487f44b service nova] Lock "98710934-6b96-477b-b4d6-d0d416de3a21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:50:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-718ee4ce-ea2b-4d2b-a659-2f37e9689e5d req-ebb15231-ff39-409e-83d5-dd461487f44b service nova] Lock "98710934-6b96-477b-b4d6-d0d416de3a21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:50:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-718ee4ce-ea2b-4d2b-a659-2f37e9689e5d req-ebb15231-ff39-409e-83d5-dd461487f44b service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] No waiting events found dispatching network-vif-plugged-8996253c-5555-4f6a-b018-2be387ee55b8 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:50:02 user nova-compute[74776]: WARNING nova.compute.manager [req-718ee4ce-ea2b-4d2b-a659-2f37e9689e5d req-ebb15231-ff39-409e-83d5-dd461487f44b service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Received unexpected event network-vif-plugged-8996253c-5555-4f6a-b018-2be387ee55b8 for instance with vm_state deleted and task_state None.
Nov 22 14:50:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-718ee4ce-ea2b-4d2b-a659-2f37e9689e5d req-ebb15231-ff39-409e-83d5-dd461487f44b service nova] [instance: 98710934-6b96-477b-b4d6-d0d416de3a21] Received event network-vif-deleted-8996253c-5555-4f6a-b018-2be387ee55b8 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:50:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:50:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:32 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:50:32 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:50:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-a85f1006-d456-4d9d-aa2f-de57dc7c42f3" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:50:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-a85f1006-d456-4d9d-aa2f-de57dc7c42f3" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:50:32 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:50:33 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Updating instance_info_cache with network_info: [{"id": "e337e003-094f-4871-862a-1a1ffc4414f2", "address": "fa:16:3e:ea:e5:e3", "network": {"id": "8c42bd23-eb1f-408f-b07b-2ac01b738ca0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2136861231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd43e8bdb8d4525a32d7f1216856b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape337e003-09", "ovs_interfaceid": "e337e003-094f-4871-862a-1a1ffc4414f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:50:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-a85f1006-d456-4d9d-aa2f-de57dc7c42f3" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:50:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:50:33 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:50:34 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:50:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:50:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:50:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:50:34 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:50:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:35 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:50:35 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:50:35 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8893MB free_disk=25.09354019165039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:50:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:50:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:50:35 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance a85f1006-d456-4d9d-aa2f-de57dc7c42f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:50:35 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:50:35 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:50:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:35 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:50:35 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:50:35 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:50:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:50:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:36 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:50:36 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:50:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:50:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "a7f827a9-787f-4826-9b73-34b68f8cb742" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:50:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:50:39 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:50:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:50:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:50:39 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:50:39 user nova-compute[74776]: INFO nova.compute.claims [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Claim successful on node user
Nov 22 14:50:39 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:50:39 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:50:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.219s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:50:39 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:50:39 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:50:39 user nova-compute[74776]: DEBUG nova.network.neutron [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:50:39 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:50:39 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:50:39 user nova-compute[74776]: DEBUG nova.policy [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5cce524a8c6419aa76fb4b02861377e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6764076f2a428ea35c11476a3e7231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:50:39 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:50:39 user nova-compute[74776]: INFO nova.virt.block_device [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Booting with volume snapshot 3eeb8919-1b3b-4a04-8385-70bf35a8de7d at /dev/vda
Nov 22 14:50:40 user nova-compute[74776]: DEBUG nova.network.neutron [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Successfully created port: e2b29902-a6a9-4da1-825b-9706fdbad3b3 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:50:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG nova.network.neutron [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Successfully updated port: e2b29902-a6a9-4da1-825b-9706fdbad3b3 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "refresh_cache-a7f827a9-787f-4826-9b73-34b68f8cb742" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquired lock "refresh_cache-a7f827a9-787f-4826-9b73-34b68f8cb742" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG nova.network.neutron [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-b3ae981c-ac19-4f87-9ebd-ccc47523324c req-8f355a6a-31ae-4092-a51b-b7cbd2423132 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Received event network-changed-e2b29902-a6a9-4da1-825b-9706fdbad3b3 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-b3ae981c-ac19-4f87-9ebd-ccc47523324c req-8f355a6a-31ae-4092-a51b-b7cbd2423132 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Refreshing instance network info cache due to event network-changed-e2b29902-a6a9-4da1-825b-9706fdbad3b3. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b3ae981c-ac19-4f87-9ebd-ccc47523324c req-8f355a6a-31ae-4092-a51b-b7cbd2423132 service nova] Acquiring lock "refresh_cache-a7f827a9-787f-4826-9b73-34b68f8cb742" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG nova.network.neutron [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG nova.network.neutron [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Updating instance_info_cache with network_info: [{"id": "e2b29902-a6a9-4da1-825b-9706fdbad3b3", "address": "fa:16:3e:df:fe:09", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b29902-a6", "ovs_interfaceid": "e2b29902-a6a9-4da1-825b-9706fdbad3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Releasing lock "refresh_cache-a7f827a9-787f-4826-9b73-34b68f8cb742" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Instance network_info: |[{"id": "e2b29902-a6a9-4da1-825b-9706fdbad3b3", "address": "fa:16:3e:df:fe:09", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b29902-a6", "ovs_interfaceid": "e2b29902-a6a9-4da1-825b-9706fdbad3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b3ae981c-ac19-4f87-9ebd-ccc47523324c req-8f355a6a-31ae-4092-a51b-b7cbd2423132 service nova] Acquired lock "refresh_cache-a7f827a9-787f-4826-9b73-34b68f8cb742" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG nova.network.neutron [req-b3ae981c-ac19-4f87-9ebd-ccc47523324c req-8f355a6a-31ae-4092-a51b-b7cbd2423132 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Refreshing network info cache for port e2b29902-a6a9-4da1-825b-9706fdbad3b3 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-f39e3dc9-73ab-4aaa-b7a9-c59f99cd96b0 req-224895c2-a67a-4e60-a69b-e5e6149f0cb0 service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Received event network-changed-e337e003-094f-4871-862a-1a1ffc4414f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-f39e3dc9-73ab-4aaa-b7a9-c59f99cd96b0 req-224895c2-a67a-4e60-a69b-e5e6149f0cb0 service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Refreshing instance network info cache due to event network-changed-e337e003-094f-4871-862a-1a1ffc4414f2. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f39e3dc9-73ab-4aaa-b7a9-c59f99cd96b0 req-224895c2-a67a-4e60-a69b-e5e6149f0cb0 service nova] Acquiring lock "refresh_cache-a85f1006-d456-4d9d-aa2f-de57dc7c42f3" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f39e3dc9-73ab-4aaa-b7a9-c59f99cd96b0 req-224895c2-a67a-4e60-a69b-e5e6149f0cb0 service nova] Acquired lock "refresh_cache-a85f1006-d456-4d9d-aa2f-de57dc7c42f3" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG nova.network.neutron [req-f39e3dc9-73ab-4aaa-b7a9-c59f99cd96b0 req-224895c2-a67a-4e60-a69b-e5e6149f0cb0 service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Refreshing network info cache for port e337e003-094f-4871-862a-1a1ffc4414f2 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG nova.network.neutron [req-f39e3dc9-73ab-4aaa-b7a9-c59f99cd96b0 req-224895c2-a67a-4e60-a69b-e5e6149f0cb0 service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Updated VIF entry in instance network info cache for port e337e003-094f-4871-862a-1a1ffc4414f2. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG nova.network.neutron [req-f39e3dc9-73ab-4aaa-b7a9-c59f99cd96b0 req-224895c2-a67a-4e60-a69b-e5e6149f0cb0 service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Updating instance_info_cache with network_info: [{"id": "e337e003-094f-4871-862a-1a1ffc4414f2", "address": "fa:16:3e:ea:e5:e3", "network": {"id": "8c42bd23-eb1f-408f-b07b-2ac01b738ca0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2136861231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd43e8bdb8d4525a32d7f1216856b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape337e003-09", "ovs_interfaceid": "e337e003-094f-4871-862a-1a1ffc4414f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:50:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f39e3dc9-73ab-4aaa-b7a9-c59f99cd96b0 req-224895c2-a67a-4e60-a69b-e5e6149f0cb0 service nova] Releasing lock "refresh_cache-a85f1006-d456-4d9d-aa2f-de57dc7c42f3" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG nova.network.neutron [req-b3ae981c-ac19-4f87-9ebd-ccc47523324c req-8f355a6a-31ae-4092-a51b-b7cbd2423132 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Updated VIF entry in instance network info cache for port e2b29902-a6a9-4da1-825b-9706fdbad3b3. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG nova.network.neutron [req-b3ae981c-ac19-4f87-9ebd-ccc47523324c req-8f355a6a-31ae-4092-a51b-b7cbd2423132 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Updating instance_info_cache with network_info: [{"id": "e2b29902-a6a9-4da1-825b-9706fdbad3b3", "address": "fa:16:3e:df:fe:09", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b29902-a6", "ovs_interfaceid": "e2b29902-a6a9-4da1-825b-9706fdbad3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b3ae981c-ac19-4f87-9ebd-ccc47523324c req-8f355a6a-31ae-4092-a51b-b7cbd2423132 service nova] Releasing lock "refresh_cache-a7f827a9-787f-4826-9b73-34b68f8cb742" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquiring lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG nova.objects.instance [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lazy-loading 'flavor' on Instance uuid a85f1006-d456-4d9d-aa2f-de57dc7c42f3 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.046s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquiring lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:50:42 user nova-compute[74776]: INFO nova.compute.manager [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Attaching volume 20647021-eea1-4f1f-99e4-2810be567de1 to /dev/vdb
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG os_brick.utils [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5163923-1512-42b9-803a-42b5c046ef98]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffe4f59-3cfd-412c-bed5-2d9047a34b0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddde0627-7840-4259-be28-b4ec8f6c2a89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5c46aa-b933-417a-9723-ea07fa5f5ead]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:50:42 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:50:42 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c876456-65c6-4407-a88d-57c75ccd3ba0]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG os_brick.utils [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:50:42 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Updating existing volume attachment record: 7262a95f-9c3e-434c-8661-20ba869478a7 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:50:44 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG os_brick.utils [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e2faee-b2a5-4373-89ff-cf71d1da47c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1a93d6-e50d-461d-81f2-a60d032ae257]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e49b66-408f-4f6a-9b17-4da9f82bd3f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f604f07-fdbd-4697-a715-02d6d30051ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:50:45 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:50:45 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbc0aa1-fc35-471b-b840-e7e0208e965f]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG os_brick.utils [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Updating existing volume attachment record: 62843ba8-f584-48c3-ac40-4813204780cc {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:50:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qyGeMcOx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:50:48 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:50:48 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:50:48 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcfceea-7c9f-431b-bd16-d65a67f54914]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:50:48 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[61703049-15cd-4f7f-8e6b-69a954c8f8ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1] added
Nov 22 14:50:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cc60b4-a683-45cf-8ef2-50abd071d179]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fda158a-6200-463d-acd7-1b4a0be60fd9]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qyGeMcOx {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qyGeMcOx" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b301849-1310-400e-8fe9-c47998b4455c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qyGeMcOx'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[492e5161-d078-4fcf-8f1a-5d1abb331153]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c42df9-7861-49ee-a7c0-7e2c9e412c2f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 14:50:48 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 14:50:48 user nova-compute[74776]:  {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:50:48 user nova-compute[74776]: WARNING os_brick.initiator.connectors.iscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 14:50:48 user nova-compute[74776]: 
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a47b819-dfae-45f7-97b5-f3ea4c9bee79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1, portal: 172.16.0.220,3260]
Nov 22 14:50:48 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1, portal: 172.16.0.220,3260] successful.
Nov 22 14:50:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da07e27-50c1-480d-bb42-73eae41e19d0]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[745f04b3-4fc8-42cf-a36b-d4f51c5c74ae]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 (non-flash)
Nov 22 14:50:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 (non-flash)
Nov 22 14:50:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.231s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a8501f-4930-49d5-a2f2-c7af97962b6a]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:50:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qyGeMcOx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:50:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.261s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:50:49 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] <== connect_volume: return (1263ms) {'type': 'block', 'scsi_wwn': '23232356565653533', 'path': '/dev/sdb'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:50:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232356565653533', 'path': '/dev/sdb'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:50:49 user nova-compute[74776]: DEBUG nova.objects.instance [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lazy-loading 'flavor' on Instance uuid a85f1006-d456-4d9d-aa2f-de57dc7c42f3 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:50:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:50:49 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:50:49 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 14:50:49 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:50:49 user nova-compute[74776]:   <serial>20647021-eea1-4f1f-99e4-2810be567de1</serial>
Nov 22 14:50:49 user nova-compute[74776]: </disk>
Nov 22 14:50:49 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:50:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:50:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:50:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] No VIF found with MAC fa:16:3e:ea:e5:e3, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:50:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-49dd346c-3acd-43f9-a8a0-3816da39faeb tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.582s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:50:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:50:51 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Creating image(s)
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Did not create local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Ensure instance console log exists: /opt/stack/data/nova/instances/a7f827a9-787f-4826-9b73-34b68f8cb742/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Start _get_guest_xml network_info=[{"id": "e2b29902-a6a9-4da1-825b-9706fdbad3b3", "address": "fa:16:3e:df:fe:09", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b29902-a6", "ovs_interfaceid": "e2b29902-a6a9-4da1-825b-9706fdbad3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '62843ba8-f584-48c3-ac40-4813204780cc', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMmVjLFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a7f827a9-787f-4826-9b73-34b68f8cb742', 'attached_at': '', 'detached_at': '', 'volume_id': 'a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb', 'serial': 'a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb'}, 'boot_index': 0, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:50:51 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:50:51 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMmVjLFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:50:51 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:50:51 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:50:51 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f18334e-4def-4ac5-9f2e-7523400147d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:50:51 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f847440d-e851-445b-99d4-98470451095c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb] added
Nov 22 14:50:51 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e971ae6-ff70-4f38-9de1-cfae974ec700]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[025bf018-3dfb-4645-9e10-082d9db66a4b]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMmVjLFu {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMmVjLFu" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[11838add-89a9-47dd-a743-0698e55a6f92]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QMmVjLFu'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[267e779e-26ae-43fc-bec0-d981d19663dd]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65626b5-8f65-45ca-be55-7de60a09b8e5]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 (non-flash)
Nov 22 14:50:51 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 (non-flash)
Nov 22 14:50:51 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f3e4bf-d3b7-4fd3-8db8-d5bdc5a83afe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb, portal: 172.16.0.220,3260]
Nov 22 14:50:51 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb, portal: 172.16.0.220,3260] successful.
Nov 22 14:50:51 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b210e9a0-cb7e-4057-a1cf-9aceb6dd83e2]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c3db9a-a4db-4961-9844-d5dc032fa21b]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 (non-flash)
Nov 22 14:50:51 user nova-compute[74776]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb (non-flash)
Nov 22 14:50:51 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 (non-flash)
Nov 22 14:50:51 user nova-compute[74776]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb (non-flash)
Nov 22 14:50:51 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0ead4d-3ac7-446d-842e-b06743bcc702]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:50:51 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMmVjLFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26566343962373162', 'path': '/dev/sdc'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566343962373162', 'path': '/dev/sdc'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1327794556',display_name='tempest-TestVolumeBootPattern-server-1327794556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1327794556',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f6764076f2a428ea35c11476a3e7231',ramdisk_id='',reservation_id='r-4drb4yr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1931721751',owner_user_name='tempest-TestVolumeBootPattern-1931721751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:50:40Z,user_data=None,user_id='d5cce524a8c6419aa76fb4b02861377e',uuid=a7f827a9-787f-4826-9b73-34b68f8cb742,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2b29902-a6a9-4da1-825b-9706fdbad3b3", "address": "fa:16:3e:df:fe:09", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b29902-a6", "ovs_interfaceid": "e2b29902-a6a9-4da1-825b-9706fdbad3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converting VIF {"id": "e2b29902-a6a9-4da1-825b-9706fdbad3b3", "address": "fa:16:3e:df:fe:09", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b29902-a6", "ovs_interfaceid": "e2b29902-a6a9-4da1-825b-9706fdbad3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:fe:09,bridge_name='br-int',has_traffic_filtering=True,id=e2b29902-a6a9-4da1-825b-9706fdbad3b3,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b29902-a6') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG nova.objects.instance [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lazy-loading 'pci_devices' on Instance uuid a7f827a9-787f-4826-9b73-34b68f8cb742 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:50:52 user nova-compute[74776]:   <uuid>a7f827a9-787f-4826-9b73-34b68f8cb742</uuid>
Nov 22 14:50:52 user nova-compute[74776]:   <name>instance-0000002c</name>
Nov 22 14:50:52 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:50:52 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:50:52 user nova-compute[74776]:   <metadata>
Nov 22 14:50:52 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:50:52 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:50:52 user nova-compute[74776]:       <nova:name>tempest-TestVolumeBootPattern-server-1327794556</nova:name>
Nov 22 14:50:52 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:50:51</nova:creationTime>
Nov 22 14:50:52 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:50:52 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:50:52 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:50:52 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:50:52 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:50:52 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:50:52 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:50:52 user nova-compute[74776]:       <nova:owner>
Nov 22 14:50:52 user nova-compute[74776]:         <nova:user uuid="d5cce524a8c6419aa76fb4b02861377e">tempest-TestVolumeBootPattern-1931721751-project-member</nova:user>
Nov 22 14:50:52 user nova-compute[74776]:         <nova:project uuid="2f6764076f2a428ea35c11476a3e7231">tempest-TestVolumeBootPattern-1931721751</nova:project>
Nov 22 14:50:52 user nova-compute[74776]:       </nova:owner>
Nov 22 14:50:52 user nova-compute[74776]:       <nova:ports>
Nov 22 14:50:52 user nova-compute[74776]:         <nova:port uuid="e2b29902-a6a9-4da1-825b-9706fdbad3b3">
Nov 22 14:50:52 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 22 14:50:52 user nova-compute[74776]:         </nova:port>
Nov 22 14:50:52 user nova-compute[74776]:       </nova:ports>
Nov 22 14:50:52 user nova-compute[74776]:     </nova:instance>
Nov 22 14:50:52 user nova-compute[74776]:   </metadata>
Nov 22 14:50:52 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:50:52 user nova-compute[74776]:     <system>
Nov 22 14:50:52 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:50:52 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:50:52 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:50:52 user nova-compute[74776]:       <entry name="serial">a7f827a9-787f-4826-9b73-34b68f8cb742</entry>
Nov 22 14:50:52 user nova-compute[74776]:       <entry name="uuid">a7f827a9-787f-4826-9b73-34b68f8cb742</entry>
Nov 22 14:50:52 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:50:52 user nova-compute[74776]:     </system>
Nov 22 14:50:52 user nova-compute[74776]:   </sysinfo>
Nov 22 14:50:52 user nova-compute[74776]:   <os>
Nov 22 14:50:52 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:50:52 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:50:52 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:50:52 user nova-compute[74776]:   </os>
Nov 22 14:50:52 user nova-compute[74776]:   <features>
Nov 22 14:50:52 user nova-compute[74776]:     <acpi/>
Nov 22 14:50:52 user nova-compute[74776]:     <apic/>
Nov 22 14:50:52 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:50:52 user nova-compute[74776]:   </features>
Nov 22 14:50:52 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:50:52 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:50:52 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:50:52 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:50:52 user nova-compute[74776]:   </clock>
Nov 22 14:50:52 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:50:52 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:50:52 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:50:52 user nova-compute[74776]:   </cpu>
Nov 22 14:50:52 user nova-compute[74776]:   <devices>
Nov 22 14:50:52 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:50:52 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:50:52 user nova-compute[74776]:       <source dev="/dev/sdc"/>
Nov 22 14:50:52 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:50:52 user nova-compute[74776]:       <serial>a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb</serial>
Nov 22 14:50:52 user nova-compute[74776]:     </disk>
Nov 22 14:50:52 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:50:52 user nova-compute[74776]:       <mac address="fa:16:3e:df:fe:09"/>
Nov 22 14:50:52 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:50:52 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:50:52 user nova-compute[74776]:       <target dev="tape2b29902-a6"/>
Nov 22 14:50:52 user nova-compute[74776]:     </interface>
Nov 22 14:50:52 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:50:52 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/a7f827a9-787f-4826-9b73-34b68f8cb742/console.log" append="off"/>
Nov 22 14:50:52 user nova-compute[74776]:     </serial>
Nov 22 14:50:52 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:50:52 user nova-compute[74776]:     <video>
Nov 22 14:50:52 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:50:52 user nova-compute[74776]:     </video>
Nov 22 14:50:52 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:50:52 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:50:52 user nova-compute[74776]:     </rng>
Nov 22 14:50:52 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:50:52 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:50:52 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:50:52 user nova-compute[74776]:     </memballoon>
Nov 22 14:50:52 user nova-compute[74776]:   </devices>
Nov 22 14:50:52 user nova-compute[74776]: </domain>
Nov 22 14:50:52 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1327794556',display_name='tempest-TestVolumeBootPattern-server-1327794556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1327794556',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f6764076f2a428ea35c11476a3e7231',ramdisk_id='',reservation_id='r-4drb4yr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1931721751',owner_user_name='tempest-TestVolumeBootPattern-1931721751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:50:40Z,user_data=None,user_id='d5cce524a8c6419aa76fb4b02861377e',uuid=a7f827a9-787f-4826-9b73-34b68f8cb742,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2b29902-a6a9-4da1-825b-9706fdbad3b3", "address": "fa:16:3e:df:fe:09", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b29902-a6", "ovs_interfaceid": "e2b29902-a6a9-4da1-825b-9706fdbad3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converting VIF {"id": "e2b29902-a6a9-4da1-825b-9706fdbad3b3", "address": "fa:16:3e:df:fe:09", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b29902-a6", "ovs_interfaceid": "e2b29902-a6a9-4da1-825b-9706fdbad3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:fe:09,bridge_name='br-int',has_traffic_filtering=True,id=e2b29902-a6a9-4da1-825b-9706fdbad3b3,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b29902-a6') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG os_vif [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:fe:09,bridge_name='br-int',has_traffic_filtering=True,id=e2b29902-a6a9-4da1-825b-9706fdbad3b3,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b29902-a6') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92aab4ee-bdfe-5e2f-b2da-3b45a1193b1d', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2b29902-a6, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2b29902-a6, col_values=(('qos', UUID('f2cab04d-5abc-4fcd-931a-89ee32819463')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2b29902-a6, col_values=(('external_ids', {'iface-id': 'e2b29902-a6a9-4da1-825b-9706fdbad3b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:fe:09', 'vm-uuid': 'a7f827a9-787f-4826-9b73-34b68f8cb742'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:52 user nova-compute[74776]: INFO os_vif [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:fe:09,bridge_name='br-int',has_traffic_filtering=True,id=e2b29902-a6a9-4da1-825b-9706fdbad3b3,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b29902-a6')
Nov 22 14:50:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:50:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] No VIF found with MAC fa:16:3e:df:fe:09, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:50:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquiring lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:50:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:50:53 user nova-compute[74776]: DEBUG nova.objects.instance [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lazy-loading 'flavor' on Instance uuid a85f1006-d456-4d9d-aa2f-de57dc7c42f3 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:50:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:50:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquiring lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:50:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:50:53 user nova-compute[74776]: INFO nova.compute.manager [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Attaching volume 006b26a7-6cda-4aaa-b13f-9f5912bd439d to /dev/vdc
Nov 22 14:50:54 user nova-compute[74776]: DEBUG os_brick.utils [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0bb6b3-9b4c-4f3f-b778-124a0bc7af59]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6239021-6952-4a46-9e9a-d0152571ef05]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c02146-44cc-4a6e-96cb-1071e15a8840]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[630f4364-64cc-47e0-9cfa-fa563a1a5839]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:50:54 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:50:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4a5904-6c2f-46a8-9ccb-471f3f32bb23]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG os_brick.utils [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Updating existing volume attachment record: e3d09242-edad-4ad3-a30d-0f2cf8f5e158 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG nova.compute.manager [req-1c46631e-c251-4861-9232-1f135fcb0868 req-de13b386-37ad-4800-9809-867a39da9f48 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Received event network-vif-plugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1c46631e-c251-4861-9232-1f135fcb0868 req-de13b386-37ad-4800-9809-867a39da9f48 service nova] Acquiring lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1c46631e-c251-4861-9232-1f135fcb0868 req-de13b386-37ad-4800-9809-867a39da9f48 service nova] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1c46631e-c251-4861-9232-1f135fcb0868 req-de13b386-37ad-4800-9809-867a39da9f48 service nova] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG nova.compute.manager [req-1c46631e-c251-4861-9232-1f135fcb0868 req-de13b386-37ad-4800-9809-867a39da9f48 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] No waiting events found dispatching network-vif-plugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:50:54 user nova-compute[74776]: WARNING nova.compute.manager [req-1c46631e-c251-4861-9232-1f135fcb0868 req-de13b386-37ad-4800-9809-867a39da9f48 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Received unexpected event network-vif-plugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 for instance with vm_state building and task_state spawning.
Nov 22 14:50:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:50:56 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:50:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:50:56 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Instance spawned successfully.
Nov 22 14:50:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:50:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:50:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:50:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:50:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:50:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:50:56 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:50:56 user nova-compute[74776]: INFO nova.compute.manager [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 22 14:50:56 user nova-compute[74776]: DEBUG nova.compute.manager [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:50:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-2ea9212a-a121-4bf6-9b1a-c9a64db2f26a req-64da07eb-9d12-4f56-939c-c248a424507c service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Received event network-vif-plugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:50:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2ea9212a-a121-4bf6-9b1a-c9a64db2f26a req-64da07eb-9d12-4f56-939c-c248a424507c service nova] Acquiring lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:50:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2ea9212a-a121-4bf6-9b1a-c9a64db2f26a req-64da07eb-9d12-4f56-939c-c248a424507c service nova] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:50:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2ea9212a-a121-4bf6-9b1a-c9a64db2f26a req-64da07eb-9d12-4f56-939c-c248a424507c service nova] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:50:56 user nova-compute[74776]: DEBUG nova.compute.manager [req-2ea9212a-a121-4bf6-9b1a-c9a64db2f26a req-64da07eb-9d12-4f56-939c-c248a424507c service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] No waiting events found dispatching network-vif-plugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:50:56 user nova-compute[74776]: WARNING nova.compute.manager [req-2ea9212a-a121-4bf6-9b1a-c9a64db2f26a req-64da07eb-9d12-4f56-939c-c248a424507c service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Received unexpected event network-vif-plugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 for instance with vm_state building and task_state spawning.
Nov 22 14:50:56 user nova-compute[74776]: INFO nova.compute.manager [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Took 17.20 seconds to build instance.
Nov 22 14:50:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a796d7b9-4b95-41f5-9b9b-fca96b0ef8cd tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.302s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:50:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoPphmNC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:51:00 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:51:00 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:51:00 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa65320-de1a-4fde-8203-544fdb95a56f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:51:00 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[81112d5c-2e60-463e-ac45-26838f65916e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d] added
Nov 22 14:51:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d899ad87-583a-4a95-9e99-9e1da7f1fa9e]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8545e0e-630b-4543-ba0f-ce36dc8b9712]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UoPphmNC {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UoPphmNC" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ec3938-d0d2-40ec-8a24-5dcaa7c67724]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UoPphmNC'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[643b62e5-a50c-4350-91c6-27a7b53c1e52]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f985d8c0-b41d-4455-9a01-1a4dbd97448d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 (non-flash)
Nov 22 14:51:00 user nova-compute[74776]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb (non-flash)
Nov 22 14:51:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 (non-flash)
Nov 22 14:51:00 user nova-compute[74776]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb (non-flash)
Nov 22 14:51:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2f9d3e-3141-4642-a02a-46473551c985]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d, portal: 172.16.0.220,3260]
Nov 22 14:51:00 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d, portal: 172.16.0.220,3260] successful.
Nov 22 14:51:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7a6e54-33ca-4570-92ea-99e591a4d4f6]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d7c3a6-0ac5-40ed-bf63-bb1a272ca8e2]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 (non-flash)
Nov 22 14:51:00 user nova-compute[74776]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb (non-flash)
Nov 22 14:51:00 user nova-compute[74776]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d (non-flash)
Nov 22 14:51:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 (non-flash)
Nov 22 14:51:00 user nova-compute[74776]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb (non-flash)
Nov 22 14:51:00 user nova-compute[74776]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d (non-flash)
Nov 22 14:51:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] HCTL ('35', '-', '-', 0) found on session 53 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3a255d-19be-4d11-ae69-7fb18aecd74a]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:51:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoPphmNC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:51:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:51:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23330626162353537', 'path': '/dev/sdd'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:51:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330626162353537', 'path': '/dev/sdd'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:51:01 user nova-compute[74776]: DEBUG nova.objects.instance [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lazy-loading 'flavor' on Instance uuid a85f1006-d456-4d9d-aa2f-de57dc7c42f3 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:51:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 14:51:01 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:51:01 user nova-compute[74776]:   <source dev="/dev/sdd"/>
Nov 22 14:51:01 user nova-compute[74776]:   <target dev="vdc" bus="virtio"/>
Nov 22 14:51:01 user nova-compute[74776]:   <serial>006b26a7-6cda-4aaa-b13f-9f5912bd439d</serial>
Nov 22 14:51:01 user nova-compute[74776]: </disk>
Nov 22 14:51:01 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 14:51:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:51:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:51:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:51:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] No VIF found with MAC fa:16:3e:ea:e5:e3, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:51:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-30788a5c-b812-48d1-b34b-889240fd4854 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.627s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:51:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquiring lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:51:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:51:04 user nova-compute[74776]: INFO nova.compute.manager [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Detaching volume 006b26a7-6cda-4aaa-b13f-9f5912bd439d
Nov 22 14:51:04 user nova-compute[74776]: INFO nova.virt.block_device [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Attempting to driver detach volume 006b26a7-6cda-4aaa-b13f-9f5912bd439d from mountpoint /dev/vdc
Nov 22 14:51:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Attempting to detach device vdc from instance a85f1006-d456-4d9d-aa2f-de57dc7c42f3 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:51:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:51:04 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:51:04 user nova-compute[74776]:   <source dev="/dev/sdd"/>
Nov 22 14:51:04 user nova-compute[74776]:   <target dev="vdc" bus="virtio"/>
Nov 22 14:51:04 user nova-compute[74776]:   <serial>006b26a7-6cda-4aaa-b13f-9f5912bd439d</serial>
Nov 22 14:51:04 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 22 14:51:04 user nova-compute[74776]: </disk>
Nov 22 14:51:04 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:51:04 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Successfully detached device vdc from instance a85f1006-d456-4d9d-aa2f-de57dc7c42f3 from the persistent domain config.
Nov 22 14:51:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a85f1006-d456-4d9d-aa2f-de57dc7c42f3 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:51:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:51:04 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:51:04 user nova-compute[74776]:   <source dev="/dev/sdd"/>
Nov 22 14:51:04 user nova-compute[74776]:   <target dev="vdc" bus="virtio"/>
Nov 22 14:51:04 user nova-compute[74776]:   <serial>006b26a7-6cda-4aaa-b13f-9f5912bd439d</serial>
Nov 22 14:51:04 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 22 14:51:04 user nova-compute[74776]: </disk>
Nov 22 14:51:04 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:51:04 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a85f1006-d456-4d9d-aa2f-de57dc7c42f3 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:51:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:24 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a85f1006-d456-4d9d-aa2f-de57dc7c42f3 is timed out.
Nov 22 14:51:24 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Successfully detached device vdc from instance a85f1006-d456-4d9d-aa2f-de57dc7c42f3 from the live domain config.
Nov 22 14:51:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoPphmNC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:51:24 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:51:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[930b5814-2176-4407-99bc-c2ad82138bc3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:51:24 user nova-compute[74776]: No targets found.
Nov 22 14:51:24 user nova-compute[74776]: iSNS:
Nov 22 14:51:24 user nova-compute[74776]: No targets found.
Nov 22 14:51:24 user nova-compute[74776]: STATIC:
Nov 22 14:51:24 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb
Nov 22 14:51:24 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:51:24 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:51:24 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d
Nov 22 14:51:24 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:51:24 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:51:24 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1
Nov 22 14:51:24 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:51:24 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:51:24 user nova-compute[74776]: FIRMWARE:
Nov 22 14:51:24 user nova-compute[74776]: No targets found.
Nov 22 14:51:24 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:51:24 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:51:24 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d810f86-cc78-4a2a-ab82-e49cbac9f27e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bb9525-d405-4f90-9da6-18e65b81ad90]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 (non-flash)
Nov 22 14:51:24 user nova-compute[74776]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb (non-flash)
Nov 22 14:51:24 user nova-compute[74776]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d (non-flash)
Nov 22 14:51:24 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 (non-flash)
Nov 22 14:51:24 user nova-compute[74776]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb (non-flash)
Nov 22 14:51:24 user nova-compute[74776]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d (non-flash)
Nov 22 14:51:24 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c7841a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d'): ({'sdd'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Removing single pathed devices sdd {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9bc18b-6d03-4a9a-a43c-a5b7ecb20b1c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b190a5-6a68-4d8e-a78f-518957c42850]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Flushing IO for device /dev/sdd {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9547a0d7-fc1c-4435-9abd-b420fc675460]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4282da83-f95c-4a66-bf7b-7c95c99e0e89]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] SCSI volumes sdd have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8e2cdf-f098-4151-8028-be209e508535]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[90785e3d-86c2-41c9-afce-e3615d773f92]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d, portal: 172.16.0.220,3260]
Nov 22 14:51:24 user nova-compute[74776]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d, portal: 172.16.0.220,3260] successful.
Nov 22 14:51:24 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:006b26a7-6cda-4aaa-b13f-9f5912bd439d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[77889580-4617-4741-8de5-bef954c5e897]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] <== disconnect_volume: return (294ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:51:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:51:25 user nova-compute[74776]: DEBUG nova.objects.instance [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lazy-loading 'flavor' on Instance uuid a85f1006-d456-4d9d-aa2f-de57dc7c42f3 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:51:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-b22664f0-a79f-4beb-8f9c-012ba691f5bf tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.628s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:51:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:32 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:51:32 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:51:32 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 14:51:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-a85f1006-d456-4d9d-aa2f-de57dc7c42f3" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:51:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-a85f1006-d456-4d9d-aa2f-de57dc7c42f3" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:51:32 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:51:32 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid a85f1006-d456-4d9d-aa2f-de57dc7c42f3 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:51:33 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Updating instance_info_cache with network_info: [{"id": "e337e003-094f-4871-862a-1a1ffc4414f2", "address": "fa:16:3e:ea:e5:e3", "network": {"id": "8c42bd23-eb1f-408f-b07b-2ac01b738ca0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2136861231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd43e8bdb8d4525a32d7f1216856b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape337e003-09", "ovs_interfaceid": "e337e003-094f-4871-862a-1a1ffc4414f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:51:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-a85f1006-d456-4d9d-aa2f-de57dc7c42f3" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:51:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:51:34 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:51:34 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:51:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:51:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:51:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:51:34 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:51:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:35 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:51:35 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:51:35 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:51:35 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:51:35 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8760MB free_disk=25.081565856933594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:51:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:51:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:51:35 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance a85f1006-d456-4d9d-aa2f-de57dc7c42f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:51:35 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance a7f827a9-787f-4826-9b73-34b68f8cb742 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:51:35 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:51:35 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:51:35 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:51:35 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:51:35 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:51:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:51:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:51:38 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:51:38 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:51:38 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:51:41 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:51:42 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:51:42 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:51:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:51:45 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:51:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquiring lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:51:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:51:54 user nova-compute[74776]: INFO nova.compute.manager [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Detaching volume 20647021-eea1-4f1f-99e4-2810be567de1
Nov 22 14:51:54 user nova-compute[74776]: INFO nova.virt.block_device [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Attempting to driver detach volume 20647021-eea1-4f1f-99e4-2810be567de1 from mountpoint /dev/vdb
Nov 22 14:51:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Attempting to detach device vdb from instance a85f1006-d456-4d9d-aa2f-de57dc7c42f3 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 14:51:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:51:54 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:51:54 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 14:51:54 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:51:54 user nova-compute[74776]:   <serial>20647021-eea1-4f1f-99e4-2810be567de1</serial>
Nov 22 14:51:54 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:51:54 user nova-compute[74776]: </disk>
Nov 22 14:51:54 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:51:54 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Successfully detached device vdb from instance a85f1006-d456-4d9d-aa2f-de57dc7c42f3 from the persistent domain config.
Nov 22 14:51:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a85f1006-d456-4d9d-aa2f-de57dc7c42f3 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 14:51:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 14:51:54 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:51:54 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 14:51:54 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 14:51:54 user nova-compute[74776]:   <serial>20647021-eea1-4f1f-99e4-2810be567de1</serial>
Nov 22 14:51:54 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 14:51:54 user nova-compute[74776]: </disk>
Nov 22 14:51:54 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 14:51:55 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a85f1006-d456-4d9d-aa2f-de57dc7c42f3 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 14:51:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Acquiring lock "ff941215-6e73-4ad4-9d7c-be7825029466" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:51:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "ff941215-6e73-4ad4-9d7c-be7825029466" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:51:56 user nova-compute[74776]: DEBUG nova.compute.manager [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:51:57 user nova-compute[74776]: INFO nova.compute.claims [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Claim successful on node user
Nov 22 14:51:57 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG nova.compute.manager [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG nova.compute.manager [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG nova.network.neutron [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:51:57 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:51:57 user nova-compute[74776]: DEBUG nova.compute.manager [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG nova.policy [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e21ccdbbadfc4b8b81d96194dff23b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd222b98813445e0af4430563b942958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG nova.compute.manager [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:51:57 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Creating image(s)
Nov 22 14:51:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "/opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "/opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.180s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/disk 1073741824" returned: 0 in 0.075s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:57 user nova-compute[74776]: DEBUG nova.network.neutron [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Successfully created port: ccc343e2-1b4d-4f3d-9b28-0b2962c810e0 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.191s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Cannot resize image /opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Ensure instance console log exists: /opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.network.neutron [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Successfully updated port: ccc343e2-1b4d-4f3d-9b28-0b2962c810e0 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Acquiring lock "refresh_cache-ff941215-6e73-4ad4-9d7c-be7825029466" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Acquired lock "refresh_cache-ff941215-6e73-4ad4-9d7c-be7825029466" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.network.neutron [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.compute.manager [req-5f7aae37-dfa9-4e20-ba5a-e102c1e14b34 req-822a80dc-242c-45df-822f-dbc3ae5a0c25 service nova] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Received event network-changed-ccc343e2-1b4d-4f3d-9b28-0b2962c810e0 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.compute.manager [req-5f7aae37-dfa9-4e20-ba5a-e102c1e14b34 req-822a80dc-242c-45df-822f-dbc3ae5a0c25 service nova] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Refreshing instance network info cache due to event network-changed-ccc343e2-1b4d-4f3d-9b28-0b2962c810e0. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5f7aae37-dfa9-4e20-ba5a-e102c1e14b34 req-822a80dc-242c-45df-822f-dbc3ae5a0c25 service nova] Acquiring lock "refresh_cache-ff941215-6e73-4ad4-9d7c-be7825029466" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.network.neutron [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.network.neutron [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Updating instance_info_cache with network_info: [{"id": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "address": "fa:16:3e:1a:c0:b4", "network": {"id": "166a938b-0779-4198-8905-ebda4e19e289", "bridge": "br-int", "label": "tempest-VolumesActionsTest-102064328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd222b98813445e0af4430563b942958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc343e2-1b", "ovs_interfaceid": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Releasing lock "refresh_cache-ff941215-6e73-4ad4-9d7c-be7825029466" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.compute.manager [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Instance network_info: |[{"id": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "address": "fa:16:3e:1a:c0:b4", "network": {"id": "166a938b-0779-4198-8905-ebda4e19e289", "bridge": "br-int", "label": "tempest-VolumesActionsTest-102064328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd222b98813445e0af4430563b942958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc343e2-1b", "ovs_interfaceid": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5f7aae37-dfa9-4e20-ba5a-e102c1e14b34 req-822a80dc-242c-45df-822f-dbc3ae5a0c25 service nova] Acquired lock "refresh_cache-ff941215-6e73-4ad4-9d7c-be7825029466" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.network.neutron [req-5f7aae37-dfa9-4e20-ba5a-e102c1e14b34 req-822a80dc-242c-45df-822f-dbc3ae5a0c25 service nova] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Refreshing network info cache for port ccc343e2-1b4d-4f3d-9b28-0b2962c810e0 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Start _get_guest_xml network_info=[{"id": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "address": "fa:16:3e:1a:c0:b4", "network": {"id": "166a938b-0779-4198-8905-ebda4e19e289", "bridge": "br-int", "label": "tempest-VolumesActionsTest-102064328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd222b98813445e0af4430563b942958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc343e2-1b", "ovs_interfaceid": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:51:58 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:51:58 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1338725153',display_name='tempest-VolumesActionsTest-instance-1338725153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1338725153',id=45,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd222b98813445e0af4430563b942958',ramdisk_id='',reservation_id='r-wogxwecv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1883387310',owner_user_name='tempest-VolumesActionsTest-1883387310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:51:57Z,user_data=None,user_id='e21ccdbbadfc4b8b81d96194dff23b38',uuid=ff941215-6e73-4ad4-9d7c-be7825029466,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "address": "fa:16:3e:1a:c0:b4", "network": {"id": "166a938b-0779-4198-8905-ebda4e19e289", "bridge": "br-int", "label": "tempest-VolumesActionsTest-102064328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd222b98813445e0af4430563b942958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc343e2-1b", "ovs_interfaceid": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Converting VIF {"id": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "address": "fa:16:3e:1a:c0:b4", "network": {"id": "166a938b-0779-4198-8905-ebda4e19e289", "bridge": "br-int", "label": "tempest-VolumesActionsTest-102064328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd222b98813445e0af4430563b942958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc343e2-1b", "ovs_interfaceid": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:c0:b4,bridge_name='br-int',has_traffic_filtering=True,id=ccc343e2-1b4d-4f3d-9b28-0b2962c810e0,network=Network(166a938b-0779-4198-8905-ebda4e19e289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccc343e2-1b') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.objects.instance [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lazy-loading 'pci_devices' on Instance uuid ff941215-6e73-4ad4-9d7c-be7825029466 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:51:58 user nova-compute[74776]:   <uuid>ff941215-6e73-4ad4-9d7c-be7825029466</uuid>
Nov 22 14:51:58 user nova-compute[74776]:   <name>instance-0000002d</name>
Nov 22 14:51:58 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:51:58 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:51:58 user nova-compute[74776]:   <metadata>
Nov 22 14:51:58 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:51:58 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:51:58 user nova-compute[74776]:       <nova:name>tempest-VolumesActionsTest-instance-1338725153</nova:name>
Nov 22 14:51:58 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:51:58</nova:creationTime>
Nov 22 14:51:58 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:51:58 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:51:58 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:51:58 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:51:58 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:51:58 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:51:58 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:51:58 user nova-compute[74776]:       <nova:owner>
Nov 22 14:51:58 user nova-compute[74776]:         <nova:user uuid="e21ccdbbadfc4b8b81d96194dff23b38">tempest-VolumesActionsTest-1883387310-project-member</nova:user>
Nov 22 14:51:58 user nova-compute[74776]:         <nova:project uuid="fd222b98813445e0af4430563b942958">tempest-VolumesActionsTest-1883387310</nova:project>
Nov 22 14:51:58 user nova-compute[74776]:       </nova:owner>
Nov 22 14:51:58 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:51:58 user nova-compute[74776]:       <nova:ports>
Nov 22 14:51:58 user nova-compute[74776]:         <nova:port uuid="ccc343e2-1b4d-4f3d-9b28-0b2962c810e0">
Nov 22 14:51:58 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 22 14:51:58 user nova-compute[74776]:         </nova:port>
Nov 22 14:51:58 user nova-compute[74776]:       </nova:ports>
Nov 22 14:51:58 user nova-compute[74776]:     </nova:instance>
Nov 22 14:51:58 user nova-compute[74776]:   </metadata>
Nov 22 14:51:58 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:51:58 user nova-compute[74776]:     <system>
Nov 22 14:51:58 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:51:58 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:51:58 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:51:58 user nova-compute[74776]:       <entry name="serial">ff941215-6e73-4ad4-9d7c-be7825029466</entry>
Nov 22 14:51:58 user nova-compute[74776]:       <entry name="uuid">ff941215-6e73-4ad4-9d7c-be7825029466</entry>
Nov 22 14:51:58 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:51:58 user nova-compute[74776]:     </system>
Nov 22 14:51:58 user nova-compute[74776]:   </sysinfo>
Nov 22 14:51:58 user nova-compute[74776]:   <os>
Nov 22 14:51:58 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:51:58 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:51:58 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:51:58 user nova-compute[74776]:   </os>
Nov 22 14:51:58 user nova-compute[74776]:   <features>
Nov 22 14:51:58 user nova-compute[74776]:     <acpi/>
Nov 22 14:51:58 user nova-compute[74776]:     <apic/>
Nov 22 14:51:58 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:51:58 user nova-compute[74776]:   </features>
Nov 22 14:51:58 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:51:58 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:51:58 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:51:58 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:51:58 user nova-compute[74776]:   </clock>
Nov 22 14:51:58 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:51:58 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:51:58 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:51:58 user nova-compute[74776]:   </cpu>
Nov 22 14:51:58 user nova-compute[74776]:   <devices>
Nov 22 14:51:58 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:51:58 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:51:58 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/disk"/>
Nov 22 14:51:58 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:51:58 user nova-compute[74776]:     </disk>
Nov 22 14:51:58 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:51:58 user nova-compute[74776]:       <mac address="fa:16:3e:1a:c0:b4"/>
Nov 22 14:51:58 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:51:58 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:51:58 user nova-compute[74776]:       <target dev="tapccc343e2-1b"/>
Nov 22 14:51:58 user nova-compute[74776]:     </interface>
Nov 22 14:51:58 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:51:58 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/console.log" append="off"/>
Nov 22 14:51:58 user nova-compute[74776]:     </serial>
Nov 22 14:51:58 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:51:58 user nova-compute[74776]:     <video>
Nov 22 14:51:58 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:51:58 user nova-compute[74776]:     </video>
Nov 22 14:51:58 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:51:58 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:51:58 user nova-compute[74776]:     </rng>
Nov 22 14:51:58 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:51:58 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:51:58 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:51:58 user nova-compute[74776]:     </memballoon>
Nov 22 14:51:58 user nova-compute[74776]:   </devices>
Nov 22 14:51:58 user nova-compute[74776]: </domain>
Nov 22 14:51:58 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1338725153',display_name='tempest-VolumesActionsTest-instance-1338725153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1338725153',id=45,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd222b98813445e0af4430563b942958',ramdisk_id='',reservation_id='r-wogxwecv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1883387310',owner_user_name='tempest-VolumesActionsTest-1883387310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:51:57Z,user_data=None,user_id='e21ccdbbadfc4b8b81d96194dff23b38',uuid=ff941215-6e73-4ad4-9d7c-be7825029466,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "address": "fa:16:3e:1a:c0:b4", "network": {"id": "166a938b-0779-4198-8905-ebda4e19e289", "bridge": "br-int", "label": "tempest-VolumesActionsTest-102064328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd222b98813445e0af4430563b942958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc343e2-1b", "ovs_interfaceid": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Converting VIF {"id": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "address": "fa:16:3e:1a:c0:b4", "network": {"id": "166a938b-0779-4198-8905-ebda4e19e289", "bridge": "br-int", "label": "tempest-VolumesActionsTest-102064328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd222b98813445e0af4430563b942958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc343e2-1b", "ovs_interfaceid": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:c0:b4,bridge_name='br-int',has_traffic_filtering=True,id=ccc343e2-1b4d-4f3d-9b28-0b2962c810e0,network=Network(166a938b-0779-4198-8905-ebda4e19e289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccc343e2-1b') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG os_vif [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:c0:b4,bridge_name='br-int',has_traffic_filtering=True,id=ccc343e2-1b4d-4f3d-9b28-0b2962c810e0,network=Network(166a938b-0779-4198-8905-ebda4e19e289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccc343e2-1b') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e30da58a-0e9a-50d7-8ebf-8760e70d17f8', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccc343e2-1b, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapccc343e2-1b, col_values=(('qos', UUID('f7a6c0e2-ea74-4e18-b635-5b1a230654bf')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapccc343e2-1b, col_values=(('external_ids', {'iface-id': 'ccc343e2-1b4d-4f3d-9b28-0b2962c810e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:c0:b4', 'vm-uuid': 'ff941215-6e73-4ad4-9d7c-be7825029466'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:51:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:51:58 user nova-compute[74776]: INFO os_vif [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:c0:b4,bridge_name='br-int',has_traffic_filtering=True,id=ccc343e2-1b4d-4f3d-9b28-0b2962c810e0,network=Network(166a938b-0779-4198-8905-ebda4e19e289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccc343e2-1b')
Nov 22 14:51:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:51:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] No VIF found with MAC fa:16:3e:1a:c0:b4, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:51:59 user nova-compute[74776]: DEBUG nova.network.neutron [req-5f7aae37-dfa9-4e20-ba5a-e102c1e14b34 req-822a80dc-242c-45df-822f-dbc3ae5a0c25 service nova] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Updated VIF entry in instance network info cache for port ccc343e2-1b4d-4f3d-9b28-0b2962c810e0. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:51:59 user nova-compute[74776]: DEBUG nova.network.neutron [req-5f7aae37-dfa9-4e20-ba5a-e102c1e14b34 req-822a80dc-242c-45df-822f-dbc3ae5a0c25 service nova] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Updating instance_info_cache with network_info: [{"id": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "address": "fa:16:3e:1a:c0:b4", "network": {"id": "166a938b-0779-4198-8905-ebda4e19e289", "bridge": "br-int", "label": "tempest-VolumesActionsTest-102064328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd222b98813445e0af4430563b942958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc343e2-1b", "ovs_interfaceid": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:51:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5f7aae37-dfa9-4e20-ba5a-e102c1e14b34 req-822a80dc-242c-45df-822f-dbc3ae5a0c25 service nova] Releasing lock "refresh_cache-ff941215-6e73-4ad4-9d7c-be7825029466" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-ca36902f-8b9b-44ab-be38-04e86556551f req-173abe05-4e8e-4515-a626-c2887ece940a service nova] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Received event network-vif-plugged-ccc343e2-1b4d-4f3d-9b28-0b2962c810e0 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ca36902f-8b9b-44ab-be38-04e86556551f req-173abe05-4e8e-4515-a626-c2887ece940a service nova] Acquiring lock "ff941215-6e73-4ad4-9d7c-be7825029466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ca36902f-8b9b-44ab-be38-04e86556551f req-173abe05-4e8e-4515-a626-c2887ece940a service nova] Lock "ff941215-6e73-4ad4-9d7c-be7825029466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ca36902f-8b9b-44ab-be38-04e86556551f req-173abe05-4e8e-4515-a626-c2887ece940a service nova] Lock "ff941215-6e73-4ad4-9d7c-be7825029466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-ca36902f-8b9b-44ab-be38-04e86556551f req-173abe05-4e8e-4515-a626-c2887ece940a service nova] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] No waiting events found dispatching network-vif-plugged-ccc343e2-1b4d-4f3d-9b28-0b2962c810e0 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:52:00 user nova-compute[74776]: WARNING nova.compute.manager [req-ca36902f-8b9b-44ab-be38-04e86556551f req-173abe05-4e8e-4515-a626-c2887ece940a service nova] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Received unexpected event network-vif-plugged-ccc343e2-1b4d-4f3d-9b28-0b2962c810e0 for instance with vm_state building and task_state spawning.
Nov 22 14:52:00 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Verify base images {{(pid=74776) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Image id ee204558-2a75-42f8-8c03-3c76a3916fa5 yields fingerprint 8b46a9b21731c19ccb10b60bac0ad927511c4e4e {{(pid=74776) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 22 14:52:00 user nova-compute[74776]: INFO nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] image ee204558-2a75-42f8-8c03-3c76a3916fa5 at (/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e): checking
Nov 22 14:52:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] image ee204558-2a75-42f8-8c03-3c76a3916fa5 at (/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e): image is in use {{(pid=74776) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74776) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] a7f827a9-787f-4826-9b73-34b68f8cb742 is a valid instance name {{(pid=74776) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] ff941215-6e73-4ad4-9d7c-be7825029466 is a valid instance name {{(pid=74776) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] ff941215-6e73-4ad4-9d7c-be7825029466 has a disk file {{(pid=74776) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance ff941215-6e73-4ad4-9d7c-be7825029466 is backed by 8b46a9b21731c19ccb10b60bac0ad927511c4e4e {{(pid=74776) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] a85f1006-d456-4d9d-aa2f-de57dc7c42f3 is a valid instance name {{(pid=74776) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] a85f1006-d456-4d9d-aa2f-de57dc7c42f3 has a disk file {{(pid=74776) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 22 14:52:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance a85f1006-d456-4d9d-aa2f-de57dc7c42f3 is backed by 8b46a9b21731c19ccb10b60bac0ad927511c4e4e {{(pid=74776) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 22 14:52:01 user nova-compute[74776]: WARNING nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Unknown base file: /opt/stack/data/nova/instances/_base/437069e1d141bdfd13852144404ad190984a60a2
Nov 22 14:52:01 user nova-compute[74776]: WARNING nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2b208d479aaa341ca0f705e8bcc8d48dc3c93e63
Nov 22 14:52:01 user nova-compute[74776]: WARNING nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cb30ed7a028babaaeecbb1e750ff7f75a0703f2f
Nov 22 14:52:01 user nova-compute[74776]: WARNING nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Unknown base file: /opt/stack/data/nova/instances/_base/56cc66d516c1aaa3b9d52915ea9a61514add9c7b
Nov 22 14:52:01 user nova-compute[74776]: WARNING nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Unknown base file: /opt/stack/data/nova/instances/_base/377f7131191ddcc203bf5fef71bb96fa43329a13
Nov 22 14:52:01 user nova-compute[74776]: WARNING nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d829168599e52d2f9f6d1f32c392c0aaa6461b35
Nov 22 14:52:01 user nova-compute[74776]: WARNING nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Unknown base file: /opt/stack/data/nova/instances/_base/eb78f9c50bb2fec08d30a802f663f276a46ef011
Nov 22 14:52:01 user nova-compute[74776]: WARNING nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Unknown base file: /opt/stack/data/nova/instances/_base/765f2d1acf409d7bb1ca2b154aaeec1f40881f9b
Nov 22 14:52:01 user nova-compute[74776]: WARNING nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9a72d9f8c3846268a25872639f1260083ee26210
Nov 22 14:52:01 user nova-compute[74776]: INFO nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Active base files: /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e
Nov 22 14:52:01 user nova-compute[74776]: INFO nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Removable base files: /opt/stack/data/nova/instances/_base/437069e1d141bdfd13852144404ad190984a60a2 /opt/stack/data/nova/instances/_base/2b208d479aaa341ca0f705e8bcc8d48dc3c93e63 /opt/stack/data/nova/instances/_base/cb30ed7a028babaaeecbb1e750ff7f75a0703f2f /opt/stack/data/nova/instances/_base/56cc66d516c1aaa3b9d52915ea9a61514add9c7b /opt/stack/data/nova/instances/_base/377f7131191ddcc203bf5fef71bb96fa43329a13 /opt/stack/data/nova/instances/_base/d829168599e52d2f9f6d1f32c392c0aaa6461b35 /opt/stack/data/nova/instances/_base/eb78f9c50bb2fec08d30a802f663f276a46ef011 /opt/stack/data/nova/instances/_base/765f2d1acf409d7bb1ca2b154aaeec1f40881f9b /opt/stack/data/nova/instances/_base/9a72d9f8c3846268a25872639f1260083ee26210
Nov 22 14:52:01 user nova-compute[74776]: INFO nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/437069e1d141bdfd13852144404ad190984a60a2
Nov 22 14:52:01 user nova-compute[74776]: INFO nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2b208d479aaa341ca0f705e8bcc8d48dc3c93e63
Nov 22 14:52:01 user nova-compute[74776]: INFO nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cb30ed7a028babaaeecbb1e750ff7f75a0703f2f
Nov 22 14:52:01 user nova-compute[74776]: INFO nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/56cc66d516c1aaa3b9d52915ea9a61514add9c7b
Nov 22 14:52:01 user nova-compute[74776]: INFO nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/377f7131191ddcc203bf5fef71bb96fa43329a13
Nov 22 14:52:01 user nova-compute[74776]: INFO nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d829168599e52d2f9f6d1f32c392c0aaa6461b35
Nov 22 14:52:01 user nova-compute[74776]: INFO nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/eb78f9c50bb2fec08d30a802f663f276a46ef011
Nov 22 14:52:01 user nova-compute[74776]: INFO nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/765f2d1acf409d7bb1ca2b154aaeec1f40881f9b
Nov 22 14:52:01 user nova-compute[74776]: INFO nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9a72d9f8c3846268a25872639f1260083ee26210
Nov 22 14:52:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Verification complete {{(pid=74776) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 22 14:52:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Verify swap images {{(pid=74776) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 22 14:52:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.imagecache [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Verify ephemeral images {{(pid=74776) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 22 14:52:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-b5a38bb4-8706-4b41-92fb-f8063142f89e req-27557895-a062-4985-a18c-9a50f7b0b93e service nova] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Received event network-vif-plugged-ccc343e2-1b4d-4f3d-9b28-0b2962c810e0 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:52:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b5a38bb4-8706-4b41-92fb-f8063142f89e req-27557895-a062-4985-a18c-9a50f7b0b93e service nova] Acquiring lock "ff941215-6e73-4ad4-9d7c-be7825029466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:52:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b5a38bb4-8706-4b41-92fb-f8063142f89e req-27557895-a062-4985-a18c-9a50f7b0b93e service nova] Lock "ff941215-6e73-4ad4-9d7c-be7825029466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:52:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-b5a38bb4-8706-4b41-92fb-f8063142f89e req-27557895-a062-4985-a18c-9a50f7b0b93e service nova] Lock "ff941215-6e73-4ad4-9d7c-be7825029466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-b5a38bb4-8706-4b41-92fb-f8063142f89e req-27557895-a062-4985-a18c-9a50f7b0b93e service nova] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] No waiting events found dispatching network-vif-plugged-ccc343e2-1b4d-4f3d-9b28-0b2962c810e0 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:52:02 user nova-compute[74776]: WARNING nova.compute.manager [req-b5a38bb4-8706-4b41-92fb-f8063142f89e req-27557895-a062-4985-a18c-9a50f7b0b93e service nova] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Received unexpected event network-vif-plugged-ccc343e2-1b4d-4f3d-9b28-0b2962c810e0 for instance with vm_state building and task_state spawning.
Nov 22 14:52:02 user nova-compute[74776]: DEBUG nova.compute.manager [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:52:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:52:02 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Instance spawned successfully.
Nov 22 14:52:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:52:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:52:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:52:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:52:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:52:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:52:02 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:52:02 user nova-compute[74776]: INFO nova.compute.manager [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 22 14:52:02 user nova-compute[74776]: DEBUG nova.compute.manager [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:52:02 user nova-compute[74776]: INFO nova.compute.manager [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Took 5.85 seconds to build instance.
Nov 22 14:52:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-de1f82e2-2ddc-46ea-a51c-7edb1f5728b4 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "ff941215-6e73-4ad4-9d7c-be7825029466" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.945s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:15 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a85f1006-d456-4d9d-aa2f-de57dc7c42f3 is timed out.
Nov 22 14:52:15 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Successfully detached device vdb from instance a85f1006-d456-4d9d-aa2f-de57dc7c42f3 from the live domain config.
Nov 22 14:52:15 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qyGeMcOx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:52:15 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:52:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f0940f-369d-4d01-9c04-8ad97ea7ccc9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:52:15 user nova-compute[74776]: No targets found.
Nov 22 14:52:15 user nova-compute[74776]: iSNS:
Nov 22 14:52:15 user nova-compute[74776]: No targets found.
Nov 22 14:52:15 user nova-compute[74776]: STATIC:
Nov 22 14:52:15 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb
Nov 22 14:52:15 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:52:15 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:52:15 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1
Nov 22 14:52:15 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:52:15 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:52:15 user nova-compute[74776]: FIRMWARE:
Nov 22 14:52:15 user nova-compute[74776]: No targets found.
Nov 22 14:52:15 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:52:15 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:52:15 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31c6510-a5c6-4c4f-98fd-5d0b620ab1b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b658e615-8c75-4851-8180-53c8f9e2e589]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 (non-flash)
Nov 22 14:52:15 user nova-compute[74776]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb (non-flash)
Nov 22 14:52:15 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 (non-flash)
Nov 22 14:52:15 user nova-compute[74776]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb (non-flash)
Nov 22 14:52:15 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c58610160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1'): ({'sdb'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Removing single pathed devices sdb {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b24349b-97ac-4358-be71-cbfab823d7e6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8051cb41-c7f8-47be-847e-2fe563a6eca0]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Flushing IO for device /dev/sdb {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ac7081-4d10-4ba8-a407-183cced6b3a5]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.065s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5397b5-d416-4535-a98a-72bb08ca7b59]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[23250e39-af30-40dc-8503-f17b18d11f76]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb94f62-4e60-45d0-9350-8f11e474bd6c]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1, portal: 172.16.0.220,3260]
Nov 22 14:52:15 user nova-compute[74776]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1, portal: 172.16.0.220,3260] successful.
Nov 22 14:52:15 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20647021-eea1-4f1f-99e4-2810be567de1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c29dc95-6f58-42e8-a7f8-f28789454938]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.452s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] <== disconnect_volume: return (453ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:52:15 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:52:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:16 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lazy-loading 'flavor' on Instance uuid a85f1006-d456-4d9d-aa2f-de57dc7c42f3 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:52:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d5a38b4e-ca7c-4880-9b1e-d4dce5fb7bf4 tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.881s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "a7f827a9-787f-4826-9b73-34b68f8cb742" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:52:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:52:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:52:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:52:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:29 user nova-compute[74776]: INFO nova.compute.manager [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Terminating instance
Nov 22 14:52:29 user nova-compute[74776]: DEBUG nova.compute.manager [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:52:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG nova.compute.manager [req-c970f92b-8508-4a4b-b266-15b3eb6b5fd5 req-2571c931-0038-4be7-866d-7881b296ad28 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Received event network-vif-unplugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c970f92b-8508-4a4b-b266-15b3eb6b5fd5 req-2571c931-0038-4be7-866d-7881b296ad28 service nova] Acquiring lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c970f92b-8508-4a4b-b266-15b3eb6b5fd5 req-2571c931-0038-4be7-866d-7881b296ad28 service nova] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-c970f92b-8508-4a4b-b266-15b3eb6b5fd5 req-2571c931-0038-4be7-866d-7881b296ad28 service nova] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG nova.compute.manager [req-c970f92b-8508-4a4b-b266-15b3eb6b5fd5 req-2571c931-0038-4be7-866d-7881b296ad28 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] No waiting events found dispatching network-vif-unplugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG nova.compute.manager [req-c970f92b-8508-4a4b-b266-15b3eb6b5fd5 req-2571c931-0038-4be7-866d-7881b296ad28 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Received event network-vif-unplugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:30 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Instance destroyed successfully.
Nov 22 14:52:30 user nova-compute[74776]: DEBUG nova.objects.instance [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lazy-loading 'resources' on Instance uuid a7f827a9-787f-4826-9b73-34b68f8cb742 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1327794556',display_name='tempest-TestVolumeBootPattern-server-1327794556',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1327794556',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:50:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f6764076f2a428ea35c11476a3e7231',ramdisk_id='',reservation_id='r-4drb4yr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1931721751',owner_user_name='tempest-TestVolumeBootPattern-1931721751-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:50:56Z,user_data=None,user_id='d5cce524a8c6419aa76fb4b02861377e',uuid=a7f827a9-787f-4826-9b73-34b68f8cb742,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2b29902-a6a9-4da1-825b-9706fdbad3b3", "address": "fa:16:3e:df:fe:09", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b29902-a6", "ovs_interfaceid": "e2b29902-a6a9-4da1-825b-9706fdbad3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converting VIF {"id": "e2b29902-a6a9-4da1-825b-9706fdbad3b3", "address": "fa:16:3e:df:fe:09", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b29902-a6", "ovs_interfaceid": "e2b29902-a6a9-4da1-825b-9706fdbad3b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:fe:09,bridge_name='br-int',has_traffic_filtering=True,id=e2b29902-a6a9-4da1-825b-9706fdbad3b3,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b29902-a6') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG os_vif [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:fe:09,bridge_name='br-int',has_traffic_filtering=True,id=e2b29902-a6a9-4da1-825b-9706fdbad3b3,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b29902-a6') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2b29902-a6, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2cab04d-5abc-4fcd-931a-89ee32819463) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:52:30 user nova-compute[74776]: INFO os_vif [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:fe:09,bridge_name='br-int',has_traffic_filtering=True,id=e2b29902-a6a9-4da1-825b-9706fdbad3b3,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b29902-a6')
Nov 22 14:52:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMmVjLFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:52:30 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:52:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed9e209-3fd6-4a99-a0e7-6de53619bd37]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:52:30 user nova-compute[74776]: No targets found.
Nov 22 14:52:30 user nova-compute[74776]: iSNS:
Nov 22 14:52:30 user nova-compute[74776]: No targets found.
Nov 22 14:52:30 user nova-compute[74776]: STATIC:
Nov 22 14:52:30 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb
Nov 22 14:52:30 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:52:30 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:52:30 user nova-compute[74776]: FIRMWARE:
Nov 22 14:52:30 user nova-compute[74776]: No targets found.
Nov 22 14:52:30 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:52:30 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:52:30 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[027b3945-6dcf-4e9b-aa04-db4838303041]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe728f0-0ca6-446e-9570-2fe7df643b34]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb (non-flash)
Nov 22 14:52:30 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb (non-flash)
Nov 22 14:52:30 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c58252e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb'): ({'sdc'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Removing single pathed devices sdc {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40a4fde-afd5-4257-b92f-e8ed4e8f40c4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d318561-a8f4-4ce6-a206-ffe30d14311d]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Flushing IO for device /dev/sdc {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd57eac5-646a-4f66-b2b6-f0f1ecfed923]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[919995e1-dfaa-4f60-b42d-ecbb6d06d4fd]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_7655ecaa', '/dev/disk/by-id/scsi-1SCST_BIO7655ecaa-ef49b71b5937e317', '/dev/disk/by-id/scsi-26566343962373162') {{(pid=85789) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7152967-ee69-4e33-a7b7-cf3738eed851]: (4, None) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7093c1-50cb-42c5-b031-8b1dffd94bce]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:52:30 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:31 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[529d550f-d0cc-4478-a1e7-1d9f60302749]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:52:31 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb, portal: 172.16.0.220,3260]
Nov 22 14:52:31 user nova-compute[74776]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb, portal: 172.16.0.220,3260] successful.
Nov 22 14:52:31 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:52:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:31 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:31 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[423207b1-2648-4576-99ed-d4bf2ca3a14c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:52:31 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:52:31 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:52:31 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] <== disconnect_volume: return (334ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:52:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:52:31 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Deleting instance files /opt/stack/data/nova/instances/a7f827a9-787f-4826-9b73-34b68f8cb742_del
Nov 22 14:52:31 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Deletion of /opt/stack/data/nova/instances/a7f827a9-787f-4826-9b73-34b68f8cb742_del complete
Nov 22 14:52:31 user nova-compute[74776]: INFO nova.compute.manager [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 22 14:52:31 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:52:31 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:52:31 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:52:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:31 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:52:31 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Took 0.42 seconds to deallocate network for instance.
Nov 22 14:52:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-ca8b8fc5-c00c-4dd6-b51c-798e7ab9d726 req-276774cb-6ad7-452f-b553-998c9034d0e6 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Received event network-vif-deleted-e2b29902-a6a9-4da1-825b-9706fdbad3b3 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:52:31 user nova-compute[74776]: INFO nova.compute.manager [req-ca8b8fc5-c00c-4dd6-b51c-798e7ab9d726 req-276774cb-6ad7-452f-b553-998c9034d0e6 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Neutron deleted interface e2b29902-a6a9-4da1-825b-9706fdbad3b3; detaching it from the instance and deleting it from the info cache
Nov 22 14:52:31 user nova-compute[74776]: DEBUG nova.network.neutron [req-ca8b8fc5-c00c-4dd6-b51c-798e7ab9d726 req-276774cb-6ad7-452f-b553-998c9034d0e6 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:52:31 user nova-compute[74776]: DEBUG nova.compute.manager [req-ca8b8fc5-c00c-4dd6-b51c-798e7ab9d726 req-276774cb-6ad7-452f-b553-998c9034d0e6 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Detach interface failed, port_id=e2b29902-a6a9-4da1-825b-9706fdbad3b3, reason: Instance a7f827a9-787f-4826-9b73-34b68f8cb742 could not be found. {{(pid=74776) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG nova.compute.manager [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Received event network-vif-plugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] Acquiring lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG nova.compute.manager [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] No waiting events found dispatching network-vif-plugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:52:32 user nova-compute[74776]: WARNING nova.compute.manager [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Received unexpected event network-vif-plugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 for instance with vm_state active and task_state deleting.
Nov 22 14:52:32 user nova-compute[74776]: DEBUG nova.compute.manager [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Received event network-vif-plugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] Acquiring lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG nova.compute.manager [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] No waiting events found dispatching network-vif-plugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:52:32 user nova-compute[74776]: WARNING nova.compute.manager [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Received unexpected event network-vif-plugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 for instance with vm_state active and task_state deleting.
Nov 22 14:52:32 user nova-compute[74776]: DEBUG nova.compute.manager [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Received event network-vif-plugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] Acquiring lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG nova.compute.manager [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] No waiting events found dispatching network-vif-plugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:52:32 user nova-compute[74776]: WARNING nova.compute.manager [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Received unexpected event network-vif-plugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 for instance with vm_state active and task_state deleting.
Nov 22 14:52:32 user nova-compute[74776]: DEBUG nova.compute.manager [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Received event network-vif-unplugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] Acquiring lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG nova.compute.manager [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] No waiting events found dispatching network-vif-unplugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG nova.compute.manager [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Received event network-vif-unplugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG nova.compute.manager [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Received event network-vif-plugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] Acquiring lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG nova.compute.manager [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] No waiting events found dispatching network-vif-plugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:52:32 user nova-compute[74776]: WARNING nova.compute.manager [req-28116573-51d5-4267-8fd8-38bebd13e105 req-fdac4636-af79-49da-b88f-0a3003ecb3c2 service nova] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Received unexpected event network-vif-plugged-e2b29902-a6a9-4da1-825b-9706fdbad3b3 for instance with vm_state active and task_state deleting.
Nov 22 14:52:32 user nova-compute[74776]: INFO nova.compute.manager [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Took 0.72 seconds to detach 1 volumes for instance.
Nov 22 14:52:32 user nova-compute[74776]: DEBUG nova.compute.manager [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: a7f827a9-787f-4826-9b73-34b68f8cb742] Deleting volume: a3be2bb2-4c44-49e9-bdba-70ecd15dc6fb {{(pid=74776) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:52:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:32 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Deleted allocations for instance a7f827a9-787f-4826-9b73-34b68f8cb742
Nov 22 14:52:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-66fe82bc-bf1d-47be-9d3b-343eb86081a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "a7f827a9-787f-4826-9b73-34b68f8cb742" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.825s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:34 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:52:34 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:52:34 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Didn't find any instances for network info cache update. {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 14:52:35 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:52:35 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:52:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:52:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:52:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:35 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:52:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:52:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:52:36 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:52:36 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:52:36 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8711MB free_disk=25.050827026367188GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:52:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:52:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:52:36 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance a85f1006-d456-4d9d-aa2f-de57dc7c42f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:52:36 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance ff941215-6e73-4ad4-9d7c-be7825029466 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:52:36 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:52:36 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:52:37 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing inventories for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 14:52:37 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating ProviderTree inventory for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 14:52:37 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating inventory in ProviderTree for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 14:52:37 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing aggregate associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, aggregates: None {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 14:52:37 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing trait associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 14:52:37 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:52:37 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:52:37 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:52:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.343s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:39 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:52:39 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:52:39 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:52:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:42 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:52:43 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:52:43 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:52:44 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquiring lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquiring lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:45 user nova-compute[74776]: INFO nova.compute.manager [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Terminating instance
Nov 22 14:52:45 user nova-compute[74776]: DEBUG nova.compute.manager [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG nova.compute.manager [req-8096eeb2-a249-46f8-85a3-abf25e6c79a2 req-d9e62ba7-b08b-445d-b23a-be0840534fc0 service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Received event network-vif-unplugged-e337e003-094f-4871-862a-1a1ffc4414f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8096eeb2-a249-46f8-85a3-abf25e6c79a2 req-d9e62ba7-b08b-445d-b23a-be0840534fc0 service nova] Acquiring lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8096eeb2-a249-46f8-85a3-abf25e6c79a2 req-d9e62ba7-b08b-445d-b23a-be0840534fc0 service nova] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8096eeb2-a249-46f8-85a3-abf25e6c79a2 req-d9e62ba7-b08b-445d-b23a-be0840534fc0 service nova] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG nova.compute.manager [req-8096eeb2-a249-46f8-85a3-abf25e6c79a2 req-d9e62ba7-b08b-445d-b23a-be0840534fc0 service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] No waiting events found dispatching network-vif-unplugged-e337e003-094f-4871-862a-1a1ffc4414f2 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG nova.compute.manager [req-8096eeb2-a249-46f8-85a3-abf25e6c79a2 req-d9e62ba7-b08b-445d-b23a-be0840534fc0 service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Received event network-vif-unplugged-e337e003-094f-4871-862a-1a1ffc4414f2 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:45 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Instance destroyed successfully.
Nov 22 14:52:45 user nova-compute[74776]: DEBUG nova.objects.instance [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lazy-loading 'resources' on Instance uuid a85f1006-d456-4d9d-aa2f-de57dc7c42f3 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:48:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1962000405',display_name='tempest-TestServerVolumeAttachmentScenario-server-1962000405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1962000405',id=43,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBID6HP9+Q1C0/6NMIv3+R95pYi287JO2vr9/bNp0fjNmWVL4Joe7U9nEVKKAN0NaIxcO7ik8Q7dk+spqqKVelvr8plsTr2Pwvc9KwBLOQPBBss6hihdmFsBz6cxww/F/Gg==',key_name='tempest-keypair-1431043020',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:48:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bcd43e8bdb8d4525a32d7f1216856b38',ramdisk_id='',reservation_id='r-l4y2xg20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-700338326',owner_user_name='tempest-TestServerVolumeAttachmentScenario-700338326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:48:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f90520f80b3442c5b1be4ea77adb866e',uuid=a85f1006-d456-4d9d-aa2f-de57dc7c42f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e337e003-094f-4871-862a-1a1ffc4414f2", "address": "fa:16:3e:ea:e5:e3", "network": {"id": "8c42bd23-eb1f-408f-b07b-2ac01b738ca0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2136861231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd43e8bdb8d4525a32d7f1216856b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape337e003-09", "ovs_interfaceid": "e337e003-094f-4871-862a-1a1ffc4414f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Converting VIF {"id": "e337e003-094f-4871-862a-1a1ffc4414f2", "address": "fa:16:3e:ea:e5:e3", "network": {"id": "8c42bd23-eb1f-408f-b07b-2ac01b738ca0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2136861231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd43e8bdb8d4525a32d7f1216856b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape337e003-09", "ovs_interfaceid": "e337e003-094f-4871-862a-1a1ffc4414f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:e5:e3,bridge_name='br-int',has_traffic_filtering=True,id=e337e003-094f-4871-862a-1a1ffc4414f2,network=Network(8c42bd23-eb1f-408f-b07b-2ac01b738ca0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape337e003-09') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG os_vif [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:e5:e3,bridge_name='br-int',has_traffic_filtering=True,id=e337e003-094f-4871-862a-1a1ffc4414f2,network=Network(8c42bd23-eb1f-408f-b07b-2ac01b738ca0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape337e003-09') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape337e003-09, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca622e10-206f-49d1-b980-f7f7ccb11760) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:45 user nova-compute[74776]: INFO os_vif [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:e5:e3,bridge_name='br-int',has_traffic_filtering=True,id=e337e003-094f-4871-862a-1a1ffc4414f2,network=Network(8c42bd23-eb1f-408f-b07b-2ac01b738ca0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape337e003-09')
Nov 22 14:52:45 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Deleting instance files /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3_del
Nov 22 14:52:45 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Deletion of /opt/stack/data/nova/instances/a85f1006-d456-4d9d-aa2f-de57dc7c42f3_del complete
Nov 22 14:52:45 user nova-compute[74776]: INFO nova.compute.manager [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 22 14:52:45 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:52:45 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:52:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:46 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:52:47 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Took 1.08 seconds to deallocate network for instance.
Nov 22 14:52:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:52:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:52:47 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:52:47 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:52:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:47 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Deleted allocations for instance a85f1006-d456-4d9d-aa2f-de57dc7c42f3
Nov 22 14:52:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bef8d56a-fef5-41bb-abda-63f8ebbcd52d tempest-TestServerVolumeAttachmentScenario-700338326 tempest-TestServerVolumeAttachmentScenario-700338326-project-member] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.242s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:47 user nova-compute[74776]: DEBUG nova.compute.manager [req-5f71c351-52a5-4a7f-a87b-96498e397ecf req-2883c738-4035-4fee-a97b-5df04f7e3718 service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Received event network-vif-plugged-e337e003-094f-4871-862a-1a1ffc4414f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:52:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5f71c351-52a5-4a7f-a87b-96498e397ecf req-2883c738-4035-4fee-a97b-5df04f7e3718 service nova] Acquiring lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:52:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5f71c351-52a5-4a7f-a87b-96498e397ecf req-2883c738-4035-4fee-a97b-5df04f7e3718 service nova] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:52:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5f71c351-52a5-4a7f-a87b-96498e397ecf req-2883c738-4035-4fee-a97b-5df04f7e3718 service nova] Lock "a85f1006-d456-4d9d-aa2f-de57dc7c42f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:52:47 user nova-compute[74776]: DEBUG nova.compute.manager [req-5f71c351-52a5-4a7f-a87b-96498e397ecf req-2883c738-4035-4fee-a97b-5df04f7e3718 service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] No waiting events found dispatching network-vif-plugged-e337e003-094f-4871-862a-1a1ffc4414f2 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:52:47 user nova-compute[74776]: WARNING nova.compute.manager [req-5f71c351-52a5-4a7f-a87b-96498e397ecf req-2883c738-4035-4fee-a97b-5df04f7e3718 service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Received unexpected event network-vif-plugged-e337e003-094f-4871-862a-1a1ffc4414f2 for instance with vm_state deleted and task_state None.
Nov 22 14:52:47 user nova-compute[74776]: DEBUG nova.compute.manager [req-5f71c351-52a5-4a7f-a87b-96498e397ecf req-2883c738-4035-4fee-a97b-5df04f7e3718 service nova] [instance: a85f1006-d456-4d9d-aa2f-de57dc7c42f3] Received event network-vif-deleted-e337e003-094f-4871-862a-1a1ffc4414f2 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:52:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:52:51 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:52:53 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:52:53 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 14:52:53 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] There are 0 instances to clean {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 14:52:53 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:52:53 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74776) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 14:52:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:53:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:53:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:53:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:53:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:53:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:53:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:53:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:33 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:53:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:53:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 14:53:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-ff941215-6e73-4ad4-9d7c-be7825029466" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:53:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-ff941215-6e73-4ad4-9d7c-be7825029466" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:53:33 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:53:33 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid ff941215-6e73-4ad4-9d7c-be7825029466 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Updating instance_info_cache with network_info: [{"id": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "address": "fa:16:3e:1a:c0:b4", "network": {"id": "166a938b-0779-4198-8905-ebda4e19e289", "bridge": "br-int", "label": "tempest-VolumesActionsTest-102064328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd222b98813445e0af4430563b942958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc343e2-1b", "ovs_interfaceid": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-ff941215-6e73-4ad4-9d7c-be7825029466" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "7df01019-c4b3-4626-8e05-a834f44e3019" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "7df01019-c4b3-4626-8e05-a834f44e3019" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:53:34 user nova-compute[74776]: INFO nova.compute.claims [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Claim successful on node user
Nov 22 14:53:34 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG nova.network.neutron [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:53:34 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:53:34 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG nova.policy [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5cce524a8c6419aa76fb4b02861377e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6764076f2a428ea35c11476a3e7231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:53:34 user nova-compute[74776]: INFO nova.virt.block_device [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Booting with volume 7167c37d-e079-4bfb-ad99-75b2fa325db0 at /dev/vda
Nov 22 14:53:34 user nova-compute[74776]: DEBUG os_brick.utils [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2a4130-c9f7-4703-90b8-9ea89a38bcfb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e170addd-c4b8-4d05-b598-2f61a2af08ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0b9a4f-d54b-405e-9508-fa91e0985366]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb9833d-d853-4722-8e4b-5a4551453e67]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:53:34 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:53:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:53:35 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:53:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:53:35 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:53:35 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:53:35 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[160142c0-8444-4dab-80c7-3dbdfa92f371]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:53:35 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:53:35 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:53:35 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:53:35 user nova-compute[74776]: DEBUG os_brick.utils [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:53:35 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Updating existing volume attachment record: 90d8dfdd-5ba1-4740-a25d-287d4ca22f08 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:53:35 user nova-compute[74776]: DEBUG nova.network.neutron [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Successfully created port: d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:53:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:36 user nova-compute[74776]: DEBUG nova.network.neutron [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Successfully updated port: d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:53:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "refresh_cache-7df01019-c4b3-4626-8e05-a834f44e3019" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:53:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquired lock "refresh_cache-7df01019-c4b3-4626-8e05-a834f44e3019" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:53:36 user nova-compute[74776]: DEBUG nova.network.neutron [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:53:36 user nova-compute[74776]: DEBUG nova.network.neutron [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:53:36 user nova-compute[74776]: DEBUG nova.compute.manager [req-ce940abb-1af1-4c88-8e79-8e4747bc8bc6 req-0f955baa-cb28-46a5-9f15-0d0bd608e178 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Received event network-changed-d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:53:36 user nova-compute[74776]: DEBUG nova.compute.manager [req-ce940abb-1af1-4c88-8e79-8e4747bc8bc6 req-0f955baa-cb28-46a5-9f15-0d0bd608e178 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Refreshing instance network info cache due to event network-changed-d50b55bf-450e-4227-9165-a36343344d6e. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:53:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ce940abb-1af1-4c88-8e79-8e4747bc8bc6 req-0f955baa-cb28-46a5-9f15-0d0bd608e178 service nova] Acquiring lock "refresh_cache-7df01019-c4b3-4626-8e05-a834f44e3019" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:53:36 user nova-compute[74776]: DEBUG nova.network.neutron [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Updating instance_info_cache with network_info: [{"id": "d50b55bf-450e-4227-9165-a36343344d6e", "address": "fa:16:3e:49:10:11", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd50b55bf-45", "ovs_interfaceid": "d50b55bf-450e-4227-9165-a36343344d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:53:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Releasing lock "refresh_cache-7df01019-c4b3-4626-8e05-a834f44e3019" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:53:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Instance network_info: |[{"id": "d50b55bf-450e-4227-9165-a36343344d6e", "address": "fa:16:3e:49:10:11", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd50b55bf-45", "ovs_interfaceid": "d50b55bf-450e-4227-9165-a36343344d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:53:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ce940abb-1af1-4c88-8e79-8e4747bc8bc6 req-0f955baa-cb28-46a5-9f15-0d0bd608e178 service nova] Acquired lock "refresh_cache-7df01019-c4b3-4626-8e05-a834f44e3019" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:53:36 user nova-compute[74776]: DEBUG nova.network.neutron [req-ce940abb-1af1-4c88-8e79-8e4747bc8bc6 req-0f955baa-cb28-46a5-9f15-0d0bd608e178 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Refreshing network info cache for port d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:53:36 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:53:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:53:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:53:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:53:36 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:53:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:53:36 user nova-compute[74776]: DEBUG nova.network.neutron [req-ce940abb-1af1-4c88-8e79-8e4747bc8bc6 req-0f955baa-cb28-46a5-9f15-0d0bd608e178 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Updated VIF entry in instance network info cache for port d50b55bf-450e-4227-9165-a36343344d6e. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:53:36 user nova-compute[74776]: DEBUG nova.network.neutron [req-ce940abb-1af1-4c88-8e79-8e4747bc8bc6 req-0f955baa-cb28-46a5-9f15-0d0bd608e178 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Updating instance_info_cache with network_info: [{"id": "d50b55bf-450e-4227-9165-a36343344d6e", "address": "fa:16:3e:49:10:11", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd50b55bf-45", "ovs_interfaceid": "d50b55bf-450e-4227-9165-a36343344d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:53:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ce940abb-1af1-4c88-8e79-8e4747bc8bc6 req-0f955baa-cb28-46a5-9f15-0d0bd608e178 service nova] Releasing lock "refresh_cache-7df01019-c4b3-4626-8e05-a834f44e3019" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:53:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:53:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:53:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:53:37 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:53:37 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:53:37 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8877MB free_disk=25.077186584472656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:53:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:53:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:53:37 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance ff941215-6e73-4ad4-9d7c-be7825029466 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:53:37 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 7df01019-c4b3-4626-8e05-a834f44e3019 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:53:37 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:53:37 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:53:37 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:53:37 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:53:37 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:53:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:53:38 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:53:38 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:53:38 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:53:39 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:53:40 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Creating image(s)
Nov 22 14:53:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Did not create local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Ensure instance console log exists: /opt/stack/data/nova/instances/7df01019-c4b3-4626-8e05-a834f44e3019/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Start _get_guest_xml network_info=[{"id": "d50b55bf-450e-4227-9165-a36343344d6e", "address": "fa:16:3e:49:10:11", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd50b55bf-45", "ovs_interfaceid": "d50b55bf-450e-4227-9165-a36343344d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '90d8dfdd-5ba1-4740-a25d-287d4ca22f08', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUqFifoA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7df01019-c4b3-4626-8e05-a834f44e3019', 'attached_at': '', 'detached_at': '', 'volume_id': '7167c37d-e079-4bfb-ad99-75b2fa325db0', 'serial': '7167c37d-e079-4bfb-ad99-75b2fa325db0'}, 'boot_index': 0, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:53:40 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:53:40 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:53:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:53:40 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUqFifoA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:53:41 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:53:41 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:53:41 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2507d78c-471f-4a5f-a85b-7b4119ffc7d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:53:41 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b4941e-4124-436f-a572-d34afe2c010e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0] added
Nov 22 14:53:41 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[768f34b7-618a-440d-a74c-e45c49a1df7b]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa63c4e8-c586-4133-bd39-03f531799d62]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JUqFifoA {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JUqFifoA" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7bbfca-80fc-494b-a2e3-4f67c38b53f1]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JUqFifoA'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6353aa7b-4557-4ce4-a7ba-80a1de17bf05]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cc7340-a8b3-41b9-8760-188de204219f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 14:53:41 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 14:53:41 user nova-compute[74776]:  {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:53:41 user nova-compute[74776]: WARNING os_brick.initiator.connectors.iscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 14:53:41 user nova-compute[74776]: 
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[55377b18-9966-4dab-945f-ce08153f4879]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0, portal: 172.16.0.220,3260]
Nov 22 14:53:41 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0, portal: 172.16.0.220,3260] successful.
Nov 22 14:53:41 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[653856e4-ec0b-429f-b7a9-623d1adce2b9]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4f8afe-7982-413f-8cf1-2af58352e426]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 (non-flash)
Nov 22 14:53:41 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 (non-flash)
Nov 22 14:53:41 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a07e1e6-8ece-400d-9831-0df480db56a4]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:53:41 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUqFifoA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23363346331613330', 'path': '/dev/sdb'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363346331613330', 'path': '/dev/sdb'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:53:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1394158077',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1394158077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1394158077',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcm+UsaoZV6p/DwCWkXsAqfarU4nJg8ih4S0tmURCf0k4i0LBVJhtnpc2QVtr57+BzMCCfzs26NoNrr+wWosQN0nSj4pqLp1lUC4ehZ+qH0daFhijJzhORavEp8xPqANg==',key_name='tempest-keypair-1185117298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f6764076f2a428ea35c11476a3e7231',ramdisk_id='',reservation_id='r-g1afd8fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1931721751',owner_user_name='tempest-TestVolumeBootPattern-1931721751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:53:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5cce524a8c6419aa76fb4b02861377e',uuid=7df01019-c4b3-4626-8e05-a834f44e3019,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d50b55bf-450e-4227-9165-a36343344d6e", "address": "fa:16:3e:49:10:11", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd50b55bf-45", "ovs_interfaceid": "d50b55bf-450e-4227-9165-a36343344d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converting VIF {"id": "d50b55bf-450e-4227-9165-a36343344d6e", "address": "fa:16:3e:49:10:11", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd50b55bf-45", "ovs_interfaceid": "d50b55bf-450e-4227-9165-a36343344d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:10:11,bridge_name='br-int',has_traffic_filtering=True,id=d50b55bf-450e-4227-9165-a36343344d6e,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd50b55bf-45') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lazy-loading 'pci_devices' on Instance uuid 7df01019-c4b3-4626-8e05-a834f44e3019 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:53:42 user nova-compute[74776]:   <uuid>7df01019-c4b3-4626-8e05-a834f44e3019</uuid>
Nov 22 14:53:42 user nova-compute[74776]:   <name>instance-0000002e</name>
Nov 22 14:53:42 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:53:42 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:53:42 user nova-compute[74776]:   <metadata>
Nov 22 14:53:42 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:53:42 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:53:42 user nova-compute[74776]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1394158077</nova:name>
Nov 22 14:53:42 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:53:40</nova:creationTime>
Nov 22 14:53:42 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:53:42 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:53:42 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:53:42 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:53:42 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:53:42 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:53:42 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:53:42 user nova-compute[74776]:       <nova:owner>
Nov 22 14:53:42 user nova-compute[74776]:         <nova:user uuid="d5cce524a8c6419aa76fb4b02861377e">tempest-TestVolumeBootPattern-1931721751-project-member</nova:user>
Nov 22 14:53:42 user nova-compute[74776]:         <nova:project uuid="2f6764076f2a428ea35c11476a3e7231">tempest-TestVolumeBootPattern-1931721751</nova:project>
Nov 22 14:53:42 user nova-compute[74776]:       </nova:owner>
Nov 22 14:53:42 user nova-compute[74776]:       <nova:ports>
Nov 22 14:53:42 user nova-compute[74776]:         <nova:port uuid="d50b55bf-450e-4227-9165-a36343344d6e">
Nov 22 14:53:42 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 22 14:53:42 user nova-compute[74776]:         </nova:port>
Nov 22 14:53:42 user nova-compute[74776]:       </nova:ports>
Nov 22 14:53:42 user nova-compute[74776]:     </nova:instance>
Nov 22 14:53:42 user nova-compute[74776]:   </metadata>
Nov 22 14:53:42 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:53:42 user nova-compute[74776]:     <system>
Nov 22 14:53:42 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:53:42 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:53:42 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:53:42 user nova-compute[74776]:       <entry name="serial">7df01019-c4b3-4626-8e05-a834f44e3019</entry>
Nov 22 14:53:42 user nova-compute[74776]:       <entry name="uuid">7df01019-c4b3-4626-8e05-a834f44e3019</entry>
Nov 22 14:53:42 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:53:42 user nova-compute[74776]:     </system>
Nov 22 14:53:42 user nova-compute[74776]:   </sysinfo>
Nov 22 14:53:42 user nova-compute[74776]:   <os>
Nov 22 14:53:42 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:53:42 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:53:42 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:53:42 user nova-compute[74776]:   </os>
Nov 22 14:53:42 user nova-compute[74776]:   <features>
Nov 22 14:53:42 user nova-compute[74776]:     <acpi/>
Nov 22 14:53:42 user nova-compute[74776]:     <apic/>
Nov 22 14:53:42 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:53:42 user nova-compute[74776]:   </features>
Nov 22 14:53:42 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:53:42 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:53:42 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:53:42 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:53:42 user nova-compute[74776]:   </clock>
Nov 22 14:53:42 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:53:42 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:53:42 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:53:42 user nova-compute[74776]:   </cpu>
Nov 22 14:53:42 user nova-compute[74776]:   <devices>
Nov 22 14:53:42 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:53:42 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:53:42 user nova-compute[74776]:       <source dev="/dev/sdb"/>
Nov 22 14:53:42 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:53:42 user nova-compute[74776]:       <serial>7167c37d-e079-4bfb-ad99-75b2fa325db0</serial>
Nov 22 14:53:42 user nova-compute[74776]:     </disk>
Nov 22 14:53:42 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:53:42 user nova-compute[74776]:       <mac address="fa:16:3e:49:10:11"/>
Nov 22 14:53:42 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:53:42 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:53:42 user nova-compute[74776]:       <target dev="tapd50b55bf-45"/>
Nov 22 14:53:42 user nova-compute[74776]:     </interface>
Nov 22 14:53:42 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:53:42 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/7df01019-c4b3-4626-8e05-a834f44e3019/console.log" append="off"/>
Nov 22 14:53:42 user nova-compute[74776]:     </serial>
Nov 22 14:53:42 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:53:42 user nova-compute[74776]:     <video>
Nov 22 14:53:42 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:53:42 user nova-compute[74776]:     </video>
Nov 22 14:53:42 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:53:42 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:53:42 user nova-compute[74776]:     </rng>
Nov 22 14:53:42 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:53:42 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:53:42 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:53:42 user nova-compute[74776]:     </memballoon>
Nov 22 14:53:42 user nova-compute[74776]:   </devices>
Nov 22 14:53:42 user nova-compute[74776]: </domain>
Nov 22 14:53:42 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:53:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1394158077',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1394158077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1394158077',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcm+UsaoZV6p/DwCWkXsAqfarU4nJg8ih4S0tmURCf0k4i0LBVJhtnpc2QVtr57+BzMCCfzs26NoNrr+wWosQN0nSj4pqLp1lUC4ehZ+qH0daFhijJzhORavEp8xPqANg==',key_name='tempest-keypair-1185117298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f6764076f2a428ea35c11476a3e7231',ramdisk_id='',reservation_id='r-g1afd8fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1931721751',owner_user_name='tempest-TestVolumeBootPattern-1931721751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:53:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5cce524a8c6419aa76fb4b02861377e',uuid=7df01019-c4b3-4626-8e05-a834f44e3019,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d50b55bf-450e-4227-9165-a36343344d6e", "address": "fa:16:3e:49:10:11", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd50b55bf-45", "ovs_interfaceid": "d50b55bf-450e-4227-9165-a36343344d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converting VIF {"id": "d50b55bf-450e-4227-9165-a36343344d6e", "address": "fa:16:3e:49:10:11", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd50b55bf-45", "ovs_interfaceid": "d50b55bf-450e-4227-9165-a36343344d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:10:11,bridge_name='br-int',has_traffic_filtering=True,id=d50b55bf-450e-4227-9165-a36343344d6e,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd50b55bf-45') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG os_vif [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:10:11,bridge_name='br-int',has_traffic_filtering=True,id=d50b55bf-450e-4227-9165-a36343344d6e,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd50b55bf-45') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ae37aae-972f-5235-9017-54ce52480647', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd50b55bf-45, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd50b55bf-45, col_values=(('qos', UUID('53dd1861-db00-4461-8d55-31d03116ba13')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd50b55bf-45, col_values=(('external_ids', {'iface-id': 'd50b55bf-450e-4227-9165-a36343344d6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:10:11', 'vm-uuid': '7df01019-c4b3-4626-8e05-a834f44e3019'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:42 user nova-compute[74776]: INFO os_vif [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:10:11,bridge_name='br-int',has_traffic_filtering=True,id=d50b55bf-450e-4227-9165-a36343344d6e,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd50b55bf-45')
Nov 22 14:53:42 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:53:42 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] No VIF found with MAC fa:16:3e:49:10:11, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:53:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:43 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:53:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:43 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:53:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:43 user nova-compute[74776]: DEBUG nova.compute.manager [req-a1332598-47e5-4c44-a86c-4ee08dbf9f21 req-12feb45a-adc9-4ea7-8dd7-8ac7f17d09b2 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Received event network-vif-plugged-d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:53:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-a1332598-47e5-4c44-a86c-4ee08dbf9f21 req-12feb45a-adc9-4ea7-8dd7-8ac7f17d09b2 service nova] Acquiring lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:53:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-a1332598-47e5-4c44-a86c-4ee08dbf9f21 req-12feb45a-adc9-4ea7-8dd7-8ac7f17d09b2 service nova] Lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:53:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-a1332598-47e5-4c44-a86c-4ee08dbf9f21 req-12feb45a-adc9-4ea7-8dd7-8ac7f17d09b2 service nova] Lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:53:43 user nova-compute[74776]: DEBUG nova.compute.manager [req-a1332598-47e5-4c44-a86c-4ee08dbf9f21 req-12feb45a-adc9-4ea7-8dd7-8ac7f17d09b2 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] No waiting events found dispatching network-vif-plugged-d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:53:43 user nova-compute[74776]: WARNING nova.compute.manager [req-a1332598-47e5-4c44-a86c-4ee08dbf9f21 req-12feb45a-adc9-4ea7-8dd7-8ac7f17d09b2 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Received unexpected event network-vif-plugged-d50b55bf-450e-4227-9165-a36343344d6e for instance with vm_state building and task_state spawning.
Nov 22 14:53:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:45 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:53:45 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:53:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:53:45 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Instance spawned successfully.
Nov 22 14:53:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:53:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:53:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:53:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:53:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:53:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:53:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:53:45 user nova-compute[74776]: INFO nova.compute.manager [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 22 14:53:45 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:53:45 user nova-compute[74776]: DEBUG nova.compute.manager [req-1fb299dd-92a5-47e6-b953-f79408a8d572 req-dc17308e-287c-4d74-8594-272209a36381 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Received event network-vif-plugged-d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:53:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1fb299dd-92a5-47e6-b953-f79408a8d572 req-dc17308e-287c-4d74-8594-272209a36381 service nova] Acquiring lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:53:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1fb299dd-92a5-47e6-b953-f79408a8d572 req-dc17308e-287c-4d74-8594-272209a36381 service nova] Lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:53:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1fb299dd-92a5-47e6-b953-f79408a8d572 req-dc17308e-287c-4d74-8594-272209a36381 service nova] Lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:53:45 user nova-compute[74776]: DEBUG nova.compute.manager [req-1fb299dd-92a5-47e6-b953-f79408a8d572 req-dc17308e-287c-4d74-8594-272209a36381 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] No waiting events found dispatching network-vif-plugged-d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:53:45 user nova-compute[74776]: WARNING nova.compute.manager [req-1fb299dd-92a5-47e6-b953-f79408a8d572 req-dc17308e-287c-4d74-8594-272209a36381 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Received unexpected event network-vif-plugged-d50b55bf-450e-4227-9165-a36343344d6e for instance with vm_state building and task_state spawning.
Nov 22 14:53:45 user nova-compute[74776]: INFO nova.compute.manager [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Took 11.59 seconds to build instance.
Nov 22 14:53:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d910057b-d723-4558-b1e5-8d95d7db3ede tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "7df01019-c4b3-4626-8e05-a834f44e3019" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.690s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:53:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Acquiring lock "ff941215-6e73-4ad4-9d7c-be7825029466" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:53:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "ff941215-6e73-4ad4-9d7c-be7825029466" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:53:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Acquiring lock "ff941215-6e73-4ad4-9d7c-be7825029466-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:53:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "ff941215-6e73-4ad4-9d7c-be7825029466-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:53:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "ff941215-6e73-4ad4-9d7c-be7825029466-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:53:47 user nova-compute[74776]: INFO nova.compute.manager [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Terminating instance
Nov 22 14:53:47 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:53:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:47 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG nova.compute.manager [req-fe5da346-a4a4-4b4d-8531-6fb51ab9938f req-8e95f5d2-c8fc-40f5-af22-46870defd7b3 service nova] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Received event network-vif-unplugged-ccc343e2-1b4d-4f3d-9b28-0b2962c810e0 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-fe5da346-a4a4-4b4d-8531-6fb51ab9938f req-8e95f5d2-c8fc-40f5-af22-46870defd7b3 service nova] Acquiring lock "ff941215-6e73-4ad4-9d7c-be7825029466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-fe5da346-a4a4-4b4d-8531-6fb51ab9938f req-8e95f5d2-c8fc-40f5-af22-46870defd7b3 service nova] Lock "ff941215-6e73-4ad4-9d7c-be7825029466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-fe5da346-a4a4-4b4d-8531-6fb51ab9938f req-8e95f5d2-c8fc-40f5-af22-46870defd7b3 service nova] Lock "ff941215-6e73-4ad4-9d7c-be7825029466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG nova.compute.manager [req-fe5da346-a4a4-4b4d-8531-6fb51ab9938f req-8e95f5d2-c8fc-40f5-af22-46870defd7b3 service nova] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] No waiting events found dispatching network-vif-unplugged-ccc343e2-1b4d-4f3d-9b28-0b2962c810e0 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG nova.compute.manager [req-fe5da346-a4a4-4b4d-8531-6fb51ab9938f req-8e95f5d2-c8fc-40f5-af22-46870defd7b3 service nova] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Received event network-vif-unplugged-ccc343e2-1b4d-4f3d-9b28-0b2962c810e0 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:53:48 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Instance destroyed successfully.
Nov 22 14:53:48 user nova-compute[74776]: DEBUG nova.objects.instance [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lazy-loading 'resources' on Instance uuid ff941215-6e73-4ad4-9d7c-be7825029466 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:51:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1338725153',display_name='tempest-VolumesActionsTest-instance-1338725153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1338725153',id=45,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:52:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd222b98813445e0af4430563b942958',ramdisk_id='',reservation_id='r-wogxwecv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1883387310',owner_user_name='tempest-VolumesActionsTest-1883387310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:52:03Z,user_data=None,user_id='e21ccdbbadfc4b8b81d96194dff23b38',uuid=ff941215-6e73-4ad4-9d7c-be7825029466,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "address": "fa:16:3e:1a:c0:b4", "network": {"id": "166a938b-0779-4198-8905-ebda4e19e289", "bridge": "br-int", "label": "tempest-VolumesActionsTest-102064328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd222b98813445e0af4430563b942958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc343e2-1b", "ovs_interfaceid": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Converting VIF {"id": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "address": "fa:16:3e:1a:c0:b4", "network": {"id": "166a938b-0779-4198-8905-ebda4e19e289", "bridge": "br-int", "label": "tempest-VolumesActionsTest-102064328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd222b98813445e0af4430563b942958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc343e2-1b", "ovs_interfaceid": "ccc343e2-1b4d-4f3d-9b28-0b2962c810e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:c0:b4,bridge_name='br-int',has_traffic_filtering=True,id=ccc343e2-1b4d-4f3d-9b28-0b2962c810e0,network=Network(166a938b-0779-4198-8905-ebda4e19e289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccc343e2-1b') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG os_vif [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:c0:b4,bridge_name='br-int',has_traffic_filtering=True,id=ccc343e2-1b4d-4f3d-9b28-0b2962c810e0,network=Network(166a938b-0779-4198-8905-ebda4e19e289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccc343e2-1b') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccc343e2-1b, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7a6c0e2-ea74-4e18-b635-5b1a230654bf) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:53:48 user nova-compute[74776]: INFO os_vif [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:c0:b4,bridge_name='br-int',has_traffic_filtering=True,id=ccc343e2-1b4d-4f3d-9b28-0b2962c810e0,network=Network(166a938b-0779-4198-8905-ebda4e19e289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccc343e2-1b')
Nov 22 14:53:48 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Deleting instance files /opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466_del
Nov 22 14:53:48 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Deletion of /opt/stack/data/nova/instances/ff941215-6e73-4ad4-9d7c-be7825029466_del complete
Nov 22 14:53:48 user nova-compute[74776]: INFO nova.compute.manager [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 22 14:53:48 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:53:48 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Took 0.65 seconds to deallocate network for instance.
Nov 22 14:53:48 user nova-compute[74776]: DEBUG nova.compute.manager [req-4c9f920e-accf-40c3-b356-c12b9410d61d req-3da95675-3b15-41ae-a53e-4bcfb464225d service nova] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Received event network-vif-deleted-ccc343e2-1b4d-4f3d-9b28-0b2962c810e0 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:53:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:53:49 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:53:49 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:53:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:53:49 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Deleted allocations for instance ff941215-6e73-4ad4-9d7c-be7825029466
Nov 22 14:53:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f415949a-9381-4e77-9004-86e6df045005 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "ff941215-6e73-4ad4-9d7c-be7825029466" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.923s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:53:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-6b6cee4f-13b6-4027-9990-06b3c8242089 req-d50be147-7230-4694-8c48-9bbf39c8bec5 service nova] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Received event network-vif-plugged-ccc343e2-1b4d-4f3d-9b28-0b2962c810e0 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:53:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6b6cee4f-13b6-4027-9990-06b3c8242089 req-d50be147-7230-4694-8c48-9bbf39c8bec5 service nova] Acquiring lock "ff941215-6e73-4ad4-9d7c-be7825029466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:53:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6b6cee4f-13b6-4027-9990-06b3c8242089 req-d50be147-7230-4694-8c48-9bbf39c8bec5 service nova] Lock "ff941215-6e73-4ad4-9d7c-be7825029466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:53:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6b6cee4f-13b6-4027-9990-06b3c8242089 req-d50be147-7230-4694-8c48-9bbf39c8bec5 service nova] Lock "ff941215-6e73-4ad4-9d7c-be7825029466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:53:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-6b6cee4f-13b6-4027-9990-06b3c8242089 req-d50be147-7230-4694-8c48-9bbf39c8bec5 service nova] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] No waiting events found dispatching network-vif-plugged-ccc343e2-1b4d-4f3d-9b28-0b2962c810e0 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:53:50 user nova-compute[74776]: WARNING nova.compute.manager [req-6b6cee4f-13b6-4027-9990-06b3c8242089 req-d50be147-7230-4694-8c48-9bbf39c8bec5 service nova] [instance: ff941215-6e73-4ad4-9d7c-be7825029466] Received unexpected event network-vif-plugged-ccc343e2-1b4d-4f3d-9b28-0b2962c810e0 for instance with vm_state deleted and task_state None.
Nov 22 14:53:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:53:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:00 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:54:00 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 7df01019-c4b3-4626-8e05-a834f44e3019 {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 14:54:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "7df01019-c4b3-4626-8e05-a834f44e3019" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:54:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "7df01019-c4b3-4626-8e05-a834f44e3019" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:54:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "7df01019-c4b3-4626-8e05-a834f44e3019" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:54:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:54:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:54:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:54:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:54:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:54:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:54:35 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:54:35 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:54:35 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 14:54:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-7df01019-c4b3-4626-8e05-a834f44e3019" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:54:35 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-7df01019-c4b3-4626-8e05-a834f44e3019" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:54:35 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:54:35 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid 7df01019-c4b3-4626-8e05-a834f44e3019 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:54:36 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Updating instance_info_cache with network_info: [{"id": "d50b55bf-450e-4227-9165-a36343344d6e", "address": "fa:16:3e:49:10:11", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd50b55bf-45", "ovs_interfaceid": "d50b55bf-450e-4227-9165-a36343344d6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:54:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-7df01019-c4b3-4626-8e05-a834f44e3019" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:54:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:54:37 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:54:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:38 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:54:38 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:54:38 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:54:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:54:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:54:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:54:38 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:54:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Acquiring lock "11b368b6-f796-4838-b762-ea4f6c80a798" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "11b368b6-f796-4838-b762-ea4f6c80a798" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:54:39 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:54:39 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:54:39 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8933MB free_disk=25.094104766845703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 7df01019-c4b3-4626-8e05-a834f44e3019 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 11b368b6-f796-4838-b762-ea4f6c80a798 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.123s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:54:39 user nova-compute[74776]: INFO nova.compute.claims [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Claim successful on node user
Nov 22 14:54:39 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.213s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:54:39 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:54:39 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG nova.policy [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e21ccdbbadfc4b8b81d96194dff23b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd222b98813445e0af4430563b942958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:54:39 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Creating image(s)
Nov 22 14:54:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Acquiring lock "/opt/stack/data/nova/instances/11b368b6-f796-4838-b762-ea4f6c80a798/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "/opt/stack/data/nova/instances/11b368b6-f796-4838-b762-ea4f6c80a798/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "/opt/stack/data/nova/instances/11b368b6-f796-4838-b762-ea4f6c80a798/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:54:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:54:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.205s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:54:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:54:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:54:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:54:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:54:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/11b368b6-f796-4838-b762-ea4f6c80a798/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:54:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/11b368b6-f796-4838-b762-ea4f6c80a798/disk 1073741824" returned: 0 in 0.048s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:54:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:54:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:54:40 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:54:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.179s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:54:40 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11b368b6-f796-4838-b762-ea4f6c80a798/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:54:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b368b6-f796-4838-b762-ea4f6c80a798/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:54:40 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Successfully created port: 2317f0ac-1530-49e5-8aaf-a57db1103e0a {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:54:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b368b6-f796-4838-b762-ea4f6c80a798/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:54:40 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Cannot resize image /opt/stack/data/nova/instances/11b368b6-f796-4838-b762-ea4f6c80a798/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:54:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:54:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Ensure instance console log exists: /opt/stack/data/nova/instances/11b368b6-f796-4838-b762-ea4f6c80a798/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:54:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:54:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:54:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Successfully updated port: 2317f0ac-1530-49e5-8aaf-a57db1103e0a {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Acquiring lock "refresh_cache-11b368b6-f796-4838-b762-ea4f6c80a798" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Acquired lock "refresh_cache-11b368b6-f796-4838-b762-ea4f6c80a798" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-f6d9fcbc-8e83-4fc2-ad9e-af268c0f4ce7 req-f3d912c2-3401-4f8e-b9ea-10559c919413 service nova] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Received event network-changed-2317f0ac-1530-49e5-8aaf-a57db1103e0a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.compute.manager [req-f6d9fcbc-8e83-4fc2-ad9e-af268c0f4ce7 req-f3d912c2-3401-4f8e-b9ea-10559c919413 service nova] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Refreshing instance network info cache due to event network-changed-2317f0ac-1530-49e5-8aaf-a57db1103e0a. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f6d9fcbc-8e83-4fc2-ad9e-af268c0f4ce7 req-f3d912c2-3401-4f8e-b9ea-10559c919413 service nova] Acquiring lock "refresh_cache-11b368b6-f796-4838-b762-ea4f6c80a798" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Updating instance_info_cache with network_info: [{"id": "2317f0ac-1530-49e5-8aaf-a57db1103e0a", "address": "fa:16:3e:0d:2f:ab", "network": {"id": "166a938b-0779-4198-8905-ebda4e19e289", "bridge": "br-int", "label": "tempest-VolumesActionsTest-102064328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd222b98813445e0af4430563b942958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2317f0ac-15", "ovs_interfaceid": "2317f0ac-1530-49e5-8aaf-a57db1103e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Releasing lock "refresh_cache-11b368b6-f796-4838-b762-ea4f6c80a798" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Instance network_info: |[{"id": "2317f0ac-1530-49e5-8aaf-a57db1103e0a", "address": "fa:16:3e:0d:2f:ab", "network": {"id": "166a938b-0779-4198-8905-ebda4e19e289", "bridge": "br-int", "label": "tempest-VolumesActionsTest-102064328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd222b98813445e0af4430563b942958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2317f0ac-15", "ovs_interfaceid": "2317f0ac-1530-49e5-8aaf-a57db1103e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f6d9fcbc-8e83-4fc2-ad9e-af268c0f4ce7 req-f3d912c2-3401-4f8e-b9ea-10559c919413 service nova] Acquired lock "refresh_cache-11b368b6-f796-4838-b762-ea4f6c80a798" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.network.neutron [req-f6d9fcbc-8e83-4fc2-ad9e-af268c0f4ce7 req-f3d912c2-3401-4f8e-b9ea-10559c919413 service nova] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Refreshing network info cache for port 2317f0ac-1530-49e5-8aaf-a57db1103e0a {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Start _get_guest_xml network_info=[{"id": "2317f0ac-1530-49e5-8aaf-a57db1103e0a", "address": "fa:16:3e:0d:2f:ab", "network": {"id": "166a938b-0779-4198-8905-ebda4e19e289", "bridge": "br-int", "label": "tempest-VolumesActionsTest-102064328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd222b98813445e0af4430563b942958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2317f0ac-15", "ovs_interfaceid": "2317f0ac-1530-49e5-8aaf-a57db1103e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:54:41 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:54:41 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:54:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1634612933',display_name='tempest-VolumesActionsTest-instance-1634612933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1634612933',id=47,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd222b98813445e0af4430563b942958',ramdisk_id='',reservation_id='r-lzkhhyuq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1883387310',owner_user_name='tempest-VolumesActionsTest-1883387310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:54:40Z,user_data=None,user_id='e21ccdbbadfc4b8b81d96194dff23b38',uuid=11b368b6-f796-4838-b762-ea4f6c80a798,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2317f0ac-1530-49e5-8aaf-a57db1103e0a", "address": "fa:16:3e:0d:2f:ab", "network": {"id": "166a938b-0779-4198-8905-ebda4e19e289", "bridge": "br-int", "label": "tempest-VolumesActionsTest-102064328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd222b98813445e0af4430563b942958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2317f0ac-15", "ovs_interfaceid": "2317f0ac-1530-49e5-8aaf-a57db1103e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Converting VIF {"id": "2317f0ac-1530-49e5-8aaf-a57db1103e0a", "address": "fa:16:3e:0d:2f:ab", "network": {"id": "166a938b-0779-4198-8905-ebda4e19e289", "bridge": "br-int", "label": "tempest-VolumesActionsTest-102064328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd222b98813445e0af4430563b942958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2317f0ac-15", "ovs_interfaceid": "2317f0ac-1530-49e5-8aaf-a57db1103e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:2f:ab,bridge_name='br-int',has_traffic_filtering=True,id=2317f0ac-1530-49e5-8aaf-a57db1103e0a,network=Network(166a938b-0779-4198-8905-ebda4e19e289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2317f0ac-15') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lazy-loading 'pci_devices' on Instance uuid 11b368b6-f796-4838-b762-ea4f6c80a798 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:54:41 user nova-compute[74776]:   <uuid>11b368b6-f796-4838-b762-ea4f6c80a798</uuid>
Nov 22 14:54:41 user nova-compute[74776]:   <name>instance-0000002f</name>
Nov 22 14:54:41 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:54:41 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:54:41 user nova-compute[74776]:   <metadata>
Nov 22 14:54:41 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:54:41 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:54:41 user nova-compute[74776]:       <nova:name>tempest-VolumesActionsTest-instance-1634612933</nova:name>
Nov 22 14:54:41 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:54:41</nova:creationTime>
Nov 22 14:54:41 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:54:41 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:54:41 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:54:41 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:54:41 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:54:41 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:54:41 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:54:41 user nova-compute[74776]:       <nova:owner>
Nov 22 14:54:41 user nova-compute[74776]:         <nova:user uuid="e21ccdbbadfc4b8b81d96194dff23b38">tempest-VolumesActionsTest-1883387310-project-member</nova:user>
Nov 22 14:54:41 user nova-compute[74776]:         <nova:project uuid="fd222b98813445e0af4430563b942958">tempest-VolumesActionsTest-1883387310</nova:project>
Nov 22 14:54:41 user nova-compute[74776]:       </nova:owner>
Nov 22 14:54:41 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:54:41 user nova-compute[74776]:       <nova:ports>
Nov 22 14:54:41 user nova-compute[74776]:         <nova:port uuid="2317f0ac-1530-49e5-8aaf-a57db1103e0a">
Nov 22 14:54:41 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 14:54:41 user nova-compute[74776]:         </nova:port>
Nov 22 14:54:41 user nova-compute[74776]:       </nova:ports>
Nov 22 14:54:41 user nova-compute[74776]:     </nova:instance>
Nov 22 14:54:41 user nova-compute[74776]:   </metadata>
Nov 22 14:54:41 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:54:41 user nova-compute[74776]:     <system>
Nov 22 14:54:41 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:54:41 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:54:41 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:54:41 user nova-compute[74776]:       <entry name="serial">11b368b6-f796-4838-b762-ea4f6c80a798</entry>
Nov 22 14:54:41 user nova-compute[74776]:       <entry name="uuid">11b368b6-f796-4838-b762-ea4f6c80a798</entry>
Nov 22 14:54:41 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:54:41 user nova-compute[74776]:     </system>
Nov 22 14:54:41 user nova-compute[74776]:   </sysinfo>
Nov 22 14:54:41 user nova-compute[74776]:   <os>
Nov 22 14:54:41 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:54:41 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:54:41 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:54:41 user nova-compute[74776]:   </os>
Nov 22 14:54:41 user nova-compute[74776]:   <features>
Nov 22 14:54:41 user nova-compute[74776]:     <acpi/>
Nov 22 14:54:41 user nova-compute[74776]:     <apic/>
Nov 22 14:54:41 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:54:41 user nova-compute[74776]:   </features>
Nov 22 14:54:41 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:54:41 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:54:41 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:54:41 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:54:41 user nova-compute[74776]:   </clock>
Nov 22 14:54:41 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:54:41 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:54:41 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:54:41 user nova-compute[74776]:   </cpu>
Nov 22 14:54:41 user nova-compute[74776]:   <devices>
Nov 22 14:54:41 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:54:41 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:54:41 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/11b368b6-f796-4838-b762-ea4f6c80a798/disk"/>
Nov 22 14:54:41 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:54:41 user nova-compute[74776]:     </disk>
Nov 22 14:54:41 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:54:41 user nova-compute[74776]:       <mac address="fa:16:3e:0d:2f:ab"/>
Nov 22 14:54:41 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:54:41 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:54:41 user nova-compute[74776]:       <target dev="tap2317f0ac-15"/>
Nov 22 14:54:41 user nova-compute[74776]:     </interface>
Nov 22 14:54:41 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:54:41 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/11b368b6-f796-4838-b762-ea4f6c80a798/console.log" append="off"/>
Nov 22 14:54:41 user nova-compute[74776]:     </serial>
Nov 22 14:54:41 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:54:41 user nova-compute[74776]:     <video>
Nov 22 14:54:41 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:54:41 user nova-compute[74776]:     </video>
Nov 22 14:54:41 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:54:41 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:54:41 user nova-compute[74776]:     </rng>
Nov 22 14:54:41 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:54:41 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:54:41 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:54:41 user nova-compute[74776]:     </memballoon>
Nov 22 14:54:41 user nova-compute[74776]:   </devices>
Nov 22 14:54:41 user nova-compute[74776]: </domain>
Nov 22 14:54:41 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:54:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1634612933',display_name='tempest-VolumesActionsTest-instance-1634612933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1634612933',id=47,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd222b98813445e0af4430563b942958',ramdisk_id='',reservation_id='r-lzkhhyuq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1883387310',owner_user_name='tempest-VolumesActionsTest-1883387310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:54:40Z,user_data=None,user_id='e21ccdbbadfc4b8b81d96194dff23b38',uuid=11b368b6-f796-4838-b762-ea4f6c80a798,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2317f0ac-1530-49e5-8aaf-a57db1103e0a", "address": "fa:16:3e:0d:2f:ab", "network": {"id": "166a938b-0779-4198-8905-ebda4e19e289", "bridge": "br-int", "label": "tempest-VolumesActionsTest-102064328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd222b98813445e0af4430563b942958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2317f0ac-15", "ovs_interfaceid": "2317f0ac-1530-49e5-8aaf-a57db1103e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Converting VIF {"id": "2317f0ac-1530-49e5-8aaf-a57db1103e0a", "address": "fa:16:3e:0d:2f:ab", "network": {"id": "166a938b-0779-4198-8905-ebda4e19e289", "bridge": "br-int", "label": "tempest-VolumesActionsTest-102064328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd222b98813445e0af4430563b942958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2317f0ac-15", "ovs_interfaceid": "2317f0ac-1530-49e5-8aaf-a57db1103e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:2f:ab,bridge_name='br-int',has_traffic_filtering=True,id=2317f0ac-1530-49e5-8aaf-a57db1103e0a,network=Network(166a938b-0779-4198-8905-ebda4e19e289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2317f0ac-15') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG os_vif [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:2f:ab,bridge_name='br-int',has_traffic_filtering=True,id=2317f0ac-1530-49e5-8aaf-a57db1103e0a,network=Network(166a938b-0779-4198-8905-ebda4e19e289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2317f0ac-15') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4ca0280-5c26-5794-973b-0c89ea9574c5', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2317f0ac-15, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2317f0ac-15, col_values=(('qos', UUID('a7d5fb27-4e3e-4403-9fd0-6c8272df17cb')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2317f0ac-15, col_values=(('external_ids', {'iface-id': '2317f0ac-1530-49e5-8aaf-a57db1103e0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:2f:ab', 'vm-uuid': '11b368b6-f796-4838-b762-ea4f6c80a798'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:41 user nova-compute[74776]: INFO os_vif [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:2f:ab,bridge_name='br-int',has_traffic_filtering=True,id=2317f0ac-1530-49e5-8aaf-a57db1103e0a,network=Network(166a938b-0779-4198-8905-ebda4e19e289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2317f0ac-15')
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] No VIF found with MAC fa:16:3e:0d:2f:ab, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.network.neutron [req-f6d9fcbc-8e83-4fc2-ad9e-af268c0f4ce7 req-f3d912c2-3401-4f8e-b9ea-10559c919413 service nova] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Updated VIF entry in instance network info cache for port 2317f0ac-1530-49e5-8aaf-a57db1103e0a. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG nova.network.neutron [req-f6d9fcbc-8e83-4fc2-ad9e-af268c0f4ce7 req-f3d912c2-3401-4f8e-b9ea-10559c919413 service nova] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Updating instance_info_cache with network_info: [{"id": "2317f0ac-1530-49e5-8aaf-a57db1103e0a", "address": "fa:16:3e:0d:2f:ab", "network": {"id": "166a938b-0779-4198-8905-ebda4e19e289", "bridge": "br-int", "label": "tempest-VolumesActionsTest-102064328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd222b98813445e0af4430563b942958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2317f0ac-15", "ovs_interfaceid": "2317f0ac-1530-49e5-8aaf-a57db1103e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:54:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f6d9fcbc-8e83-4fc2-ad9e-af268c0f4ce7 req-f3d912c2-3401-4f8e-b9ea-10559c919413 service nova] Releasing lock "refresh_cache-11b368b6-f796-4838-b762-ea4f6c80a798" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:54:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:43 user nova-compute[74776]: DEBUG nova.compute.manager [req-f1c8e426-bdc0-47ae-ac86-11dfdbbe17ef req-05e2424b-5abe-48bb-9239-14b259406ba8 service nova] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Received event network-vif-plugged-2317f0ac-1530-49e5-8aaf-a57db1103e0a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:54:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f1c8e426-bdc0-47ae-ac86-11dfdbbe17ef req-05e2424b-5abe-48bb-9239-14b259406ba8 service nova] Acquiring lock "11b368b6-f796-4838-b762-ea4f6c80a798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:54:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f1c8e426-bdc0-47ae-ac86-11dfdbbe17ef req-05e2424b-5abe-48bb-9239-14b259406ba8 service nova] Lock "11b368b6-f796-4838-b762-ea4f6c80a798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:54:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f1c8e426-bdc0-47ae-ac86-11dfdbbe17ef req-05e2424b-5abe-48bb-9239-14b259406ba8 service nova] Lock "11b368b6-f796-4838-b762-ea4f6c80a798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:54:43 user nova-compute[74776]: DEBUG nova.compute.manager [req-f1c8e426-bdc0-47ae-ac86-11dfdbbe17ef req-05e2424b-5abe-48bb-9239-14b259406ba8 service nova] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] No waiting events found dispatching network-vif-plugged-2317f0ac-1530-49e5-8aaf-a57db1103e0a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:54:43 user nova-compute[74776]: WARNING nova.compute.manager [req-f1c8e426-bdc0-47ae-ac86-11dfdbbe17ef req-05e2424b-5abe-48bb-9239-14b259406ba8 service nova] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Received unexpected event network-vif-plugged-2317f0ac-1530-49e5-8aaf-a57db1103e0a for instance with vm_state building and task_state spawning.
Nov 22 14:54:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:43 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:54:43 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:54:44 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:54:44 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:54:45 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Instance spawned successfully.
Nov 22 14:54:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:54:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:54:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:54:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:54:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:54:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:54:45 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:54:45 user nova-compute[74776]: INFO nova.compute.manager [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 22 14:54:45 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:54:45 user nova-compute[74776]: DEBUG nova.compute.manager [req-4873a9c5-1be2-4614-a8aa-ac97792e57f6 req-39e04503-28e9-4c3d-84f7-4f4b441c2309 service nova] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Received event network-vif-plugged-2317f0ac-1530-49e5-8aaf-a57db1103e0a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:54:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4873a9c5-1be2-4614-a8aa-ac97792e57f6 req-39e04503-28e9-4c3d-84f7-4f4b441c2309 service nova] Acquiring lock "11b368b6-f796-4838-b762-ea4f6c80a798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:54:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4873a9c5-1be2-4614-a8aa-ac97792e57f6 req-39e04503-28e9-4c3d-84f7-4f4b441c2309 service nova] Lock "11b368b6-f796-4838-b762-ea4f6c80a798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:54:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4873a9c5-1be2-4614-a8aa-ac97792e57f6 req-39e04503-28e9-4c3d-84f7-4f4b441c2309 service nova] Lock "11b368b6-f796-4838-b762-ea4f6c80a798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:54:45 user nova-compute[74776]: DEBUG nova.compute.manager [req-4873a9c5-1be2-4614-a8aa-ac97792e57f6 req-39e04503-28e9-4c3d-84f7-4f4b441c2309 service nova] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] No waiting events found dispatching network-vif-plugged-2317f0ac-1530-49e5-8aaf-a57db1103e0a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:54:45 user nova-compute[74776]: WARNING nova.compute.manager [req-4873a9c5-1be2-4614-a8aa-ac97792e57f6 req-39e04503-28e9-4c3d-84f7-4f4b441c2309 service nova] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Received unexpected event network-vif-plugged-2317f0ac-1530-49e5-8aaf-a57db1103e0a for instance with vm_state building and task_state spawning.
Nov 22 14:54:45 user nova-compute[74776]: INFO nova.compute.manager [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Took 5.98 seconds to build instance.
Nov 22 14:54:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7cdf07c8-753a-4056-aad4-3731c79183bc tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "11b368b6-f796-4838-b762-ea4f6c80a798" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.069s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:54:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:46 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:54:49 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:54:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:54:54 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:54:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:55:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:55:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:55:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:55:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:55:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-38de80aa-bf6c-483f-bc0e-4fe6ae4a88b1 req-834d238b-8a01-456d-bc73-37dd4da6c706 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Received event network-changed-d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:55:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-38de80aa-bf6c-483f-bc0e-4fe6ae4a88b1 req-834d238b-8a01-456d-bc73-37dd4da6c706 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Refreshing instance network info cache due to event network-changed-d50b55bf-450e-4227-9165-a36343344d6e. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:55:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-38de80aa-bf6c-483f-bc0e-4fe6ae4a88b1 req-834d238b-8a01-456d-bc73-37dd4da6c706 service nova] Acquiring lock "refresh_cache-7df01019-c4b3-4626-8e05-a834f44e3019" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:55:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-38de80aa-bf6c-483f-bc0e-4fe6ae4a88b1 req-834d238b-8a01-456d-bc73-37dd4da6c706 service nova] Acquired lock "refresh_cache-7df01019-c4b3-4626-8e05-a834f44e3019" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:55:25 user nova-compute[74776]: DEBUG nova.network.neutron [req-38de80aa-bf6c-483f-bc0e-4fe6ae4a88b1 req-834d238b-8a01-456d-bc73-37dd4da6c706 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Refreshing network info cache for port d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:55:26 user nova-compute[74776]: DEBUG nova.network.neutron [req-38de80aa-bf6c-483f-bc0e-4fe6ae4a88b1 req-834d238b-8a01-456d-bc73-37dd4da6c706 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Updated VIF entry in instance network info cache for port d50b55bf-450e-4227-9165-a36343344d6e. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:55:26 user nova-compute[74776]: DEBUG nova.network.neutron [req-38de80aa-bf6c-483f-bc0e-4fe6ae4a88b1 req-834d238b-8a01-456d-bc73-37dd4da6c706 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Updating instance_info_cache with network_info: [{"id": "d50b55bf-450e-4227-9165-a36343344d6e", "address": "fa:16:3e:49:10:11", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd50b55bf-45", "ovs_interfaceid": "d50b55bf-450e-4227-9165-a36343344d6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:55:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-38de80aa-bf6c-483f-bc0e-4fe6ae4a88b1 req-834d238b-8a01-456d-bc73-37dd4da6c706 service nova] Releasing lock "refresh_cache-7df01019-c4b3-4626-8e05-a834f44e3019" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:55:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "d4c09c5c-43d3-45cf-a5f2-5ac730c146ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:55:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "d4c09c5c-43d3-45cf-a5f2-5ac730c146ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:55:31 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:55:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:55:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:55:31 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:55:31 user nova-compute[74776]: INFO nova.compute.claims [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Claim successful on node user
Nov 22 14:55:31 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:55:31 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:55:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:55:31 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:55:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:31 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:55:31 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:55:31 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:55:31 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:55:31 user nova-compute[74776]: INFO nova.virt.block_device [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Booting with volume snapshot 5db9a343-ff5e-4dc9-81f0-b8baef96674a at /dev/vda
Nov 22 14:55:31 user nova-compute[74776]: DEBUG nova.policy [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5cce524a8c6419aa76fb4b02861377e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6764076f2a428ea35c11476a3e7231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:55:32 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Successfully created port: a3900592-13f4-4d40-842d-31b6ad758a1b {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:55:32 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Successfully updated port: a3900592-13f4-4d40-842d-31b6ad758a1b {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:55:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "refresh_cache-d4c09c5c-43d3-45cf-a5f2-5ac730c146ec" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:55:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquired lock "refresh_cache-d4c09c5c-43d3-45cf-a5f2-5ac730c146ec" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:55:32 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:55:32 user nova-compute[74776]: DEBUG nova.compute.manager [req-32840a5b-9c04-4334-9ddd-21d2da88ad80 req-bf9e8c69-0f3a-47e2-86b8-477fd76a4bcc service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Received event network-changed-a3900592-13f4-4d40-842d-31b6ad758a1b {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:55:32 user nova-compute[74776]: DEBUG nova.compute.manager [req-32840a5b-9c04-4334-9ddd-21d2da88ad80 req-bf9e8c69-0f3a-47e2-86b8-477fd76a4bcc service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Refreshing instance network info cache due to event network-changed-a3900592-13f4-4d40-842d-31b6ad758a1b. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:55:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-32840a5b-9c04-4334-9ddd-21d2da88ad80 req-bf9e8c69-0f3a-47e2-86b8-477fd76a4bcc service nova] Acquiring lock "refresh_cache-d4c09c5c-43d3-45cf-a5f2-5ac730c146ec" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:55:32 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:55:33 user nova-compute[74776]: DEBUG nova.network.neutron [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Updating instance_info_cache with network_info: [{"id": "a3900592-13f4-4d40-842d-31b6ad758a1b", "address": "fa:16:3e:4d:fe:3f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3900592-13", "ovs_interfaceid": "a3900592-13f4-4d40-842d-31b6ad758a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:55:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Releasing lock "refresh_cache-d4c09c5c-43d3-45cf-a5f2-5ac730c146ec" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:55:33 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Instance network_info: |[{"id": "a3900592-13f4-4d40-842d-31b6ad758a1b", "address": "fa:16:3e:4d:fe:3f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3900592-13", "ovs_interfaceid": "a3900592-13f4-4d40-842d-31b6ad758a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:55:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-32840a5b-9c04-4334-9ddd-21d2da88ad80 req-bf9e8c69-0f3a-47e2-86b8-477fd76a4bcc service nova] Acquired lock "refresh_cache-d4c09c5c-43d3-45cf-a5f2-5ac730c146ec" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:55:33 user nova-compute[74776]: DEBUG nova.network.neutron [req-32840a5b-9c04-4334-9ddd-21d2da88ad80 req-bf9e8c69-0f3a-47e2-86b8-477fd76a4bcc service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Refreshing network info cache for port a3900592-13f4-4d40-842d-31b6ad758a1b {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:55:33 user nova-compute[74776]: DEBUG nova.network.neutron [req-32840a5b-9c04-4334-9ddd-21d2da88ad80 req-bf9e8c69-0f3a-47e2-86b8-477fd76a4bcc service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Updated VIF entry in instance network info cache for port a3900592-13f4-4d40-842d-31b6ad758a1b. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:55:33 user nova-compute[74776]: DEBUG nova.network.neutron [req-32840a5b-9c04-4334-9ddd-21d2da88ad80 req-bf9e8c69-0f3a-47e2-86b8-477fd76a4bcc service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Updating instance_info_cache with network_info: [{"id": "a3900592-13f4-4d40-842d-31b6ad758a1b", "address": "fa:16:3e:4d:fe:3f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3900592-13", "ovs_interfaceid": "a3900592-13f4-4d40-842d-31b6ad758a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:55:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-32840a5b-9c04-4334-9ddd-21d2da88ad80 req-bf9e8c69-0f3a-47e2-86b8-477fd76a4bcc service nova] Releasing lock "refresh_cache-d4c09c5c-43d3-45cf-a5f2-5ac730c146ec" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:55:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:36 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:55:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:55:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 14:55:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Skipping network cache update for instance because it is Building. {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 22 14:55:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-7df01019-c4b3-4626-8e05-a834f44e3019" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:55:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-7df01019-c4b3-4626-8e05-a834f44e3019" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:55:36 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:55:36 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid 7df01019-c4b3-4626-8e05-a834f44e3019 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG os_brick.utils [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d862b3e-b74b-417c-928c-f2e1bd75b80e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7301ca5-472e-4a58-8f27-7cff6d3edf72]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[580b6a7d-7236-4d74-8f5b-231996451cba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1f2fe0-c940-424e-a843-10debb7292d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Updating instance_info_cache with network_info: [{"id": "d50b55bf-450e-4227-9165-a36343344d6e", "address": "fa:16:3e:49:10:11", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd50b55bf-45", "ovs_interfaceid": "d50b55bf-450e-4227-9165-a36343344d6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:55:37 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:55:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b793cd-cae1-4111-b51c-b34e55a163ba]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG os_brick.utils [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Updating existing volume attachment record: a389e5fa-4c6f-4a31-8643-4ab33f0bb8d7 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-7df01019-c4b3-4626-8e05-a834f44e3019" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:55:37 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:55:38 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:55:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:55:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:55:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:55:38 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:55:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b368b6-f796-4838-b762-ea4f6c80a798/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:55:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b368b6-f796-4838-b762-ea4f6c80a798/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:55:38 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b368b6-f796-4838-b762-ea4f6c80a798/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:55:39 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11b368b6-f796-4838-b762-ea4f6c80a798/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:55:39 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:55:39 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:55:39 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:55:39 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8810MB free_disk=25.063987731933594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:55:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:55:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:55:39 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 7df01019-c4b3-4626-8e05-a834f44e3019 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:55:39 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 11b368b6-f796-4838-b762-ea4f6c80a798 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:55:39 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance d4c09c5c-43d3-45cf-a5f2-5ac730c146ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:55:39 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:55:39 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:55:39 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:55:39 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:55:39 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:55:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:55:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:41 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:55:41 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:55:41 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:55:43 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Creating image(s)
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Did not create local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Ensure instance console log exists: /opt/stack/data/nova/instances/d4c09c5c-43d3-45cf-a5f2-5ac730c146ec/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Start _get_guest_xml network_info=[{"id": "a3900592-13f4-4d40-842d-31b6ad758a1b", "address": "fa:16:3e:4d:fe:3f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3900592-13", "ovs_interfaceid": "a3900592-13f4-4d40-842d-31b6ad758a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-22T14:55:27Z,direct_url=<?>,disk_format='qcow2',id=88d9b11c-20b9-48f9-afca-d5cc9e0201c6,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-217777335',owner='2f6764076f2a428ea35c11476a3e7231',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-22T14:55:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a389e5fa-4c6f-4a31-8643-4ab33f0bb8d7', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SHzxKesn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd4c09c5c-43d3-45cf-a5f2-5ac730c146ec', 'attached_at': '', 'detached_at': '', 'volume_id': '3a7ebcc7-702d-4b43-8f68-f806d4d18626', 'serial': '3a7ebcc7-702d-4b43-8f68-f806d4d18626'}, 'boot_index': 0, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:55:43 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:55:43 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-22T14:55:27Z,direct_url=<?>,disk_format='qcow2',id=88d9b11c-20b9-48f9-afca-d5cc9e0201c6,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-217777335',owner='2f6764076f2a428ea35c11476a3e7231',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-22T14:55:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SHzxKesn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:55:43 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:55:43 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:55:43 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2568dee9-d784-486a-8879-f18030f85619]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:55:43 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9f34ce-7e22-4006-996c-92b7037a94ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626] added
Nov 22 14:55:43 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d54c4e9-83ae-4941-8042-e77447727d20]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3400e900-0603-4a55-9859-bff635f33bc4]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SHzxKesn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SHzxKesn" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1125360-c170-479d-9df5-afbb6b323118]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SHzxKesn'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c032872-f451-406b-bd69-0269e0694cfa]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d814f3c9-a738-4835-afa5-18b07b76bd15]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 (non-flash)
Nov 22 14:55:43 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 (non-flash)
Nov 22 14:55:43 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c492d47-810f-4006-9ba4-7899983c0cc5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626, portal: 172.16.0.220,3260]
Nov 22 14:55:43 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626, portal: 172.16.0.220,3260] successful.
Nov 22 14:55:43 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bca040-31c3-4bbb-b028-bd81f2567dd1]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cb870f-032d-4470-a41b-6cc3498958e0]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 (non-flash)
Nov 22 14:55:43 user nova-compute[74776]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 (non-flash)
Nov 22 14:55:43 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 (non-flash)
Nov 22 14:55:43 user nova-compute[74776]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 (non-flash)
Nov 22 14:55:43 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c7da61-b3e8-4058-9ff2-1aa21ba61487]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:55:43 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SHzxKesn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23034313066363734', 'path': '/dev/sdc'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034313066363734', 'path': '/dev/sdc'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:55:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1411440475',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1411440475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1411440475',id=48,image_ref='88d9b11c-20b9-48f9-afca-d5cc9e0201c6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLslWFMAVaSra48LUCAZDTvBY/PB/Ubdhwt0mjSC3Yk5io1k/rbWQqLvvg06md70c0XeUXXpinr1TThROUZRy9NtZOy1Uz/UbstR0VFINwHpkG56dAmj3+LnX8tK7Ibxyg==',key_name='tempest-keypair-1101352704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f6764076f2a428ea35c11476a3e7231',ramdisk_id='',reservation_id='r-m1dj7me8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1931721751',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1931721751-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1931721751',owner_user_name='tempest-TestVolumeBootPattern-1931721751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:55:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5cce524a8c6419aa76fb4b02861377e',uuid=d4c09c5c-43d3-45cf-a5f2-5ac730c146ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3900592-13f4-4d40-842d-31b6ad758a1b", "address": "fa:16:3e:4d:fe:3f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3900592-13", "ovs_interfaceid": "a3900592-13f4-4d40-842d-31b6ad758a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converting VIF {"id": "a3900592-13f4-4d40-842d-31b6ad758a1b", "address": "fa:16:3e:4d:fe:3f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3900592-13", "ovs_interfaceid": "a3900592-13f4-4d40-842d-31b6ad758a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:fe:3f,bridge_name='br-int',has_traffic_filtering=True,id=a3900592-13f4-4d40-842d-31b6ad758a1b,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3900592-13') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG nova.objects.instance [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lazy-loading 'pci_devices' on Instance uuid d4c09c5c-43d3-45cf-a5f2-5ac730c146ec {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:55:44 user nova-compute[74776]:   <uuid>d4c09c5c-43d3-45cf-a5f2-5ac730c146ec</uuid>
Nov 22 14:55:44 user nova-compute[74776]:   <name>instance-00000030</name>
Nov 22 14:55:44 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:55:44 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:55:44 user nova-compute[74776]:   <metadata>
Nov 22 14:55:44 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:55:44 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:55:44 user nova-compute[74776]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1411440475</nova:name>
Nov 22 14:55:44 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:55:43</nova:creationTime>
Nov 22 14:55:44 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:55:44 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:55:44 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:55:44 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:55:44 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:55:44 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:55:44 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:55:44 user nova-compute[74776]:       <nova:owner>
Nov 22 14:55:44 user nova-compute[74776]:         <nova:user uuid="d5cce524a8c6419aa76fb4b02861377e">tempest-TestVolumeBootPattern-1931721751-project-member</nova:user>
Nov 22 14:55:44 user nova-compute[74776]:         <nova:project uuid="2f6764076f2a428ea35c11476a3e7231">tempest-TestVolumeBootPattern-1931721751</nova:project>
Nov 22 14:55:44 user nova-compute[74776]:       </nova:owner>
Nov 22 14:55:44 user nova-compute[74776]:       <nova:root type="image" uuid="88d9b11c-20b9-48f9-afca-d5cc9e0201c6"/>
Nov 22 14:55:44 user nova-compute[74776]:       <nova:ports>
Nov 22 14:55:44 user nova-compute[74776]:         <nova:port uuid="a3900592-13f4-4d40-842d-31b6ad758a1b">
Nov 22 14:55:44 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 22 14:55:44 user nova-compute[74776]:         </nova:port>
Nov 22 14:55:44 user nova-compute[74776]:       </nova:ports>
Nov 22 14:55:44 user nova-compute[74776]:     </nova:instance>
Nov 22 14:55:44 user nova-compute[74776]:   </metadata>
Nov 22 14:55:44 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:55:44 user nova-compute[74776]:     <system>
Nov 22 14:55:44 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:55:44 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:55:44 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:55:44 user nova-compute[74776]:       <entry name="serial">d4c09c5c-43d3-45cf-a5f2-5ac730c146ec</entry>
Nov 22 14:55:44 user nova-compute[74776]:       <entry name="uuid">d4c09c5c-43d3-45cf-a5f2-5ac730c146ec</entry>
Nov 22 14:55:44 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:55:44 user nova-compute[74776]:     </system>
Nov 22 14:55:44 user nova-compute[74776]:   </sysinfo>
Nov 22 14:55:44 user nova-compute[74776]:   <os>
Nov 22 14:55:44 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:55:44 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:55:44 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:55:44 user nova-compute[74776]:   </os>
Nov 22 14:55:44 user nova-compute[74776]:   <features>
Nov 22 14:55:44 user nova-compute[74776]:     <acpi/>
Nov 22 14:55:44 user nova-compute[74776]:     <apic/>
Nov 22 14:55:44 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:55:44 user nova-compute[74776]:   </features>
Nov 22 14:55:44 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:55:44 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:55:44 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:55:44 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:55:44 user nova-compute[74776]:   </clock>
Nov 22 14:55:44 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:55:44 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:55:44 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:55:44 user nova-compute[74776]:   </cpu>
Nov 22 14:55:44 user nova-compute[74776]:   <devices>
Nov 22 14:55:44 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:55:44 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:55:44 user nova-compute[74776]:       <source dev="/dev/sdc"/>
Nov 22 14:55:44 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:55:44 user nova-compute[74776]:       <serial>3a7ebcc7-702d-4b43-8f68-f806d4d18626</serial>
Nov 22 14:55:44 user nova-compute[74776]:     </disk>
Nov 22 14:55:44 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:55:44 user nova-compute[74776]:       <mac address="fa:16:3e:4d:fe:3f"/>
Nov 22 14:55:44 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:55:44 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:55:44 user nova-compute[74776]:       <target dev="tapa3900592-13"/>
Nov 22 14:55:44 user nova-compute[74776]:     </interface>
Nov 22 14:55:44 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:55:44 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/d4c09c5c-43d3-45cf-a5f2-5ac730c146ec/console.log" append="off"/>
Nov 22 14:55:44 user nova-compute[74776]:     </serial>
Nov 22 14:55:44 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:55:44 user nova-compute[74776]:     <video>
Nov 22 14:55:44 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:55:44 user nova-compute[74776]:     </video>
Nov 22 14:55:44 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:55:44 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:55:44 user nova-compute[74776]:     </rng>
Nov 22 14:55:44 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:55:44 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:55:44 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:55:44 user nova-compute[74776]:     </memballoon>
Nov 22 14:55:44 user nova-compute[74776]:   </devices>
Nov 22 14:55:44 user nova-compute[74776]: </domain>
Nov 22 14:55:44 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:55:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1411440475',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1411440475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1411440475',id=48,image_ref='88d9b11c-20b9-48f9-afca-d5cc9e0201c6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLslWFMAVaSra48LUCAZDTvBY/PB/Ubdhwt0mjSC3Yk5io1k/rbWQqLvvg06md70c0XeUXXpinr1TThROUZRy9NtZOy1Uz/UbstR0VFINwHpkG56dAmj3+LnX8tK7Ibxyg==',key_name='tempest-keypair-1101352704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f6764076f2a428ea35c11476a3e7231',ramdisk_id='',reservation_id='r-m1dj7me8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1931721751',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1931721751-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1931721751',owner_user_name='tempest-TestVolumeBootPattern-1931721751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:55:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5cce524a8c6419aa76fb4b02861377e',uuid=d4c09c5c-43d3-45cf-a5f2-5ac730c146ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3900592-13f4-4d40-842d-31b6ad758a1b", "address": "fa:16:3e:4d:fe:3f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3900592-13", "ovs_interfaceid": "a3900592-13f4-4d40-842d-31b6ad758a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converting VIF {"id": "a3900592-13f4-4d40-842d-31b6ad758a1b", "address": "fa:16:3e:4d:fe:3f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3900592-13", "ovs_interfaceid": "a3900592-13f4-4d40-842d-31b6ad758a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:fe:3f,bridge_name='br-int',has_traffic_filtering=True,id=a3900592-13f4-4d40-842d-31b6ad758a1b,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3900592-13') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG os_vif [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:fe:3f,bridge_name='br-int',has_traffic_filtering=True,id=a3900592-13f4-4d40-842d-31b6ad758a1b,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3900592-13') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0068fc3-f4cb-5c02-9d2b-975ac6b86ffb', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3900592-13, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3900592-13, col_values=(('qos', UUID('62f5a03b-f140-4212-8fbd-5e82e4f17fcf')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3900592-13, col_values=(('external_ids', {'iface-id': 'a3900592-13f4-4d40-842d-31b6ad758a1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:fe:3f', 'vm-uuid': 'd4c09c5c-43d3-45cf-a5f2-5ac730c146ec'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:44 user nova-compute[74776]: INFO os_vif [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:fe:3f,bridge_name='br-int',has_traffic_filtering=True,id=a3900592-13f4-4d40-842d-31b6ad758a1b,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3900592-13')
Nov 22 14:55:44 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:55:44 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] No VIF found with MAC fa:16:3e:4d:fe:3f, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:55:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:46 user nova-compute[74776]: DEBUG nova.compute.manager [req-23a449d2-3650-4e36-8421-45af4ff72091 req-5113842d-93dd-413d-8aaf-6f1ef3c6fe30 service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Received event network-vif-plugged-a3900592-13f4-4d40-842d-31b6ad758a1b {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:55:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-23a449d2-3650-4e36-8421-45af4ff72091 req-5113842d-93dd-413d-8aaf-6f1ef3c6fe30 service nova] Acquiring lock "d4c09c5c-43d3-45cf-a5f2-5ac730c146ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:55:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-23a449d2-3650-4e36-8421-45af4ff72091 req-5113842d-93dd-413d-8aaf-6f1ef3c6fe30 service nova] Lock "d4c09c5c-43d3-45cf-a5f2-5ac730c146ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:55:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-23a449d2-3650-4e36-8421-45af4ff72091 req-5113842d-93dd-413d-8aaf-6f1ef3c6fe30 service nova] Lock "d4c09c5c-43d3-45cf-a5f2-5ac730c146ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:55:46 user nova-compute[74776]: DEBUG nova.compute.manager [req-23a449d2-3650-4e36-8421-45af4ff72091 req-5113842d-93dd-413d-8aaf-6f1ef3c6fe30 service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] No waiting events found dispatching network-vif-plugged-a3900592-13f4-4d40-842d-31b6ad758a1b {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:55:46 user nova-compute[74776]: WARNING nova.compute.manager [req-23a449d2-3650-4e36-8421-45af4ff72091 req-5113842d-93dd-413d-8aaf-6f1ef3c6fe30 service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Received unexpected event network-vif-plugged-a3900592-13f4-4d40-842d-31b6ad758a1b for instance with vm_state building and task_state spawning.
Nov 22 14:55:47 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:55:48 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:55:48 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:55:48 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Instance spawned successfully.
Nov 22 14:55:48 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:55:48 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:55:48 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:55:48 user nova-compute[74776]: INFO nova.compute.manager [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Took 4.79 seconds to spawn the instance on the hypervisor.
Nov 22 14:55:48 user nova-compute[74776]: DEBUG nova.compute.manager [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:55:48 user nova-compute[74776]: INFO nova.compute.manager [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Took 16.95 seconds to build instance.
Nov 22 14:55:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4ca59976-335f-40e5-b0ef-b27de06abb83 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "d4c09c5c-43d3-45cf-a5f2-5ac730c146ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.053s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:55:48 user nova-compute[74776]: DEBUG nova.compute.manager [req-fa55c0ec-f9f5-4e4b-8e90-54add11025e6 req-adcf74f9-e606-4a62-8b17-6ae9b2cfd0d2 service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Received event network-vif-plugged-a3900592-13f4-4d40-842d-31b6ad758a1b {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:55:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-fa55c0ec-f9f5-4e4b-8e90-54add11025e6 req-adcf74f9-e606-4a62-8b17-6ae9b2cfd0d2 service nova] Acquiring lock "d4c09c5c-43d3-45cf-a5f2-5ac730c146ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:55:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-fa55c0ec-f9f5-4e4b-8e90-54add11025e6 req-adcf74f9-e606-4a62-8b17-6ae9b2cfd0d2 service nova] Lock "d4c09c5c-43d3-45cf-a5f2-5ac730c146ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:55:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-fa55c0ec-f9f5-4e4b-8e90-54add11025e6 req-adcf74f9-e606-4a62-8b17-6ae9b2cfd0d2 service nova] Lock "d4c09c5c-43d3-45cf-a5f2-5ac730c146ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:55:48 user nova-compute[74776]: DEBUG nova.compute.manager [req-fa55c0ec-f9f5-4e4b-8e90-54add11025e6 req-adcf74f9-e606-4a62-8b17-6ae9b2cfd0d2 service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] No waiting events found dispatching network-vif-plugged-a3900592-13f4-4d40-842d-31b6ad758a1b {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:55:48 user nova-compute[74776]: WARNING nova.compute.manager [req-fa55c0ec-f9f5-4e4b-8e90-54add11025e6 req-adcf74f9-e606-4a62-8b17-6ae9b2cfd0d2 service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Received unexpected event network-vif-plugged-a3900592-13f4-4d40-842d-31b6ad758a1b for instance with vm_state active and task_state None.
Nov 22 14:55:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:51 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:55:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:55:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Acquiring lock "11b368b6-f796-4838-b762-ea4f6c80a798" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:56:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "11b368b6-f796-4838-b762-ea4f6c80a798" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:56:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Acquiring lock "11b368b6-f796-4838-b762-ea4f6c80a798-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:56:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "11b368b6-f796-4838-b762-ea4f6c80a798-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:56:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "11b368b6-f796-4838-b762-ea4f6c80a798-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:56:29 user nova-compute[74776]: INFO nova.compute.manager [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Terminating instance
Nov 22 14:56:29 user nova-compute[74776]: DEBUG nova.compute.manager [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:56:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG nova.compute.manager [req-f846b440-4ad0-47c3-941c-15b5efe97008 req-b6b28c74-27b4-416a-b5d8-ade4f21069a5 service nova] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Received event network-vif-unplugged-2317f0ac-1530-49e5-8aaf-a57db1103e0a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f846b440-4ad0-47c3-941c-15b5efe97008 req-b6b28c74-27b4-416a-b5d8-ade4f21069a5 service nova] Acquiring lock "11b368b6-f796-4838-b762-ea4f6c80a798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f846b440-4ad0-47c3-941c-15b5efe97008 req-b6b28c74-27b4-416a-b5d8-ade4f21069a5 service nova] Lock "11b368b6-f796-4838-b762-ea4f6c80a798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f846b440-4ad0-47c3-941c-15b5efe97008 req-b6b28c74-27b4-416a-b5d8-ade4f21069a5 service nova] Lock "11b368b6-f796-4838-b762-ea4f6c80a798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG nova.compute.manager [req-f846b440-4ad0-47c3-941c-15b5efe97008 req-b6b28c74-27b4-416a-b5d8-ade4f21069a5 service nova] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] No waiting events found dispatching network-vif-unplugged-2317f0ac-1530-49e5-8aaf-a57db1103e0a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG nova.compute.manager [req-f846b440-4ad0-47c3-941c-15b5efe97008 req-b6b28c74-27b4-416a-b5d8-ade4f21069a5 service nova] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Received event network-vif-unplugged-2317f0ac-1530-49e5-8aaf-a57db1103e0a for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:30 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Instance destroyed successfully.
Nov 22 14:56:30 user nova-compute[74776]: DEBUG nova.objects.instance [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lazy-loading 'resources' on Instance uuid 11b368b6-f796-4838-b762-ea4f6c80a798 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:54:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1634612933',display_name='tempest-VolumesActionsTest-instance-1634612933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1634612933',id=47,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:54:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd222b98813445e0af4430563b942958',ramdisk_id='',reservation_id='r-lzkhhyuq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1883387310',owner_user_name='tempest-VolumesActionsTest-1883387310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:54:45Z,user_data=None,user_id='e21ccdbbadfc4b8b81d96194dff23b38',uuid=11b368b6-f796-4838-b762-ea4f6c80a798,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2317f0ac-1530-49e5-8aaf-a57db1103e0a", "address": "fa:16:3e:0d:2f:ab", "network": {"id": "166a938b-0779-4198-8905-ebda4e19e289", "bridge": "br-int", "label": "tempest-VolumesActionsTest-102064328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd222b98813445e0af4430563b942958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2317f0ac-15", "ovs_interfaceid": "2317f0ac-1530-49e5-8aaf-a57db1103e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Converting VIF {"id": "2317f0ac-1530-49e5-8aaf-a57db1103e0a", "address": "fa:16:3e:0d:2f:ab", "network": {"id": "166a938b-0779-4198-8905-ebda4e19e289", "bridge": "br-int", "label": "tempest-VolumesActionsTest-102064328-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd222b98813445e0af4430563b942958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2317f0ac-15", "ovs_interfaceid": "2317f0ac-1530-49e5-8aaf-a57db1103e0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:2f:ab,bridge_name='br-int',has_traffic_filtering=True,id=2317f0ac-1530-49e5-8aaf-a57db1103e0a,network=Network(166a938b-0779-4198-8905-ebda4e19e289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2317f0ac-15') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG os_vif [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:2f:ab,bridge_name='br-int',has_traffic_filtering=True,id=2317f0ac-1530-49e5-8aaf-a57db1103e0a,network=Network(166a938b-0779-4198-8905-ebda4e19e289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2317f0ac-15') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2317f0ac-15, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7d5fb27-4e3e-4403-9fd0-6c8272df17cb) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:30 user nova-compute[74776]: INFO os_vif [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:2f:ab,bridge_name='br-int',has_traffic_filtering=True,id=2317f0ac-1530-49e5-8aaf-a57db1103e0a,network=Network(166a938b-0779-4198-8905-ebda4e19e289),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2317f0ac-15')
Nov 22 14:56:30 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Deleting instance files /opt/stack/data/nova/instances/11b368b6-f796-4838-b762-ea4f6c80a798_del
Nov 22 14:56:30 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Deletion of /opt/stack/data/nova/instances/11b368b6-f796-4838-b762-ea4f6c80a798_del complete
Nov 22 14:56:30 user nova-compute[74776]: INFO nova.compute.manager [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 22 14:56:30 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:56:30 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Took 0.48 seconds to deallocate network for instance.
Nov 22 14:56:30 user nova-compute[74776]: DEBUG nova.compute.manager [req-7ff9db1f-56c4-4e50-8bab-4584aa0beecf req-316af466-cdbb-423c-981b-dd832a35b9e7 service nova] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Received event network-vif-deleted-2317f0ac-1530-49e5-8aaf-a57db1103e0a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:56:30 user nova-compute[74776]: INFO nova.compute.manager [req-7ff9db1f-56c4-4e50-8bab-4584aa0beecf req-316af466-cdbb-423c-981b-dd832a35b9e7 service nova] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Neutron deleted interface 2317f0ac-1530-49e5-8aaf-a57db1103e0a; detaching it from the instance and deleting it from the info cache
Nov 22 14:56:30 user nova-compute[74776]: DEBUG nova.network.neutron [req-7ff9db1f-56c4-4e50-8bab-4584aa0beecf req-316af466-cdbb-423c-981b-dd832a35b9e7 service nova] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:56:30 user nova-compute[74776]: DEBUG nova.compute.manager [req-7ff9db1f-56c4-4e50-8bab-4584aa0beecf req-316af466-cdbb-423c-981b-dd832a35b9e7 service nova] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Detach interface failed, port_id=2317f0ac-1530-49e5-8aaf-a57db1103e0a, reason: Instance 11b368b6-f796-4838-b762-ea4f6c80a798 could not be found. {{(pid=74776) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 22 14:56:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:56:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:56:31 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:56:31 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:56:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:56:31 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Deleted allocations for instance 11b368b6-f796-4838-b762-ea4f6c80a798
Nov 22 14:56:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-eb8c51b3-1852-4d4a-ae1d-b4fa95fd8a26 tempest-VolumesActionsTest-1883387310 tempest-VolumesActionsTest-1883387310-project-member] Lock "11b368b6-f796-4838-b762-ea4f6c80a798" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.599s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:56:32 user nova-compute[74776]: DEBUG nova.compute.manager [req-06864972-c8aa-475e-acde-76e6ffa26f74 req-9b2f5c4c-8a70-4cc3-9fd5-1055c8a5a4f1 service nova] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Received event network-vif-plugged-2317f0ac-1530-49e5-8aaf-a57db1103e0a {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:56:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-06864972-c8aa-475e-acde-76e6ffa26f74 req-9b2f5c4c-8a70-4cc3-9fd5-1055c8a5a4f1 service nova] Acquiring lock "11b368b6-f796-4838-b762-ea4f6c80a798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:56:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-06864972-c8aa-475e-acde-76e6ffa26f74 req-9b2f5c4c-8a70-4cc3-9fd5-1055c8a5a4f1 service nova] Lock "11b368b6-f796-4838-b762-ea4f6c80a798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:56:32 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-06864972-c8aa-475e-acde-76e6ffa26f74 req-9b2f5c4c-8a70-4cc3-9fd5-1055c8a5a4f1 service nova] Lock "11b368b6-f796-4838-b762-ea4f6c80a798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:56:32 user nova-compute[74776]: DEBUG nova.compute.manager [req-06864972-c8aa-475e-acde-76e6ffa26f74 req-9b2f5c4c-8a70-4cc3-9fd5-1055c8a5a4f1 service nova] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] No waiting events found dispatching network-vif-plugged-2317f0ac-1530-49e5-8aaf-a57db1103e0a {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:56:32 user nova-compute[74776]: WARNING nova.compute.manager [req-06864972-c8aa-475e-acde-76e6ffa26f74 req-9b2f5c4c-8a70-4cc3-9fd5-1055c8a5a4f1 service nova] [instance: 11b368b6-f796-4838-b762-ea4f6c80a798] Received unexpected event network-vif-plugged-2317f0ac-1530-49e5-8aaf-a57db1103e0a for instance with vm_state deleted and task_state None.
Nov 22 14:56:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:36 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:56:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:56:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Didn't find any instances for network info cache update. {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 14:56:37 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:56:38 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:56:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:56:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:56:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:56:38 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:56:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:56:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:56:39 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:56:39 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:56:39 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8799MB free_disk=25.082496643066406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:56:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:56:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:56:39 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 7df01019-c4b3-4626-8e05-a834f44e3019 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:56:39 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance d4c09c5c-43d3-45cf-a5f2-5ac730c146ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:56:39 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:56:39 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:56:39 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:56:39 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:56:39 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:56:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:56:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:56:41 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:56:41 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:56:43 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:56:44 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:56:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:56:46 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:56:49 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:56:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:52 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:56:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:56:58 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:57:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:57:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:57:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:57:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:57:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:57:22 user nova-compute[74776]: DEBUG nova.compute.manager [req-cf6a563d-29da-4e62-8039-d8fcb1f49784 req-f89f6d81-1553-4a1c-a177-1b1735e1fcd2 service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Received event network-changed-a3900592-13f4-4d40-842d-31b6ad758a1b {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:57:22 user nova-compute[74776]: DEBUG nova.compute.manager [req-cf6a563d-29da-4e62-8039-d8fcb1f49784 req-f89f6d81-1553-4a1c-a177-1b1735e1fcd2 service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Refreshing instance network info cache due to event network-changed-a3900592-13f4-4d40-842d-31b6ad758a1b. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:57:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cf6a563d-29da-4e62-8039-d8fcb1f49784 req-f89f6d81-1553-4a1c-a177-1b1735e1fcd2 service nova] Acquiring lock "refresh_cache-d4c09c5c-43d3-45cf-a5f2-5ac730c146ec" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:57:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cf6a563d-29da-4e62-8039-d8fcb1f49784 req-f89f6d81-1553-4a1c-a177-1b1735e1fcd2 service nova] Acquired lock "refresh_cache-d4c09c5c-43d3-45cf-a5f2-5ac730c146ec" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:57:22 user nova-compute[74776]: DEBUG nova.network.neutron [req-cf6a563d-29da-4e62-8039-d8fcb1f49784 req-f89f6d81-1553-4a1c-a177-1b1735e1fcd2 service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Refreshing network info cache for port a3900592-13f4-4d40-842d-31b6ad758a1b {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:57:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "d4c09c5c-43d3-45cf-a5f2-5ac730c146ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:57:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "d4c09c5c-43d3-45cf-a5f2-5ac730c146ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:57:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "d4c09c5c-43d3-45cf-a5f2-5ac730c146ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:57:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "d4c09c5c-43d3-45cf-a5f2-5ac730c146ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:57:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "d4c09c5c-43d3-45cf-a5f2-5ac730c146ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:57:22 user nova-compute[74776]: INFO nova.compute.manager [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Terminating instance
Nov 22 14:57:22 user nova-compute[74776]: DEBUG nova.compute.manager [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:57:22 user nova-compute[74776]: DEBUG nova.network.neutron [req-cf6a563d-29da-4e62-8039-d8fcb1f49784 req-f89f6d81-1553-4a1c-a177-1b1735e1fcd2 service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Updated VIF entry in instance network info cache for port a3900592-13f4-4d40-842d-31b6ad758a1b. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:57:22 user nova-compute[74776]: DEBUG nova.network.neutron [req-cf6a563d-29da-4e62-8039-d8fcb1f49784 req-f89f6d81-1553-4a1c-a177-1b1735e1fcd2 service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Updating instance_info_cache with network_info: [{"id": "a3900592-13f4-4d40-842d-31b6ad758a1b", "address": "fa:16:3e:4d:fe:3f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3900592-13", "ovs_interfaceid": "a3900592-13f4-4d40-842d-31b6ad758a1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:57:22 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cf6a563d-29da-4e62-8039-d8fcb1f49784 req-f89f6d81-1553-4a1c-a177-1b1735e1fcd2 service nova] Releasing lock "refresh_cache-d4c09c5c-43d3-45cf-a5f2-5ac730c146ec" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:57:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:57:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-5c62a411-e78f-41ad-890f-2abf0cf19ed7 req-6e71e9d4-858a-4e76-a535-bfc0f4c061ef service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Received event network-vif-unplugged-a3900592-13f4-4d40-842d-31b6ad758a1b {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5c62a411-e78f-41ad-890f-2abf0cf19ed7 req-6e71e9d4-858a-4e76-a535-bfc0f4c061ef service nova] Acquiring lock "d4c09c5c-43d3-45cf-a5f2-5ac730c146ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5c62a411-e78f-41ad-890f-2abf0cf19ed7 req-6e71e9d4-858a-4e76-a535-bfc0f4c061ef service nova] Lock "d4c09c5c-43d3-45cf-a5f2-5ac730c146ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5c62a411-e78f-41ad-890f-2abf0cf19ed7 req-6e71e9d4-858a-4e76-a535-bfc0f4c061ef service nova] Lock "d4c09c5c-43d3-45cf-a5f2-5ac730c146ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-5c62a411-e78f-41ad-890f-2abf0cf19ed7 req-6e71e9d4-858a-4e76-a535-bfc0f4c061ef service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] No waiting events found dispatching network-vif-unplugged-a3900592-13f4-4d40-842d-31b6ad758a1b {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG nova.compute.manager [req-5c62a411-e78f-41ad-890f-2abf0cf19ed7 req-6e71e9d4-858a-4e76-a535-bfc0f4c061ef service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Received event network-vif-unplugged-a3900592-13f4-4d40-842d-31b6ad758a1b for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:57:23 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Instance destroyed successfully.
Nov 22 14:57:23 user nova-compute[74776]: DEBUG nova.objects.instance [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lazy-loading 'resources' on Instance uuid d4c09c5c-43d3-45cf-a5f2-5ac730c146ec {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:55:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1411440475',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1411440475',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1411440475',id=48,image_ref='88d9b11c-20b9-48f9-afca-d5cc9e0201c6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLslWFMAVaSra48LUCAZDTvBY/PB/Ubdhwt0mjSC3Yk5io1k/rbWQqLvvg06md70c0XeUXXpinr1TThROUZRy9NtZOy1Uz/UbstR0VFINwHpkG56dAmj3+LnX8tK7Ibxyg==',key_name='tempest-keypair-1101352704',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:55:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f6764076f2a428ea35c11476a3e7231',ramdisk_id='',reservation_id='r-m1dj7me8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1931721751',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1931721751-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1931721751',owner_user_name='tempest-TestVolumeBootPattern-1931721751-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:55:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5cce524a8c6419aa76fb4b02861377e',uuid=d4c09c5c-43d3-45cf-a5f2-5ac730c146ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3900592-13f4-4d40-842d-31b6ad758a1b", "address": "fa:16:3e:4d:fe:3f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3900592-13", "ovs_interfaceid": "a3900592-13f4-4d40-842d-31b6ad758a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converting VIF {"id": "a3900592-13f4-4d40-842d-31b6ad758a1b", "address": "fa:16:3e:4d:fe:3f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3900592-13", "ovs_interfaceid": "a3900592-13f4-4d40-842d-31b6ad758a1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:fe:3f,bridge_name='br-int',has_traffic_filtering=True,id=a3900592-13f4-4d40-842d-31b6ad758a1b,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3900592-13') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG os_vif [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:fe:3f,bridge_name='br-int',has_traffic_filtering=True,id=a3900592-13f4-4d40-842d-31b6ad758a1b,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3900592-13') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3900592-13, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62f5a03b-f140-4212-8fbd-5e82e4f17fcf) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:57:23 user nova-compute[74776]: INFO os_vif [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:fe:3f,bridge_name='br-int',has_traffic_filtering=True,id=a3900592-13f4-4d40-842d-31b6ad758a1b,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3900592-13')
Nov 22 14:57:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SHzxKesn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:57:23 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:57:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d5bfbd-9f42-4b53-ae43-380a29db6a8c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:57:23 user nova-compute[74776]: No targets found.
Nov 22 14:57:23 user nova-compute[74776]: iSNS:
Nov 22 14:57:23 user nova-compute[74776]: No targets found.
Nov 22 14:57:23 user nova-compute[74776]: STATIC:
Nov 22 14:57:23 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626
Nov 22 14:57:23 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:57:23 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:57:23 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0
Nov 22 14:57:23 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:57:23 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:57:23 user nova-compute[74776]: FIRMWARE:
Nov 22 14:57:23 user nova-compute[74776]: No targets found.
Nov 22 14:57:23 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:57:23 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:57:23 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c910db1-6367-4b96-9198-aa94677bb79f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd81df0d-530e-45c0-afc1-afece3db0080]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 (non-flash)
Nov 22 14:57:23 user nova-compute[74776]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 (non-flash)
Nov 22 14:57:23 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 (non-flash)
Nov 22 14:57:23 user nova-compute[74776]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 (non-flash)
Nov 22 14:57:23 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c781b30a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626'): ({'sdc'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Removing single pathed devices sdc {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fed69d9-7d45-4bc0-a38a-93d1ed7f3b6f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[34850206-9908-4b35-ade9-d645238cc642]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Flushing IO for device /dev/sdc {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[424e908c-751b-4d4e-9256-483e9d325712]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfea61e9-22c3-44c7-91a1-75878622d8e9]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a24dfd2-50f3-40b1-b8e0-e6a32fcf565c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b57550c-06e5-4387-a0d3-d80dadba78ec]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626, portal: 172.16.0.220,3260]
Nov 22 14:57:23 user nova-compute[74776]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626, portal: 172.16.0.220,3260] successful.
Nov 22 14:57:23 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7ebcc7-702d-4b43-8f68-f806d4d18626 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8180338-7723-45c4-9bbc-e47089f4aaeb]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] <== disconnect_volume: return (305ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:57:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:57:23 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Deleting instance files /opt/stack/data/nova/instances/d4c09c5c-43d3-45cf-a5f2-5ac730c146ec_del
Nov 22 14:57:23 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Deletion of /opt/stack/data/nova/instances/d4c09c5c-43d3-45cf-a5f2-5ac730c146ec_del complete
Nov 22 14:57:24 user nova-compute[74776]: INFO nova.compute.manager [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 22 14:57:24 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:57:24 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:57:24 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:57:24 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:57:24 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Took 0.98 seconds to deallocate network for instance.
Nov 22 14:57:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-5620ea82-8c28-48cc-952c-942661fc78b3 req-22bd8df1-eafd-432a-ba49-04bd4cc7e4e9 service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Received event network-vif-plugged-a3900592-13f4-4d40-842d-31b6ad758a1b {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:57:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5620ea82-8c28-48cc-952c-942661fc78b3 req-22bd8df1-eafd-432a-ba49-04bd4cc7e4e9 service nova] Acquiring lock "d4c09c5c-43d3-45cf-a5f2-5ac730c146ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:57:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5620ea82-8c28-48cc-952c-942661fc78b3 req-22bd8df1-eafd-432a-ba49-04bd4cc7e4e9 service nova] Lock "d4c09c5c-43d3-45cf-a5f2-5ac730c146ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:57:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-5620ea82-8c28-48cc-952c-942661fc78b3 req-22bd8df1-eafd-432a-ba49-04bd4cc7e4e9 service nova] Lock "d4c09c5c-43d3-45cf-a5f2-5ac730c146ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:57:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-5620ea82-8c28-48cc-952c-942661fc78b3 req-22bd8df1-eafd-432a-ba49-04bd4cc7e4e9 service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] No waiting events found dispatching network-vif-plugged-a3900592-13f4-4d40-842d-31b6ad758a1b {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:57:25 user nova-compute[74776]: WARNING nova.compute.manager [req-5620ea82-8c28-48cc-952c-942661fc78b3 req-22bd8df1-eafd-432a-ba49-04bd4cc7e4e9 service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Received unexpected event network-vif-plugged-a3900592-13f4-4d40-842d-31b6ad758a1b for instance with vm_state active and task_state deleting.
Nov 22 14:57:25 user nova-compute[74776]: DEBUG nova.compute.manager [req-5620ea82-8c28-48cc-952c-942661fc78b3 req-22bd8df1-eafd-432a-ba49-04bd4cc7e4e9 service nova] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Received event network-vif-deleted-a3900592-13f4-4d40-842d-31b6ad758a1b {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:57:25 user nova-compute[74776]: INFO nova.compute.manager [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Took 0.76 seconds to detach 1 volumes for instance.
Nov 22 14:57:25 user nova-compute[74776]: DEBUG nova.compute.manager [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: d4c09c5c-43d3-45cf-a5f2-5ac730c146ec] Deleting volume: 3a7ebcc7-702d-4b43-8f68-f806d4d18626 {{(pid=74776) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 22 14:57:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:57:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:57:26 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:57:26 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:57:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:57:26 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Deleted allocations for instance d4c09c5c-43d3-45cf-a5f2-5ac730c146ec
Nov 22 14:57:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6d7f9605-cb54-4aa6-804a-1199961efc54 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "d4c09c5c-43d3-45cf-a5f2-5ac730c146ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.401s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:57:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:57:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:57:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:57:36 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:57:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:57:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 14:57:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-7df01019-c4b3-4626-8e05-a834f44e3019" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:57:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-7df01019-c4b3-4626-8e05-a834f44e3019" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:57:36 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:57:36 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid 7df01019-c4b3-4626-8e05-a834f44e3019 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:57:37 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Updating instance_info_cache with network_info: [{"id": "d50b55bf-450e-4227-9165-a36343344d6e", "address": "fa:16:3e:49:10:11", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd50b55bf-45", "ovs_interfaceid": "d50b55bf-450e-4227-9165-a36343344d6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:57:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-7df01019-c4b3-4626-8e05-a834f44e3019" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:57:37 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:57:37 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:57:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:57:38 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:57:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:57:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:57:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:57:38 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:57:38 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:57:39 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:57:39 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:57:39 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8875MB free_disk=24.4390869140625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:57:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:57:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:57:40 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 7df01019-c4b3-4626-8e05-a834f44e3019 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:57:40 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:57:40 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:57:40 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing inventories for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 14:57:40 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating ProviderTree inventory for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 14:57:40 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating inventory in ProviderTree for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 14:57:40 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing aggregate associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, aggregates: None {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 14:57:40 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing trait associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 14:57:40 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:57:40 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:57:40 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:57:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.803s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:57:42 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:57:42 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:57:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:57:44 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:57:45 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:57:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:57:48 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:57:51 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:57:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:57:52 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:57:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:57:53 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:57:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:57:58 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:57:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:06 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:58:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 14:58:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] There are 0 instances to clean {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 14:58:07 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:58:07 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74776) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 14:58:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG nova.compute.manager [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:58:11 user nova-compute[74776]: INFO nova.compute.claims [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Claim successful on node user
Nov 22 14:58:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.221s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG nova.compute.manager [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG nova.compute.manager [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG nova.network.neutron [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:58:11 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:58:11 user nova-compute[74776]: DEBUG nova.compute.manager [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG nova.policy [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '874a278f90444a69b1824c4d161efe99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41137c06323a439f987365dc7b885fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG nova.compute.manager [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:58:11 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Creating image(s)
Nov 22 14:58:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "/opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "/opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.181s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:58:11 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.181s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk 1073741824" returned: 0 in 0.060s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.183s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG nova.network.neutron [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Successfully created port: 29c2b1de-7b59-4466-941f-31cbaf33283b {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Cannot resize image /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Ensure instance console log exists: /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG nova.network.neutron [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Successfully updated port: 29c2b1de-7b59-4466-941f-31cbaf33283b {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquired lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG nova.network.neutron [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-29f6baa4-7aca-407e-a4ef-f09c5368da50 req-c0eec9b2-5e8d-475d-b2e8-44ed71a0389d service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Received event network-changed-29c2b1de-7b59-4466-941f-31cbaf33283b {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-29f6baa4-7aca-407e-a4ef-f09c5368da50 req-c0eec9b2-5e8d-475d-b2e8-44ed71a0389d service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Refreshing instance network info cache due to event network-changed-29c2b1de-7b59-4466-941f-31cbaf33283b. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:58:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29f6baa4-7aca-407e-a4ef-f09c5368da50 req-c0eec9b2-5e8d-475d-b2e8-44ed71a0389d service nova] Acquiring lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.network.neutron [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.network.neutron [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Updating instance_info_cache with network_info: [{"id": "29c2b1de-7b59-4466-941f-31cbaf33283b", "address": "fa:16:3e:93:2c:72", "network": {"id": "ab23dced-504d-456e-97eb-bbf452866cd7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1753613074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41137c06323a439f987365dc7b885fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c2b1de-7b", "ovs_interfaceid": "29c2b1de-7b59-4466-941f-31cbaf33283b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Releasing lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.compute.manager [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Instance network_info: |[{"id": "29c2b1de-7b59-4466-941f-31cbaf33283b", "address": "fa:16:3e:93:2c:72", "network": {"id": "ab23dced-504d-456e-97eb-bbf452866cd7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1753613074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41137c06323a439f987365dc7b885fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c2b1de-7b", "ovs_interfaceid": "29c2b1de-7b59-4466-941f-31cbaf33283b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29f6baa4-7aca-407e-a4ef-f09c5368da50 req-c0eec9b2-5e8d-475d-b2e8-44ed71a0389d service nova] Acquired lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.network.neutron [req-29f6baa4-7aca-407e-a4ef-f09c5368da50 req-c0eec9b2-5e8d-475d-b2e8-44ed71a0389d service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Refreshing network info cache for port 29c2b1de-7b59-4466-941f-31cbaf33283b {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Start _get_guest_xml network_info=[{"id": "29c2b1de-7b59-4466-941f-31cbaf33283b", "address": "fa:16:3e:93:2c:72", "network": {"id": "ab23dced-504d-456e-97eb-bbf452866cd7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1753613074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41137c06323a439f987365dc7b885fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c2b1de-7b", "ovs_interfaceid": "29c2b1de-7b59-4466-941f-31cbaf33283b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:58:13 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:58:13 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1623062926',display_name='tempest-SnapshotDataIntegrityTests-server-1623062926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1623062926',id=49,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH69bfY3T4FVEUA5MXSB19jTWlL/AvFn5pTobr755Z162N/1t5IgP34aFa5YYV1rubJh1Eb8TVLqJFNis0qC3EeHf5AWpGhG4RFIqwLI015HO+o7flLXfBHYYngGAUQF4A==',key_name='tempest-keypair-1198651069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41137c06323a439f987365dc7b885fd5',ramdisk_id='',reservation_id='r-f4c6uef4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1997075541',owner_user_name='tempest-SnapshotDataIntegrityTests-1997075541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='874a278f90444a69b1824c4d161efe99',uuid=9d4fd442-1998-409d-84b0-c76ec9a5670d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29c2b1de-7b59-4466-941f-31cbaf33283b", "address": "fa:16:3e:93:2c:72", "network": {"id": "ab23dced-504d-456e-97eb-bbf452866cd7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1753613074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41137c06323a439f987365dc7b885fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c2b1de-7b", "ovs_interfaceid": "29c2b1de-7b59-4466-941f-31cbaf33283b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Converting VIF {"id": "29c2b1de-7b59-4466-941f-31cbaf33283b", "address": "fa:16:3e:93:2c:72", "network": {"id": "ab23dced-504d-456e-97eb-bbf452866cd7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1753613074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41137c06323a439f987365dc7b885fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c2b1de-7b", "ovs_interfaceid": "29c2b1de-7b59-4466-941f-31cbaf33283b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=29c2b1de-7b59-4466-941f-31cbaf33283b,network=Network(ab23dced-504d-456e-97eb-bbf452866cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c2b1de-7b') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.objects.instance [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:58:13 user nova-compute[74776]:   <uuid>9d4fd442-1998-409d-84b0-c76ec9a5670d</uuid>
Nov 22 14:58:13 user nova-compute[74776]:   <name>instance-00000031</name>
Nov 22 14:58:13 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:58:13 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:58:13 user nova-compute[74776]:   <metadata>
Nov 22 14:58:13 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:58:13 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:58:13 user nova-compute[74776]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1623062926</nova:name>
Nov 22 14:58:13 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:58:13</nova:creationTime>
Nov 22 14:58:13 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:58:13 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:58:13 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:58:13 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:58:13 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:58:13 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:58:13 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:58:13 user nova-compute[74776]:       <nova:owner>
Nov 22 14:58:13 user nova-compute[74776]:         <nova:user uuid="874a278f90444a69b1824c4d161efe99">tempest-SnapshotDataIntegrityTests-1997075541-project-member</nova:user>
Nov 22 14:58:13 user nova-compute[74776]:         <nova:project uuid="41137c06323a439f987365dc7b885fd5">tempest-SnapshotDataIntegrityTests-1997075541</nova:project>
Nov 22 14:58:13 user nova-compute[74776]:       </nova:owner>
Nov 22 14:58:13 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 14:58:13 user nova-compute[74776]:       <nova:ports>
Nov 22 14:58:13 user nova-compute[74776]:         <nova:port uuid="29c2b1de-7b59-4466-941f-31cbaf33283b">
Nov 22 14:58:13 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 22 14:58:13 user nova-compute[74776]:         </nova:port>
Nov 22 14:58:13 user nova-compute[74776]:       </nova:ports>
Nov 22 14:58:13 user nova-compute[74776]:     </nova:instance>
Nov 22 14:58:13 user nova-compute[74776]:   </metadata>
Nov 22 14:58:13 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:58:13 user nova-compute[74776]:     <system>
Nov 22 14:58:13 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:58:13 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:58:13 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:58:13 user nova-compute[74776]:       <entry name="serial">9d4fd442-1998-409d-84b0-c76ec9a5670d</entry>
Nov 22 14:58:13 user nova-compute[74776]:       <entry name="uuid">9d4fd442-1998-409d-84b0-c76ec9a5670d</entry>
Nov 22 14:58:13 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:58:13 user nova-compute[74776]:     </system>
Nov 22 14:58:13 user nova-compute[74776]:   </sysinfo>
Nov 22 14:58:13 user nova-compute[74776]:   <os>
Nov 22 14:58:13 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:58:13 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:58:13 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:58:13 user nova-compute[74776]:   </os>
Nov 22 14:58:13 user nova-compute[74776]:   <features>
Nov 22 14:58:13 user nova-compute[74776]:     <acpi/>
Nov 22 14:58:13 user nova-compute[74776]:     <apic/>
Nov 22 14:58:13 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:58:13 user nova-compute[74776]:   </features>
Nov 22 14:58:13 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:58:13 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:58:13 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:58:13 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:58:13 user nova-compute[74776]:   </clock>
Nov 22 14:58:13 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:58:13 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:58:13 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:58:13 user nova-compute[74776]:   </cpu>
Nov 22 14:58:13 user nova-compute[74776]:   <devices>
Nov 22 14:58:13 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 14:58:13 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 14:58:13 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk"/>
Nov 22 14:58:13 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:58:13 user nova-compute[74776]:     </disk>
Nov 22 14:58:13 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:58:13 user nova-compute[74776]:       <mac address="fa:16:3e:93:2c:72"/>
Nov 22 14:58:13 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:58:13 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:58:13 user nova-compute[74776]:       <target dev="tap29c2b1de-7b"/>
Nov 22 14:58:13 user nova-compute[74776]:     </interface>
Nov 22 14:58:13 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:58:13 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/console.log" append="off"/>
Nov 22 14:58:13 user nova-compute[74776]:     </serial>
Nov 22 14:58:13 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:58:13 user nova-compute[74776]:     <video>
Nov 22 14:58:13 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:58:13 user nova-compute[74776]:     </video>
Nov 22 14:58:13 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:58:13 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:58:13 user nova-compute[74776]:     </rng>
Nov 22 14:58:13 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:58:13 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:58:13 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:58:13 user nova-compute[74776]:     </memballoon>
Nov 22 14:58:13 user nova-compute[74776]:   </devices>
Nov 22 14:58:13 user nova-compute[74776]: </domain>
Nov 22 14:58:13 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1623062926',display_name='tempest-SnapshotDataIntegrityTests-server-1623062926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1623062926',id=49,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH69bfY3T4FVEUA5MXSB19jTWlL/AvFn5pTobr755Z162N/1t5IgP34aFa5YYV1rubJh1Eb8TVLqJFNis0qC3EeHf5AWpGhG4RFIqwLI015HO+o7flLXfBHYYngGAUQF4A==',key_name='tempest-keypair-1198651069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41137c06323a439f987365dc7b885fd5',ramdisk_id='',reservation_id='r-f4c6uef4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1997075541',owner_user_name='tempest-SnapshotDataIntegrityTests-1997075541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:58:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='874a278f90444a69b1824c4d161efe99',uuid=9d4fd442-1998-409d-84b0-c76ec9a5670d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29c2b1de-7b59-4466-941f-31cbaf33283b", "address": "fa:16:3e:93:2c:72", "network": {"id": "ab23dced-504d-456e-97eb-bbf452866cd7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1753613074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41137c06323a439f987365dc7b885fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c2b1de-7b", "ovs_interfaceid": "29c2b1de-7b59-4466-941f-31cbaf33283b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Converting VIF {"id": "29c2b1de-7b59-4466-941f-31cbaf33283b", "address": "fa:16:3e:93:2c:72", "network": {"id": "ab23dced-504d-456e-97eb-bbf452866cd7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1753613074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41137c06323a439f987365dc7b885fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c2b1de-7b", "ovs_interfaceid": "29c2b1de-7b59-4466-941f-31cbaf33283b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=29c2b1de-7b59-4466-941f-31cbaf33283b,network=Network(ab23dced-504d-456e-97eb-bbf452866cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c2b1de-7b') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG os_vif [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=29c2b1de-7b59-4466-941f-31cbaf33283b,network=Network(ab23dced-504d-456e-97eb-bbf452866cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c2b1de-7b') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56dcdbe7-c08c-58d8-a14b-e20053bf779d', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29c2b1de-7b, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29c2b1de-7b, col_values=(('qos', UUID('82fdbc52-cb69-4bb8-9ccf-78c8bc444e2b')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29c2b1de-7b, col_values=(('external_ids', {'iface-id': '29c2b1de-7b59-4466-941f-31cbaf33283b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:2c:72', 'vm-uuid': '9d4fd442-1998-409d-84b0-c76ec9a5670d'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:13 user nova-compute[74776]: INFO os_vif [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=29c2b1de-7b59-4466-941f-31cbaf33283b,network=Network(ab23dced-504d-456e-97eb-bbf452866cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c2b1de-7b')
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] No VIF found with MAC fa:16:3e:93:2c:72, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.network.neutron [req-29f6baa4-7aca-407e-a4ef-f09c5368da50 req-c0eec9b2-5e8d-475d-b2e8-44ed71a0389d service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Updated VIF entry in instance network info cache for port 29c2b1de-7b59-4466-941f-31cbaf33283b. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG nova.network.neutron [req-29f6baa4-7aca-407e-a4ef-f09c5368da50 req-c0eec9b2-5e8d-475d-b2e8-44ed71a0389d service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Updating instance_info_cache with network_info: [{"id": "29c2b1de-7b59-4466-941f-31cbaf33283b", "address": "fa:16:3e:93:2c:72", "network": {"id": "ab23dced-504d-456e-97eb-bbf452866cd7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1753613074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41137c06323a439f987365dc7b885fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c2b1de-7b", "ovs_interfaceid": "29c2b1de-7b59-4466-941f-31cbaf33283b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:58:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29f6baa4-7aca-407e-a4ef-f09c5368da50 req-c0eec9b2-5e8d-475d-b2e8-44ed71a0389d service nova] Releasing lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:58:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-0329c81e-342e-4899-8340-e77439cb6985 req-9ccad79b-81b0-4a77-a6c0-01d1efdeacad service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Received event network-vif-plugged-29c2b1de-7b59-4466-941f-31cbaf33283b {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:58:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0329c81e-342e-4899-8340-e77439cb6985 req-9ccad79b-81b0-4a77-a6c0-01d1efdeacad service nova] Acquiring lock "9d4fd442-1998-409d-84b0-c76ec9a5670d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:58:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0329c81e-342e-4899-8340-e77439cb6985 req-9ccad79b-81b0-4a77-a6c0-01d1efdeacad service nova] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:58:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0329c81e-342e-4899-8340-e77439cb6985 req-9ccad79b-81b0-4a77-a6c0-01d1efdeacad service nova] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:58:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-0329c81e-342e-4899-8340-e77439cb6985 req-9ccad79b-81b0-4a77-a6c0-01d1efdeacad service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] No waiting events found dispatching network-vif-plugged-29c2b1de-7b59-4466-941f-31cbaf33283b {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:58:14 user nova-compute[74776]: WARNING nova.compute.manager [req-0329c81e-342e-4899-8340-e77439cb6985 req-9ccad79b-81b0-4a77-a6c0-01d1efdeacad service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Received unexpected event network-vif-plugged-29c2b1de-7b59-4466-941f-31cbaf33283b for instance with vm_state building and task_state spawning.
Nov 22 14:58:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "7df01019-c4b3-4626-8e05-a834f44e3019" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:58:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "7df01019-c4b3-4626-8e05-a834f44e3019" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:58:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:58:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:58:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:58:16 user nova-compute[74776]: INFO nova.compute.manager [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Terminating instance
Nov 22 14:58:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 14:58:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:58:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:58:16 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Instance spawned successfully.
Nov 22 14:58:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-26d5b453-5083-4ac8-a4ba-5f8c05f446ac req-ef606198-3f9d-4d8e-bbf9-29a5ee9f8fab service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Received event network-vif-plugged-29c2b1de-7b59-4466-941f-31cbaf33283b {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-26d5b453-5083-4ac8-a4ba-5f8c05f446ac req-ef606198-3f9d-4d8e-bbf9-29a5ee9f8fab service nova] Acquiring lock "9d4fd442-1998-409d-84b0-c76ec9a5670d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-26d5b453-5083-4ac8-a4ba-5f8c05f446ac req-ef606198-3f9d-4d8e-bbf9-29a5ee9f8fab service nova] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-26d5b453-5083-4ac8-a4ba-5f8c05f446ac req-ef606198-3f9d-4d8e-bbf9-29a5ee9f8fab service nova] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-26d5b453-5083-4ac8-a4ba-5f8c05f446ac req-ef606198-3f9d-4d8e-bbf9-29a5ee9f8fab service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] No waiting events found dispatching network-vif-plugged-29c2b1de-7b59-4466-941f-31cbaf33283b {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:58:17 user nova-compute[74776]: WARNING nova.compute.manager [req-26d5b453-5083-4ac8-a4ba-5f8c05f446ac req-ef606198-3f9d-4d8e-bbf9-29a5ee9f8fab service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Received unexpected event network-vif-plugged-29c2b1de-7b59-4466-941f-31cbaf33283b for instance with vm_state building and task_state spawning.
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-26d5b453-5083-4ac8-a4ba-5f8c05f446ac req-ef606198-3f9d-4d8e-bbf9-29a5ee9f8fab service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Received event network-vif-unplugged-d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-26d5b453-5083-4ac8-a4ba-5f8c05f446ac req-ef606198-3f9d-4d8e-bbf9-29a5ee9f8fab service nova] Acquiring lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-26d5b453-5083-4ac8-a4ba-5f8c05f446ac req-ef606198-3f9d-4d8e-bbf9-29a5ee9f8fab service nova] Lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-26d5b453-5083-4ac8-a4ba-5f8c05f446ac req-ef606198-3f9d-4d8e-bbf9-29a5ee9f8fab service nova] Lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-26d5b453-5083-4ac8-a4ba-5f8c05f446ac req-ef606198-3f9d-4d8e-bbf9-29a5ee9f8fab service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] No waiting events found dispatching network-vif-unplugged-d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-26d5b453-5083-4ac8-a4ba-5f8c05f446ac req-ef606198-3f9d-4d8e-bbf9-29a5ee9f8fab service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Received event network-vif-unplugged-d50b55bf-450e-4227-9165-a36343344d6e for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-26d5b453-5083-4ac8-a4ba-5f8c05f446ac req-ef606198-3f9d-4d8e-bbf9-29a5ee9f8fab service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Received event network-vif-plugged-d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-26d5b453-5083-4ac8-a4ba-5f8c05f446ac req-ef606198-3f9d-4d8e-bbf9-29a5ee9f8fab service nova] Acquiring lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-26d5b453-5083-4ac8-a4ba-5f8c05f446ac req-ef606198-3f9d-4d8e-bbf9-29a5ee9f8fab service nova] Lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-26d5b453-5083-4ac8-a4ba-5f8c05f446ac req-ef606198-3f9d-4d8e-bbf9-29a5ee9f8fab service nova] Lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.compute.manager [req-26d5b453-5083-4ac8-a4ba-5f8c05f446ac req-ef606198-3f9d-4d8e-bbf9-29a5ee9f8fab service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] No waiting events found dispatching network-vif-plugged-d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:58:17 user nova-compute[74776]: WARNING nova.compute.manager [req-26d5b453-5083-4ac8-a4ba-5f8c05f446ac req-ef606198-3f9d-4d8e-bbf9-29a5ee9f8fab service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Received unexpected event network-vif-plugged-d50b55bf-450e-4227-9165-a36343344d6e for instance with vm_state active and task_state deleting.
Nov 22 14:58:17 user nova-compute[74776]: INFO nova.compute.manager [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.compute.manager [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:58:17 user nova-compute[74776]: INFO nova.compute.manager [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Took 5.89 seconds to build instance.
Nov 22 14:58:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-07293321-886a-4a41-85ee-37f724d5593e tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.983s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:17 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Instance destroyed successfully.
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lazy-loading 'resources' on Instance uuid 7df01019-c4b3-4626-8e05-a834f44e3019 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:53:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1394158077',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1394158077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1394158077',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcm+UsaoZV6p/DwCWkXsAqfarU4nJg8ih4S0tmURCf0k4i0LBVJhtnpc2QVtr57+BzMCCfzs26NoNrr+wWosQN0nSj4pqLp1lUC4ehZ+qH0daFhijJzhORavEp8xPqANg==',key_name='tempest-keypair-1185117298',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:53:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f6764076f2a428ea35c11476a3e7231',ramdisk_id='',reservation_id='r-g1afd8fm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1931721751',owner_user_name='tempest-TestVolumeBootPattern-1931721751-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5cce524a8c6419aa76fb4b02861377e',uuid=7df01019-c4b3-4626-8e05-a834f44e3019,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d50b55bf-450e-4227-9165-a36343344d6e", "address": "fa:16:3e:49:10:11", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd50b55bf-45", "ovs_interfaceid": "d50b55bf-450e-4227-9165-a36343344d6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converting VIF {"id": "d50b55bf-450e-4227-9165-a36343344d6e", "address": "fa:16:3e:49:10:11", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd50b55bf-45", "ovs_interfaceid": "d50b55bf-450e-4227-9165-a36343344d6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:10:11,bridge_name='br-int',has_traffic_filtering=True,id=d50b55bf-450e-4227-9165-a36343344d6e,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd50b55bf-45') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG os_vif [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:10:11,bridge_name='br-int',has_traffic_filtering=True,id=d50b55bf-450e-4227-9165-a36343344d6e,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd50b55bf-45') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd50b55bf-45, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53dd1861-db00-4461-8d55-31d03116ba13) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:58:17 user nova-compute[74776]: INFO os_vif [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:10:11,bridge_name='br-int',has_traffic_filtering=True,id=d50b55bf-450e-4227-9165-a36343344d6e,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd50b55bf-45')
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUqFifoA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:58:17 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:58:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f175eb-235e-4e4b-93ff-314828762d3d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 14:58:17 user nova-compute[74776]: No targets found.
Nov 22 14:58:17 user nova-compute[74776]: iSNS:
Nov 22 14:58:17 user nova-compute[74776]: No targets found.
Nov 22 14:58:17 user nova-compute[74776]: STATIC:
Nov 22 14:58:17 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0
Nov 22 14:58:17 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 14:58:17 user nova-compute[74776]:                 Iface Name: default
Nov 22 14:58:17 user nova-compute[74776]: FIRMWARE:
Nov 22 14:58:17 user nova-compute[74776]: No targets found.
Nov 22 14:58:17 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 14:58:17 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 14:58:17 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d40294b-3c1b-4583-a15b-8f650fd513d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf79bf18-8100-44f2-8993-407e79205a5b]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 (non-flash)
Nov 22 14:58:17 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 (non-flash)
Nov 22 14:58:17 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c58253be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0'): ({'sdb'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Removing single pathed devices sdb {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[99415ba9-b914-497c-8294-da26a3c713a9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83e645e-5068-4c51-a1c8-e9b6b4618940]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Flushing IO for device /dev/sdb {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a0cb35-3033-4b83-a358-89d7cabee649]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d31a399-4ed7-4ebe-8552-283f6492a1a9]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccabb6f3-bf90-4ff1-a2a7-d383235144d4]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe88d8f-4fd3-45f5-8436-c1ea968ea621]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0, portal: 172.16.0.220,3260]
Nov 22 14:58:17 user nova-compute[74776]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0, portal: 172.16.0.220,3260] successful.
Nov 22 14:58:17 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7167c37d-e079-4bfb-ad99-75b2fa325db0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6a3fca-14fb-478d-9d17-4d080458edfe]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] <== disconnect_volume: return (326ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 14:58:17 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Deleting instance files /opt/stack/data/nova/instances/7df01019-c4b3-4626-8e05-a834f44e3019_del
Nov 22 14:58:17 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Deletion of /opt/stack/data/nova/instances/7df01019-c4b3-4626-8e05-a834f44e3019_del complete
Nov 22 14:58:17 user nova-compute[74776]: INFO nova.compute.manager [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 22 14:58:17 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:18 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:58:18 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Took 0.90 seconds to deallocate network for instance.
Nov 22 14:58:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-2971d219-984c-4fcd-9145-76c9fef1e7b5 req-15d3b9b6-e3f6-419c-bd5c-d8efc1440f7b service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Received event network-vif-deleted-d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Received event network-vif-plugged-d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] Acquiring lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] Lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] Lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] No waiting events found dispatching network-vif-plugged-d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:58:19 user nova-compute[74776]: WARNING nova.compute.manager [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Received unexpected event network-vif-plugged-d50b55bf-450e-4227-9165-a36343344d6e for instance with vm_state active and task_state deleting.
Nov 22 14:58:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Received event network-vif-plugged-d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] Acquiring lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] Lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] Lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] No waiting events found dispatching network-vif-plugged-d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:58:19 user nova-compute[74776]: WARNING nova.compute.manager [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Received unexpected event network-vif-plugged-d50b55bf-450e-4227-9165-a36343344d6e for instance with vm_state active and task_state deleting.
Nov 22 14:58:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Received event network-vif-unplugged-d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] Acquiring lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] Lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] Lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] No waiting events found dispatching network-vif-unplugged-d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Received event network-vif-unplugged-d50b55bf-450e-4227-9165-a36343344d6e for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Received event network-vif-plugged-d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] Acquiring lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] Lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] Lock "7df01019-c4b3-4626-8e05-a834f44e3019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG nova.compute.manager [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] No waiting events found dispatching network-vif-plugged-d50b55bf-450e-4227-9165-a36343344d6e {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:58:19 user nova-compute[74776]: WARNING nova.compute.manager [req-7a936caa-5d6b-436e-85c6-c94425763269 req-4a2412e3-471e-4b6b-bd0b-437469809b57 service nova] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Received unexpected event network-vif-plugged-d50b55bf-450e-4227-9165-a36343344d6e for instance with vm_state active and task_state deleting.
Nov 22 14:58:19 user nova-compute[74776]: INFO nova.compute.manager [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Took 0.74 seconds to detach 1 volumes for instance.
Nov 22 14:58:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 7df01019-c4b3-4626-8e05-a834f44e3019] Deleting volume: 7167c37d-e079-4bfb-ad99-75b2fa325db0 {{(pid=74776) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:58:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:58:19 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Deleted allocations for instance 7df01019-c4b3-4626-8e05-a834f44e3019
Nov 22 14:58:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d75dc6c2-3a6c-41cb-8ba3-fa94fe7f8fd2 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "7df01019-c4b3-4626-8e05-a834f44e3019" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.354s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:58:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:58:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:58:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:58:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:58:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:36 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:58:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:58:36 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 14:58:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:58:36 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:58:36 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:58:36 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:58:37 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Updating instance_info_cache with network_info: [{"id": "29c2b1de-7b59-4466-941f-31cbaf33283b", "address": "fa:16:3e:93:2c:72", "network": {"id": "ab23dced-504d-456e-97eb-bbf452866cd7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1753613074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41137c06323a439f987365dc7b885fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c2b1de-7b", "ovs_interfaceid": "29c2b1de-7b59-4466-941f-31cbaf33283b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:58:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:58:37 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:58:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:37 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:58:40 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:58:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:58:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:58:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:58:40 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:58:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:58:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:58:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:58:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:58:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:41 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:58:41 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:58:41 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8873MB free_disk=25.05020523071289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:58:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:58:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:58:41 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 9d4fd442-1998-409d-84b0-c76ec9a5670d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:58:41 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:58:41 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:58:41 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:58:41 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:58:41 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:58:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:58:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:42 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:58:42 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:58:45 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:58:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:46 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:58:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:50 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:58:51 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:58:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:58:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:58:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:58:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:58:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:54 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:58:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:58:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:58:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:58:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:58:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:58:59 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:59:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:59:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:59:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:59:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:59:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:59:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:59:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:59:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:59:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:59:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:59:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "5dad848d-2e5a-4c5a-a341-d19f8dac9740" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:59:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "5dad848d-2e5a-4c5a-a341-d19f8dac9740" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:59:16 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 14:59:17 user nova-compute[74776]: INFO nova.compute.claims [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Claim successful on node user
Nov 22 14:59:17 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 14:59:17 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 14:59:17 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG nova.policy [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5cce524a8c6419aa76fb4b02861377e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6764076f2a428ea35c11476a3e7231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 14:59:17 user nova-compute[74776]: INFO nova.virt.block_device [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Booting with volume 159b7fb3-5263-4d0f-9280-28957d8ff931 at /dev/vda
Nov 22 14:59:17 user nova-compute[74776]: DEBUG os_brick.utils [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1add913-62f8-4f3c-80bc-5be5033029df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[828e457c-dac1-4baa-9819-7cdb137ef83b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4409820-384b-477f-b94d-4961b95efcfa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3dc005-986d-4806-9321-d1ad5ebd21be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 14:59:17 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 14:59:17 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[da918ee3-44f0-42be-a2b4-d4fb7a1fe26f]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG os_brick.utils [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:59:17 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Updating existing volume attachment record: 7920298a-46c8-43d9-aabf-1b152f35ebf9 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 14:59:18 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Successfully created port: 18a4573b-7484-4b78-b1ac-ad83b55d8e02 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 14:59:18 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Successfully updated port: 18a4573b-7484-4b78-b1ac-ad83b55d8e02 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 14:59:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "refresh_cache-5dad848d-2e5a-4c5a-a341-d19f8dac9740" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:59:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquired lock "refresh_cache-5dad848d-2e5a-4c5a-a341-d19f8dac9740" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:59:18 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 14:59:18 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 14:59:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-cfa7c3d8-3f3e-42a3-8a1d-52de3cc58d4c req-808792da-7c73-4b8f-a187-97af0e80e2b3 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Received event network-changed-18a4573b-7484-4b78-b1ac-ad83b55d8e02 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:59:18 user nova-compute[74776]: DEBUG nova.compute.manager [req-cfa7c3d8-3f3e-42a3-8a1d-52de3cc58d4c req-808792da-7c73-4b8f-a187-97af0e80e2b3 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Refreshing instance network info cache due to event network-changed-18a4573b-7484-4b78-b1ac-ad83b55d8e02. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 14:59:18 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cfa7c3d8-3f3e-42a3-8a1d-52de3cc58d4c req-808792da-7c73-4b8f-a187-97af0e80e2b3 service nova] Acquiring lock "refresh_cache-5dad848d-2e5a-4c5a-a341-d19f8dac9740" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:59:19 user nova-compute[74776]: DEBUG nova.network.neutron [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Updating instance_info_cache with network_info: [{"id": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "address": "fa:16:3e:f8:df:d8", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a4573b-74", "ovs_interfaceid": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:59:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Releasing lock "refresh_cache-5dad848d-2e5a-4c5a-a341-d19f8dac9740" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:59:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Instance network_info: |[{"id": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "address": "fa:16:3e:f8:df:d8", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a4573b-74", "ovs_interfaceid": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 14:59:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cfa7c3d8-3f3e-42a3-8a1d-52de3cc58d4c req-808792da-7c73-4b8f-a187-97af0e80e2b3 service nova] Acquired lock "refresh_cache-5dad848d-2e5a-4c5a-a341-d19f8dac9740" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:59:19 user nova-compute[74776]: DEBUG nova.network.neutron [req-cfa7c3d8-3f3e-42a3-8a1d-52de3cc58d4c req-808792da-7c73-4b8f-a187-97af0e80e2b3 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Refreshing network info cache for port 18a4573b-7484-4b78-b1ac-ad83b55d8e02 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 14:59:19 user nova-compute[74776]: DEBUG nova.network.neutron [req-cfa7c3d8-3f3e-42a3-8a1d-52de3cc58d4c req-808792da-7c73-4b8f-a187-97af0e80e2b3 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Updated VIF entry in instance network info cache for port 18a4573b-7484-4b78-b1ac-ad83b55d8e02. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 14:59:19 user nova-compute[74776]: DEBUG nova.network.neutron [req-cfa7c3d8-3f3e-42a3-8a1d-52de3cc58d4c req-808792da-7c73-4b8f-a187-97af0e80e2b3 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Updating instance_info_cache with network_info: [{"id": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "address": "fa:16:3e:f8:df:d8", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a4573b-74", "ovs_interfaceid": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:59:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-cfa7c3d8-3f3e-42a3-8a1d-52de3cc58d4c req-808792da-7c73-4b8f-a187-97af0e80e2b3 service nova] Releasing lock "refresh_cache-5dad848d-2e5a-4c5a-a341-d19f8dac9740" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:59:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 14:59:23 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Creating image(s)
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Did not create local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Ensure instance console log exists: /opt/stack/data/nova/instances/5dad848d-2e5a-4c5a-a341-d19f8dac9740/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Start _get_guest_xml network_info=[{"id": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "address": "fa:16:3e:f8:df:d8", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a4573b-74", "ovs_interfaceid": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7920298a-46c8-43d9-aabf-1b152f35ebf9', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjSshXem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5dad848d-2e5a-4c5a-a341-d19f8dac9740', 'attached_at': '', 'detached_at': '', 'volume_id': '159b7fb3-5263-4d0f-9280-28957d8ff931', 'serial': '159b7fb3-5263-4d0f-9280-28957d8ff931'}, 'boot_index': 0, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 14:59:23 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:59:23 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjSshXem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 14:59:23 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:59:23 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 14:59:23 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba2bc07-b850-40ef-9f8f-c6470fd4e575]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 14:59:23 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[599f8eee-cf8e-4fd5-ba7e-8bdb9e0e33c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931] added
Nov 22 14:59:23 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84dd1a4-b37a-4e6d-82cc-f006a815fad5]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.061s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bd1c87-4074-4b1b-8dc8-15cb34e3824a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjSshXem {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjSshXem" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0704edb2-6385-4b9a-8ad1-67cba6cae9ef]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kjSshXem'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e380b29-06de-488b-9f9c-2165ac189bdb]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf84b3c-adec-4cc0-aede-84fcc5c57619]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 14:59:23 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 14:59:23 user nova-compute[74776]:  {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:59:23 user nova-compute[74776]: WARNING os_brick.initiator.connectors.iscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 14:59:23 user nova-compute[74776]: 
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab234331-b04f-4cae-8a16-8c13dc69c29e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931, portal: 172.16.0.220,3260]
Nov 22 14:59:23 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931, portal: 172.16.0.220,3260] successful.
Nov 22 14:59:23 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0af0e59-335b-481a-b912-393349f0849a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb85633-ea21-47cd-bf50-a70dddf68671]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 14:59:23 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 14:59:23 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[412971ba-5ddb-4791-be2a-bae4575a77fe]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 14:59:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjSshXem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26466616130323638', 'path': '/dev/sdb'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466616130323638', 'path': '/dev/sdb'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:59:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1127508346',display_name='tempest-TestVolumeBootPattern-server-1127508346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1127508346',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB596wO3Zc22AAnzKVxuS9gk5vbChvgktvxVxXEmM2zx1YqGq6iZTXv+hgGEsOzb88w0gyInCqMJG4uw6qi46//XWRxR2yJsl2y9nTchbI5Yumea0irnLv6OU6PAmKKUUA==',key_name='tempest-TestVolumeBootPattern-1110540872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f6764076f2a428ea35c11476a3e7231',ramdisk_id='',reservation_id='r-gqg159ni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1931721751',owner_user_name='tempest-TestVolumeBootPattern-1931721751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:59:17Z,user_data=None,user_id='d5cce524a8c6419aa76fb4b02861377e',uuid=5dad848d-2e5a-4c5a-a341-d19f8dac9740,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "address": "fa:16:3e:f8:df:d8", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a4573b-74", "ovs_interfaceid": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converting VIF {"id": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "address": "fa:16:3e:f8:df:d8", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a4573b-74", "ovs_interfaceid": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:d8,bridge_name='br-int',has_traffic_filtering=True,id=18a4573b-7484-4b78-b1ac-ad83b55d8e02,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a4573b-74') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG nova.objects.instance [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lazy-loading 'pci_devices' on Instance uuid 5dad848d-2e5a-4c5a-a341-d19f8dac9740 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] End _get_guest_xml xml=<domain type="kvm">
Nov 22 14:59:24 user nova-compute[74776]:   <uuid>5dad848d-2e5a-4c5a-a341-d19f8dac9740</uuid>
Nov 22 14:59:24 user nova-compute[74776]:   <name>instance-00000032</name>
Nov 22 14:59:24 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 14:59:24 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 14:59:24 user nova-compute[74776]:   <metadata>
Nov 22 14:59:24 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 14:59:24 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 14:59:24 user nova-compute[74776]:       <nova:name>tempest-TestVolumeBootPattern-server-1127508346</nova:name>
Nov 22 14:59:24 user nova-compute[74776]:       <nova:creationTime>2023-11-22 14:59:23</nova:creationTime>
Nov 22 14:59:24 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 14:59:24 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 14:59:24 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 14:59:24 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 14:59:24 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 14:59:24 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 14:59:24 user nova-compute[74776]:       </nova:flavor>
Nov 22 14:59:24 user nova-compute[74776]:       <nova:owner>
Nov 22 14:59:24 user nova-compute[74776]:         <nova:user uuid="d5cce524a8c6419aa76fb4b02861377e">tempest-TestVolumeBootPattern-1931721751-project-member</nova:user>
Nov 22 14:59:24 user nova-compute[74776]:         <nova:project uuid="2f6764076f2a428ea35c11476a3e7231">tempest-TestVolumeBootPattern-1931721751</nova:project>
Nov 22 14:59:24 user nova-compute[74776]:       </nova:owner>
Nov 22 14:59:24 user nova-compute[74776]:       <nova:ports>
Nov 22 14:59:24 user nova-compute[74776]:         <nova:port uuid="18a4573b-7484-4b78-b1ac-ad83b55d8e02">
Nov 22 14:59:24 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 22 14:59:24 user nova-compute[74776]:         </nova:port>
Nov 22 14:59:24 user nova-compute[74776]:       </nova:ports>
Nov 22 14:59:24 user nova-compute[74776]:     </nova:instance>
Nov 22 14:59:24 user nova-compute[74776]:   </metadata>
Nov 22 14:59:24 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 14:59:24 user nova-compute[74776]:     <system>
Nov 22 14:59:24 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 14:59:24 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 14:59:24 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 14:59:24 user nova-compute[74776]:       <entry name="serial">5dad848d-2e5a-4c5a-a341-d19f8dac9740</entry>
Nov 22 14:59:24 user nova-compute[74776]:       <entry name="uuid">5dad848d-2e5a-4c5a-a341-d19f8dac9740</entry>
Nov 22 14:59:24 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 14:59:24 user nova-compute[74776]:     </system>
Nov 22 14:59:24 user nova-compute[74776]:   </sysinfo>
Nov 22 14:59:24 user nova-compute[74776]:   <os>
Nov 22 14:59:24 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 14:59:24 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 14:59:24 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 14:59:24 user nova-compute[74776]:   </os>
Nov 22 14:59:24 user nova-compute[74776]:   <features>
Nov 22 14:59:24 user nova-compute[74776]:     <acpi/>
Nov 22 14:59:24 user nova-compute[74776]:     <apic/>
Nov 22 14:59:24 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 14:59:24 user nova-compute[74776]:   </features>
Nov 22 14:59:24 user nova-compute[74776]:   <clock offset="utc">
Nov 22 14:59:24 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 14:59:24 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 14:59:24 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 14:59:24 user nova-compute[74776]:   </clock>
Nov 22 14:59:24 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 14:59:24 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 14:59:24 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 14:59:24 user nova-compute[74776]:   </cpu>
Nov 22 14:59:24 user nova-compute[74776]:   <devices>
Nov 22 14:59:24 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 14:59:24 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 14:59:24 user nova-compute[74776]:       <source dev="/dev/sdb"/>
Nov 22 14:59:24 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 14:59:24 user nova-compute[74776]:       <serial>159b7fb3-5263-4d0f-9280-28957d8ff931</serial>
Nov 22 14:59:24 user nova-compute[74776]:     </disk>
Nov 22 14:59:24 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 14:59:24 user nova-compute[74776]:       <mac address="fa:16:3e:f8:df:d8"/>
Nov 22 14:59:24 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:59:24 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 14:59:24 user nova-compute[74776]:       <target dev="tap18a4573b-74"/>
Nov 22 14:59:24 user nova-compute[74776]:     </interface>
Nov 22 14:59:24 user nova-compute[74776]:     <serial type="pty">
Nov 22 14:59:24 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/5dad848d-2e5a-4c5a-a341-d19f8dac9740/console.log" append="off"/>
Nov 22 14:59:24 user nova-compute[74776]:     </serial>
Nov 22 14:59:24 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 14:59:24 user nova-compute[74776]:     <video>
Nov 22 14:59:24 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 14:59:24 user nova-compute[74776]:     </video>
Nov 22 14:59:24 user nova-compute[74776]:     <rng model="virtio">
Nov 22 14:59:24 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 14:59:24 user nova-compute[74776]:     </rng>
Nov 22 14:59:24 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 14:59:24 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 14:59:24 user nova-compute[74776]:       <stats period="10"/>
Nov 22 14:59:24 user nova-compute[74776]:     </memballoon>
Nov 22 14:59:24 user nova-compute[74776]:   </devices>
Nov 22 14:59:24 user nova-compute[74776]: </domain>
Nov 22 14:59:24 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:59:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1127508346',display_name='tempest-TestVolumeBootPattern-server-1127508346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1127508346',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB596wO3Zc22AAnzKVxuS9gk5vbChvgktvxVxXEmM2zx1YqGq6iZTXv+hgGEsOzb88w0gyInCqMJG4uw6qi46//XWRxR2yJsl2y9nTchbI5Yumea0irnLv6OU6PAmKKUUA==',key_name='tempest-TestVolumeBootPattern-1110540872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f6764076f2a428ea35c11476a3e7231',ramdisk_id='',reservation_id='r-gqg159ni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1931721751',owner_user_name='tempest-TestVolumeBootPattern-1931721751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T14:59:17Z,user_data=None,user_id='d5cce524a8c6419aa76fb4b02861377e',uuid=5dad848d-2e5a-4c5a-a341-d19f8dac9740,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "address": "fa:16:3e:f8:df:d8", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a4573b-74", "ovs_interfaceid": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converting VIF {"id": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "address": "fa:16:3e:f8:df:d8", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a4573b-74", "ovs_interfaceid": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:d8,bridge_name='br-int',has_traffic_filtering=True,id=18a4573b-7484-4b78-b1ac-ad83b55d8e02,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a4573b-74') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG os_vif [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:d8,bridge_name='br-int',has_traffic_filtering=True,id=18a4573b-7484-4b78-b1ac-ad83b55d8e02,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a4573b-74') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0bd47d77-51d7-507a-8bfc-ef765d0c50f3', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18a4573b-74, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18a4573b-74, col_values=(('qos', UUID('2588fcca-dfd1-40c7-940a-0ec226f35402')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18a4573b-74, col_values=(('external_ids', {'iface-id': '18a4573b-7484-4b78-b1ac-ad83b55d8e02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:df:d8', 'vm-uuid': '5dad848d-2e5a-4c5a-a341-d19f8dac9740'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:24 user nova-compute[74776]: INFO os_vif [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:df:d8,bridge_name='br-int',has_traffic_filtering=True,id=18a4573b-7484-4b78-b1ac-ad83b55d8e02,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a4573b-74')
Nov 22 14:59:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 14:59:24 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] No VIF found with MAC fa:16:3e:f8:df:d8, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 14:59:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-732f3012-6544-44aa-9afd-f36731d8c8d8 req-94bc2d7f-31e6-4abc-b4dd-0ce51d59d315 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Received event network-vif-plugged-18a4573b-7484-4b78-b1ac-ad83b55d8e02 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:59:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-732f3012-6544-44aa-9afd-f36731d8c8d8 req-94bc2d7f-31e6-4abc-b4dd-0ce51d59d315 service nova] Acquiring lock "5dad848d-2e5a-4c5a-a341-d19f8dac9740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:59:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-732f3012-6544-44aa-9afd-f36731d8c8d8 req-94bc2d7f-31e6-4abc-b4dd-0ce51d59d315 service nova] Lock "5dad848d-2e5a-4c5a-a341-d19f8dac9740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:59:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-732f3012-6544-44aa-9afd-f36731d8c8d8 req-94bc2d7f-31e6-4abc-b4dd-0ce51d59d315 service nova] Lock "5dad848d-2e5a-4c5a-a341-d19f8dac9740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:59:26 user nova-compute[74776]: DEBUG nova.compute.manager [req-732f3012-6544-44aa-9afd-f36731d8c8d8 req-94bc2d7f-31e6-4abc-b4dd-0ce51d59d315 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] No waiting events found dispatching network-vif-plugged-18a4573b-7484-4b78-b1ac-ad83b55d8e02 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:59:26 user nova-compute[74776]: WARNING nova.compute.manager [req-732f3012-6544-44aa-9afd-f36731d8c8d8 req-94bc2d7f-31e6-4abc-b4dd-0ce51d59d315 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Received unexpected event network-vif-plugged-18a4573b-7484-4b78-b1ac-ad83b55d8e02 for instance with vm_state building and task_state spawning.
Nov 22 14:59:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:28 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 14:59:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 14:59:28 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Instance spawned successfully.
Nov 22 14:59:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 14:59:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:59:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:59:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:59:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:59:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:59:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 14:59:28 user nova-compute[74776]: INFO nova.compute.manager [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Took 4.84 seconds to spawn the instance on the hypervisor.
Nov 22 14:59:28 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 14:59:28 user nova-compute[74776]: INFO nova.compute.manager [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Took 11.39 seconds to build instance.
Nov 22 14:59:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f3683290-aaac-4ac0-bba3-c32b690149a7 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "5dad848d-2e5a-4c5a-a341-d19f8dac9740" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.486s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:59:28 user nova-compute[74776]: DEBUG nova.compute.manager [req-37614487-2556-4e29-8bc2-645955edf59c req-85687378-9e66-4858-beb1-76d01c07a514 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Received event network-vif-plugged-18a4573b-7484-4b78-b1ac-ad83b55d8e02 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 14:59:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-37614487-2556-4e29-8bc2-645955edf59c req-85687378-9e66-4858-beb1-76d01c07a514 service nova] Acquiring lock "5dad848d-2e5a-4c5a-a341-d19f8dac9740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:59:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-37614487-2556-4e29-8bc2-645955edf59c req-85687378-9e66-4858-beb1-76d01c07a514 service nova] Lock "5dad848d-2e5a-4c5a-a341-d19f8dac9740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:59:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-37614487-2556-4e29-8bc2-645955edf59c req-85687378-9e66-4858-beb1-76d01c07a514 service nova] Lock "5dad848d-2e5a-4c5a-a341-d19f8dac9740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:59:28 user nova-compute[74776]: DEBUG nova.compute.manager [req-37614487-2556-4e29-8bc2-645955edf59c req-85687378-9e66-4858-beb1-76d01c07a514 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] No waiting events found dispatching network-vif-plugged-18a4573b-7484-4b78-b1ac-ad83b55d8e02 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 14:59:28 user nova-compute[74776]: WARNING nova.compute.manager [req-37614487-2556-4e29-8bc2-645955edf59c req-85687378-9e66-4858-beb1-76d01c07a514 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Received unexpected event network-vif-plugged-18a4573b-7484-4b78-b1ac-ad83b55d8e02 for instance with vm_state active and task_state None.
Nov 22 14:59:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:38 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:59:38 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 14:59:38 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 14:59:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 14:59:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 14:59:38 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 14:59:38 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 14:59:39 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Updating instance_info_cache with network_info: [{"id": "29c2b1de-7b59-4466-941f-31cbaf33283b", "address": "fa:16:3e:93:2c:72", "network": {"id": "ab23dced-504d-456e-97eb-bbf452866cd7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1753613074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41137c06323a439f987365dc7b885fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c2b1de-7b", "ovs_interfaceid": "29c2b1de-7b59-4466-941f-31cbaf33283b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 14:59:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 14:59:39 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 14:59:39 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:59:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:59:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 14:59:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:59:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 14:59:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:40 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:59:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:59:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:59:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:59:40 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 14:59:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:59:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:59:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 14:59:41 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 14:59:41 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 14:59:41 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:59:41 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 14:59:41 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8734MB free_disk=25.040069580078125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 14:59:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 14:59:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 14:59:41 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 9d4fd442-1998-409d-84b0-c76ec9a5670d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:59:41 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 5dad848d-2e5a-4c5a-a341-d19f8dac9740 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 14:59:41 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 14:59:41 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 14:59:41 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 14:59:41 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 14:59:41 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 14:59:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 14:59:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 14:59:44 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:59:44 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 14:59:45 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:59:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:48 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:59:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:50 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:59:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:53 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:59:54 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 14:59:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 14:59:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:00:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-624689dd-b542-4e08-bce7-58c946e2330a req-47c44398-6acc-497d-b558-97bd484b668c service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Received event network-changed-29c2b1de-7b59-4466-941f-31cbaf33283b {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:00:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-624689dd-b542-4e08-bce7-58c946e2330a req-47c44398-6acc-497d-b558-97bd484b668c service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Refreshing instance network info cache due to event network-changed-29c2b1de-7b59-4466-941f-31cbaf33283b. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:00:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-624689dd-b542-4e08-bce7-58c946e2330a req-47c44398-6acc-497d-b558-97bd484b668c service nova] Acquiring lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:00:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-624689dd-b542-4e08-bce7-58c946e2330a req-47c44398-6acc-497d-b558-97bd484b668c service nova] Acquired lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:00:02 user nova-compute[74776]: DEBUG nova.network.neutron [req-624689dd-b542-4e08-bce7-58c946e2330a req-47c44398-6acc-497d-b558-97bd484b668c service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Refreshing network info cache for port 29c2b1de-7b59-4466-941f-31cbaf33283b {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:00:02 user nova-compute[74776]: DEBUG nova.network.neutron [req-624689dd-b542-4e08-bce7-58c946e2330a req-47c44398-6acc-497d-b558-97bd484b668c service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Updated VIF entry in instance network info cache for port 29c2b1de-7b59-4466-941f-31cbaf33283b. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:00:02 user nova-compute[74776]: DEBUG nova.network.neutron [req-624689dd-b542-4e08-bce7-58c946e2330a req-47c44398-6acc-497d-b558-97bd484b668c service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Updating instance_info_cache with network_info: [{"id": "29c2b1de-7b59-4466-941f-31cbaf33283b", "address": "fa:16:3e:93:2c:72", "network": {"id": "ab23dced-504d-456e-97eb-bbf452866cd7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1753613074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41137c06323a439f987365dc7b885fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c2b1de-7b", "ovs_interfaceid": "29c2b1de-7b59-4466-941f-31cbaf33283b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:00:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-624689dd-b542-4e08-bce7-58c946e2330a req-47c44398-6acc-497d-b558-97bd484b668c service nova] Releasing lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:00:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:00:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:00:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 15:00:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:00:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:00:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG nova.objects.instance [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lazy-loading 'flavor' on Instance uuid 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:00:06 user nova-compute[74776]: INFO nova.compute.manager [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Attaching volume bd2a0f5d-0bb3-4e3c-9836-4755afde673b to /dev/vdb
Nov 22 15:00:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG os_brick.utils [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[334bde52-5612-4260-935b-df1aaf3cc19e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a268dab-d89f-4ebb-987a-10b5f2cb57f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.040s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[06914b2d-8422-47ca-92b6-32774cd75ea1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2ad590-d282-46fa-a7d2-726b1e74e1a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:00:06 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:00:06 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fc40ee-805d-48f8-a796-6cd4d990fcb3]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG os_brick.utils [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:00:06 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Updating existing volume attachment record: d72cd62b-9213-418b-b1d1-b4ee500ee1c6 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:00:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:00:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uesLbxGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:00:12 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:00:12 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:00:12 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d56d7b1-b28c-4ec7-8b53-e7a21befe06d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:00:12 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a6a18a-5e4a-4c8e-8ce7-a57b8e80a65b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b] added
Nov 22 15:00:12 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1714c003-97a5-4055-9025-b03ad44ac061]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b04ee3-ab29-4459-accc-6c721faa53bc]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uesLbxGq {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uesLbxGq" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa813ce-f6f9-4ae4-aefc-eb1953f652ac]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uesLbxGq'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17b69f6-f5ea-482d-a2e5-0942d78444d6]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ae9d69-2bdc-4ca4-a3b8-3e79a0df27c7]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:00:12 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:00:12 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5d92c0-28e8-4d7f-83c5-018b048bff29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b, portal: 172.16.0.220,3260]
Nov 22 15:00:12 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b, portal: 172.16.0.220,3260] successful.
Nov 22 15:00:12 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0486938c-eb76-46a3-8087-78919e346cec]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2fed21-6dc7-47f6-bc31-6f7065a04c3d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:00:12 user nova-compute[74776]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b (non-flash)
Nov 22 15:00:12 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:00:12 user nova-compute[74776]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b (non-flash)
Nov 22 15:00:12 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1228d4-beed-48f7-b410-bafcbb4fa8a7]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:00:12 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uesLbxGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:00:13 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:00:13 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23335653263376238', 'path': '/dev/sdc'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:00:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335653263376238', 'path': '/dev/sdc'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:00:13 user nova-compute[74776]: DEBUG nova.objects.instance [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lazy-loading 'flavor' on Instance uuid 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:00:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 15:00:13 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:00:13 user nova-compute[74776]:   <source dev="/dev/sdc"/>
Nov 22 15:00:13 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:00:13 user nova-compute[74776]:   <serial>bd2a0f5d-0bb3-4e3c-9836-4755afde673b</serial>
Nov 22 15:00:13 user nova-compute[74776]: </disk>
Nov 22 15:00:13 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 15:00:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:00:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:00:13 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] No VIF found with MAC fa:16:3e:93:2c:72, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:00:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-629d10e2-f48d-43cf-9c46-a61437585b99 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.732s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:00:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:00:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:00:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:00:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:00:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:00:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:00:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:00:28 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:00:28 user nova-compute[74776]: INFO nova.compute.manager [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Detaching volume bd2a0f5d-0bb3-4e3c-9836-4755afde673b
Nov 22 15:00:28 user nova-compute[74776]: INFO nova.virt.block_device [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Attempting to driver detach volume bd2a0f5d-0bb3-4e3c-9836-4755afde673b from mountpoint /dev/vdb
Nov 22 15:00:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Attempting to detach device vdb from instance 9d4fd442-1998-409d-84b0-c76ec9a5670d from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 15:00:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:00:28 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:00:28 user nova-compute[74776]:   <source dev="/dev/sdc"/>
Nov 22 15:00:28 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:00:28 user nova-compute[74776]:   <serial>bd2a0f5d-0bb3-4e3c-9836-4755afde673b</serial>
Nov 22 15:00:28 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:00:28 user nova-compute[74776]: </disk>
Nov 22 15:00:28 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:00:28 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Successfully detached device vdb from instance 9d4fd442-1998-409d-84b0-c76ec9a5670d from the persistent domain config.
Nov 22 15:00:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9d4fd442-1998-409d-84b0-c76ec9a5670d from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 15:00:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:00:28 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:00:28 user nova-compute[74776]:   <source dev="/dev/sdc"/>
Nov 22 15:00:28 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:00:28 user nova-compute[74776]:   <serial>bd2a0f5d-0bb3-4e3c-9836-4755afde673b</serial>
Nov 22 15:00:28 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:00:28 user nova-compute[74776]: </disk>
Nov 22 15:00:28 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:00:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 15:00:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:00:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:00:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:00:39 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:00:39 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:00:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-5dad848d-2e5a-4c5a-a341-d19f8dac9740" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:00:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-5dad848d-2e5a-4c5a-a341-d19f8dac9740" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:00:39 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 15:00:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:00:40 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Updating instance_info_cache with network_info: [{"id": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "address": "fa:16:3e:f8:df:d8", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a4573b-74", "ovs_interfaceid": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:00:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-5dad848d-2e5a-4c5a-a341-d19f8dac9740" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:00:40 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 15:00:40 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:00:42 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:00:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:00:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:00:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:00:42 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:00:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:00:43 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:00:43 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:00:43 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8828MB free_disk=25.038616180419922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:00:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:00:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:00:43 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 9d4fd442-1998-409d-84b0-c76ec9a5670d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:00:43 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 5dad848d-2e5a-4c5a-a341-d19f8dac9740 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:00:43 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:00:43 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:00:43 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:00:43 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:00:43 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:00:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:00:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:00:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:00:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 15:00:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:00:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:00:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:00:46 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:00:46 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:00:46 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:00:48 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9d4fd442-1998-409d-84b0-c76ec9a5670d is timed out.
Nov 22 15:00:48 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Successfully detached device vdb from instance 9d4fd442-1998-409d-84b0-c76ec9a5670d from the live domain config.
Nov 22 15:00:48 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uesLbxGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:00:48 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:00:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f73390-12ae-419d-a62c-a042b36a0b59]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:00:48 user nova-compute[74776]: No targets found.
Nov 22 15:00:48 user nova-compute[74776]: iSNS:
Nov 22 15:00:48 user nova-compute[74776]: No targets found.
Nov 22 15:00:48 user nova-compute[74776]: STATIC:
Nov 22 15:00:48 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b
Nov 22 15:00:48 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:00:48 user nova-compute[74776]:                 Iface Name: default
Nov 22 15:00:48 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931
Nov 22 15:00:48 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:00:48 user nova-compute[74776]:                 Iface Name: default
Nov 22 15:00:48 user nova-compute[74776]: FIRMWARE:
Nov 22 15:00:48 user nova-compute[74776]: No targets found.
Nov 22 15:00:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:00:48 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:00:48 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a614594-52f0-4a11-8386-799425670baf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f26a057-bc83-4cd8-89e5-0b917567d39d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:00:48 user nova-compute[74776]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b (non-flash)
Nov 22 15:00:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:00:48 user nova-compute[74776]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b (non-flash)
Nov 22 15:00:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c5815c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b'): ({'sdc'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Removing single pathed devices sdc {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc07ac9-3802-4eda-84eb-28f50fe6c765]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b248876f-ceb3-43d0-9db5-9325f90e2c88]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Flushing IO for device /dev/sdc {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9ae58e-1dfd-4562-8fb3-73ccd5226d0c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa3f561-81ec-4448-b8cf-ca669d342671]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9263fd20-1f39-4b33-b3b9-1ae34198931c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18808b8-c7dd-4ad5-a2ee-ae5e24a8d31e]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b, portal: 172.16.0.220,3260]
Nov 22 15:00:48 user nova-compute[74776]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b, portal: 172.16.0.220,3260] successful.
Nov 22 15:00:48 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd2a0f5d-0bb3-4e3c-9836-4755afde673b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c892c3aa-2431-4add-8a9b-279154647d6c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] <== disconnect_volume: return (296ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:00:48 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:00:49 user nova-compute[74776]: DEBUG nova.objects.instance [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lazy-loading 'flavor' on Instance uuid 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:00:49 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:00:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-8e7b64cf-0c94-4b98-b810-406746bec7ce tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.642s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:00:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:00:50 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:00:54 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:00:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:00:55 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:00:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:01:04 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:01:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:01:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:01:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-db2fcdf3-be24-4b15-9330-4a5775c8391a req-350ada58-9a8b-44c0-acc3-cb9ec0e59113 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Received event network-changed-18a4573b-7484-4b78-b1ac-ad83b55d8e02 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:01:08 user nova-compute[74776]: DEBUG nova.compute.manager [req-db2fcdf3-be24-4b15-9330-4a5775c8391a req-350ada58-9a8b-44c0-acc3-cb9ec0e59113 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Refreshing instance network info cache due to event network-changed-18a4573b-7484-4b78-b1ac-ad83b55d8e02. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:01:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-db2fcdf3-be24-4b15-9330-4a5775c8391a req-350ada58-9a8b-44c0-acc3-cb9ec0e59113 service nova] Acquiring lock "refresh_cache-5dad848d-2e5a-4c5a-a341-d19f8dac9740" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:01:08 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-db2fcdf3-be24-4b15-9330-4a5775c8391a req-350ada58-9a8b-44c0-acc3-cb9ec0e59113 service nova] Acquired lock "refresh_cache-5dad848d-2e5a-4c5a-a341-d19f8dac9740" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:01:08 user nova-compute[74776]: DEBUG nova.network.neutron [req-db2fcdf3-be24-4b15-9330-4a5775c8391a req-350ada58-9a8b-44c0-acc3-cb9ec0e59113 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Refreshing network info cache for port 18a4573b-7484-4b78-b1ac-ad83b55d8e02 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:01:09 user nova-compute[74776]: DEBUG nova.network.neutron [req-db2fcdf3-be24-4b15-9330-4a5775c8391a req-350ada58-9a8b-44c0-acc3-cb9ec0e59113 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Updated VIF entry in instance network info cache for port 18a4573b-7484-4b78-b1ac-ad83b55d8e02. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:01:09 user nova-compute[74776]: DEBUG nova.network.neutron [req-db2fcdf3-be24-4b15-9330-4a5775c8391a req-350ada58-9a8b-44c0-acc3-cb9ec0e59113 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Updating instance_info_cache with network_info: [{"id": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "address": "fa:16:3e:f8:df:d8", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a4573b-74", "ovs_interfaceid": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:01:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-db2fcdf3-be24-4b15-9330-4a5775c8391a req-350ada58-9a8b-44c0-acc3-cb9ec0e59113 service nova] Releasing lock "refresh_cache-5dad848d-2e5a-4c5a-a341-d19f8dac9740" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:01:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "5dad848d-2e5a-4c5a-a341-d19f8dac9740" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:01:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "5dad848d-2e5a-4c5a-a341-d19f8dac9740" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:01:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "5dad848d-2e5a-4c5a-a341-d19f8dac9740-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:01:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "5dad848d-2e5a-4c5a-a341-d19f8dac9740-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:01:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "5dad848d-2e5a-4c5a-a341-d19f8dac9740-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:01:09 user nova-compute[74776]: INFO nova.compute.manager [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Terminating instance
Nov 22 15:01:09 user nova-compute[74776]: DEBUG nova.compute.manager [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 15:01:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:01:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:01:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:01:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:01:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-2631cb97-fcd0-4cc6-8b94-7f92f024a321 req-0861ca91-f431-4f16-a827-e98c7a315590 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Received event network-vif-unplugged-18a4573b-7484-4b78-b1ac-ad83b55d8e02 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:01:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2631cb97-fcd0-4cc6-8b94-7f92f024a321 req-0861ca91-f431-4f16-a827-e98c7a315590 service nova] Acquiring lock "5dad848d-2e5a-4c5a-a341-d19f8dac9740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:01:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2631cb97-fcd0-4cc6-8b94-7f92f024a321 req-0861ca91-f431-4f16-a827-e98c7a315590 service nova] Lock "5dad848d-2e5a-4c5a-a341-d19f8dac9740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:01:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2631cb97-fcd0-4cc6-8b94-7f92f024a321 req-0861ca91-f431-4f16-a827-e98c7a315590 service nova] Lock "5dad848d-2e5a-4c5a-a341-d19f8dac9740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:01:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-2631cb97-fcd0-4cc6-8b94-7f92f024a321 req-0861ca91-f431-4f16-a827-e98c7a315590 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] No waiting events found dispatching network-vif-unplugged-18a4573b-7484-4b78-b1ac-ad83b55d8e02 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:01:09 user nova-compute[74776]: DEBUG nova.compute.manager [req-2631cb97-fcd0-4cc6-8b94-7f92f024a321 req-0861ca91-f431-4f16-a827-e98c7a315590 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Received event network-vif-unplugged-18a4573b-7484-4b78-b1ac-ad83b55d8e02 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:01:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:01:10 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Instance destroyed successfully.
Nov 22 15:01:10 user nova-compute[74776]: DEBUG nova.objects.instance [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lazy-loading 'resources' on Instance uuid 5dad848d-2e5a-4c5a-a341-d19f8dac9740 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:59:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1127508346',display_name='tempest-TestVolumeBootPattern-server-1127508346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1127508346',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB596wO3Zc22AAnzKVxuS9gk5vbChvgktvxVxXEmM2zx1YqGq6iZTXv+hgGEsOzb88w0gyInCqMJG4uw6qi46//XWRxR2yJsl2y9nTchbI5Yumea0irnLv6OU6PAmKKUUA==',key_name='tempest-TestVolumeBootPattern-1110540872',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:59:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f6764076f2a428ea35c11476a3e7231',ramdisk_id='',reservation_id='r-gqg159ni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1931721751',owner_user_name='tempest-TestVolumeBootPattern-1931721751-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:59:28Z,user_data=None,user_id='d5cce524a8c6419aa76fb4b02861377e',uuid=5dad848d-2e5a-4c5a-a341-d19f8dac9740,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "address": "fa:16:3e:f8:df:d8", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a4573b-74", "ovs_interfaceid": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converting VIF {"id": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "address": "fa:16:3e:f8:df:d8", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a4573b-74", "ovs_interfaceid": "18a4573b-7484-4b78-b1ac-ad83b55d8e02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:df:d8,bridge_name='br-int',has_traffic_filtering=True,id=18a4573b-7484-4b78-b1ac-ad83b55d8e02,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a4573b-74') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_vif [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:df:d8,bridge_name='br-int',has_traffic_filtering=True,id=18a4573b-7484-4b78-b1ac-ad83b55d8e02,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a4573b-74') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18a4573b-74, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2588fcca-dfd1-40c7-940a-0ec226f35402) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:01:10 user nova-compute[74776]: INFO os_vif [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:df:d8,bridge_name='br-int',has_traffic_filtering=True,id=18a4573b-7484-4b78-b1ac-ad83b55d8e02,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a4573b-74')
Nov 22 15:01:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjSshXem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:01:10 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0adcba-759d-4e6a-bf38-2bb306dcd13c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:01:10 user nova-compute[74776]: No targets found.
Nov 22 15:01:10 user nova-compute[74776]: iSNS:
Nov 22 15:01:10 user nova-compute[74776]: No targets found.
Nov 22 15:01:10 user nova-compute[74776]: STATIC:
Nov 22 15:01:10 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931
Nov 22 15:01:10 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:01:10 user nova-compute[74776]:                 Iface Name: default
Nov 22 15:01:10 user nova-compute[74776]: FIRMWARE:
Nov 22 15:01:10 user nova-compute[74776]: No targets found.
Nov 22 15:01:10 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:01:10 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:01:10 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aeee493-9c6a-44c2-9726-0a17cc4dc6c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[791a006c-42f6-4afd-88a0-d1c9affa12b5]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:01:10 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:01:10 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c3879f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931'): ({'sdb'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Removing single pathed devices sdb {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[45481388-d489-45d8-8809-33137c0ae7a8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d04fe0-d825-483f-82a8-deb734e7117f]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Flushing IO for device /dev/sdb {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7059c6ba-ddb9-49b4-b0db-6c91582ad35b]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.114s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b47ed9f-5e09-4254-b061-8d3aebc716c2]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOcec306bc-dfaa0268e0a6e9cc', '/dev/disk/by-id/scsi-26466616130323638', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_cec306bc') {{(pid=85789) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a1a48c-b958-41f3-ac03-979500689f2b]: (4, None) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[90907e77-a10b-41ef-a7fd-4b86da95de92]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8759c114-d88a-4043-a3e9-b58106c5772c]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931, portal: 172.16.0.220,3260]
Nov 22 15:01:10 user nova-compute[74776]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931, portal: 172.16.0.220,3260] successful.
Nov 22 15:01:10 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c054111c-141f-49d1-988f-1c38d4858edf]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] <== disconnect_volume: return (346ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:01:10 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Deleting instance files /opt/stack/data/nova/instances/5dad848d-2e5a-4c5a-a341-d19f8dac9740_del
Nov 22 15:01:10 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Deletion of /opt/stack/data/nova/instances/5dad848d-2e5a-4c5a-a341-d19f8dac9740_del complete
Nov 22 15:01:10 user nova-compute[74776]: INFO nova.compute.manager [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 22 15:01:10 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 15:01:10 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 15:01:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:01:11 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:01:11 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Took 0.62 seconds to deallocate network for instance.
Nov 22 15:01:11 user nova-compute[74776]: DEBUG nova.compute.manager [req-0e17d808-14e2-4cec-9424-875a461eb14b req-04c67d5c-17f3-4b72-89a7-c29e49ee0291 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Received event network-vif-deleted-18a4573b-7484-4b78-b1ac-ad83b55d8e02 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:01:11 user nova-compute[74776]: DEBUG nova.compute.manager [req-f71ce706-d13e-4059-9df6-3742852d2dae req-c11c75c0-531f-41f8-ab54-233ae54d4616 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Received event network-vif-plugged-18a4573b-7484-4b78-b1ac-ad83b55d8e02 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:01:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f71ce706-d13e-4059-9df6-3742852d2dae req-c11c75c0-531f-41f8-ab54-233ae54d4616 service nova] Acquiring lock "5dad848d-2e5a-4c5a-a341-d19f8dac9740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:01:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f71ce706-d13e-4059-9df6-3742852d2dae req-c11c75c0-531f-41f8-ab54-233ae54d4616 service nova] Lock "5dad848d-2e5a-4c5a-a341-d19f8dac9740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:01:11 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f71ce706-d13e-4059-9df6-3742852d2dae req-c11c75c0-531f-41f8-ab54-233ae54d4616 service nova] Lock "5dad848d-2e5a-4c5a-a341-d19f8dac9740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:01:11 user nova-compute[74776]: DEBUG nova.compute.manager [req-f71ce706-d13e-4059-9df6-3742852d2dae req-c11c75c0-531f-41f8-ab54-233ae54d4616 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] No waiting events found dispatching network-vif-plugged-18a4573b-7484-4b78-b1ac-ad83b55d8e02 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:01:11 user nova-compute[74776]: WARNING nova.compute.manager [req-f71ce706-d13e-4059-9df6-3742852d2dae req-c11c75c0-531f-41f8-ab54-233ae54d4616 service nova] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Received unexpected event network-vif-plugged-18a4573b-7484-4b78-b1ac-ad83b55d8e02 for instance with vm_state active and task_state deleting.
Nov 22 15:01:12 user nova-compute[74776]: INFO nova.compute.manager [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 5dad848d-2e5a-4c5a-a341-d19f8dac9740] Took 0.73 seconds to detach 1 volumes for instance.
Nov 22 15:01:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:01:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:01:12 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:01:12 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:01:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:01:12 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Deleted allocations for instance 5dad848d-2e5a-4c5a-a341-d19f8dac9740
Nov 22 15:01:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-5d30ee77-58c2-4a7d-8587-1e9095faec4d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "5dad848d-2e5a-4c5a-a341-d19f8dac9740" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.014s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:01:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:01:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG nova.objects.instance [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lazy-loading 'flavor' on Instance uuid 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:01:21 user nova-compute[74776]: INFO nova.compute.manager [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Attaching volume 0341c566-da9f-43c6-a441-6781d7d8de2d to /dev/vdb
Nov 22 15:01:21 user nova-compute[74776]: DEBUG os_brick.utils [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[36085d98-e337-4a8f-8b0f-237beb46f7ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dad8cd4-499a-4c6d-b928-830f3ab68916]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9247f5c0-c5fe-4b8c-b2e0-7e29893c4958]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd18d058-2dd0-4638-9ab1-1e42c23fade6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:01:21 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:01:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2304cc11-4db4-405e-a755-5463ef39794e]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG os_brick.utils [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:01:21 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Updating existing volume attachment record: a1404a15-26dd-4cd9-97c8-3384ece1a13c {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:01:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsSMglub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:01:27 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:01:27 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:01:27 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d23968-5794-4b4d-bd4c-973e8a64ed2f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:01:27 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c819f475-09ff-469f-acee-6cee34dd6c8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d] added
Nov 22 15:01:27 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f61b24f-a65f-4933-a329-24d22549bc04]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e03a572-f1a0-4249-94f6-74fe09381357]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zsSMglub {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zsSMglub" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[651131f2-6ade-4ff8-99e6-2e64b17be22f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zsSMglub'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb149f7-c2de-4830-8cba-bc84bb5a43e8]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7f2b0c-3775-4e6d-8b5d-028ce039cafe]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 15:01:27 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 15:01:27 user nova-compute[74776]:  {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:01:27 user nova-compute[74776]: WARNING os_brick.initiator.connectors.iscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 15:01:27 user nova-compute[74776]: 
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2554c854-53f9-496a-900a-69e58b511756]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d, portal: 172.16.0.220,3260]
Nov 22 15:01:27 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d, portal: 172.16.0.220,3260] successful.
Nov 22 15:01:27 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63ca0a7-fa5c-4d11-943a-eeaf5f039646]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40d29db-9cd0-4595-8b8e-0a2162e82346]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d (non-flash)
Nov 22 15:01:27 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d (non-flash)
Nov 22 15:01:27 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bc3067-311c-4286-a90b-4c2b66a23715]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:01:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsSMglub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:01:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.268s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:01:28 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '26563326538306234', 'path': '/dev/sdb'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:01:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563326538306234', 'path': '/dev/sdb'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:01:28 user nova-compute[74776]: DEBUG nova.objects.instance [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lazy-loading 'flavor' on Instance uuid 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:01:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 15:01:28 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:01:28 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 15:01:28 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:01:28 user nova-compute[74776]:   <serial>0341c566-da9f-43c6-a441-6781d7d8de2d</serial>
Nov 22 15:01:28 user nova-compute[74776]: </disk>
Nov 22 15:01:28 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 15:01:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:01:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:01:28 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] No VIF found with MAC fa:16:3e:93:2c:72, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:01:29 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-344a2d8d-bd09-41d8-b9da-413418121d9a tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.753s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:01:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:01:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:01:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:01:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:01:31 user nova-compute[74776]: INFO nova.compute.manager [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Detaching volume 0341c566-da9f-43c6-a441-6781d7d8de2d
Nov 22 15:01:31 user nova-compute[74776]: INFO nova.virt.block_device [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Attempting to driver detach volume 0341c566-da9f-43c6-a441-6781d7d8de2d from mountpoint /dev/vdb
Nov 22 15:01:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Attempting to detach device vdb from instance 9d4fd442-1998-409d-84b0-c76ec9a5670d from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 15:01:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:01:31 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:01:31 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 15:01:31 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:01:31 user nova-compute[74776]:   <serial>0341c566-da9f-43c6-a441-6781d7d8de2d</serial>
Nov 22 15:01:31 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:01:31 user nova-compute[74776]: </disk>
Nov 22 15:01:31 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:01:31 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Successfully detached device vdb from instance 9d4fd442-1998-409d-84b0-c76ec9a5670d from the persistent domain config.
Nov 22 15:01:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9d4fd442-1998-409d-84b0-c76ec9a5670d from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 15:01:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:01:31 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:01:31 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 15:01:31 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:01:31 user nova-compute[74776]:   <serial>0341c566-da9f-43c6-a441-6781d7d8de2d</serial>
Nov 22 15:01:31 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:01:31 user nova-compute[74776]: </disk>
Nov 22 15:01:31 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:01:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 15:01:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:01:39 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:01:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:01:40 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:01:40 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:01:40 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 15:01:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:01:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:01:40 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 15:01:40 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:01:41 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Updating instance_info_cache with network_info: [{"id": "29c2b1de-7b59-4466-941f-31cbaf33283b", "address": "fa:16:3e:93:2c:72", "network": {"id": "ab23dced-504d-456e-97eb-bbf452866cd7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1753613074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41137c06323a439f987365dc7b885fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c2b1de-7b", "ovs_interfaceid": "29c2b1de-7b59-4466-941f-31cbaf33283b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:01:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:01:41 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 15:01:42 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:01:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:01:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:01:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:01:42 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:01:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:42 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:43 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:01:43 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:01:43 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8936MB free_disk=25.03732681274414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:01:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:01:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:01:43 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 9d4fd442-1998-409d-84b0-c76ec9a5670d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:01:43 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:01:43 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:01:43 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:01:43 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:01:43 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:01:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:01:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:01:48 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:01:48 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:01:48 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:01:49 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:01:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:01:50 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:01:52 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9d4fd442-1998-409d-84b0-c76ec9a5670d is timed out.
Nov 22 15:01:52 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Successfully detached device vdb from instance 9d4fd442-1998-409d-84b0-c76ec9a5670d from the live domain config.
Nov 22 15:01:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zsSMglub', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:01:52 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:01:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3e7bd0-6571-4dd9-adc7-63459e5bc4f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:01:52 user nova-compute[74776]: No targets found.
Nov 22 15:01:52 user nova-compute[74776]: iSNS:
Nov 22 15:01:52 user nova-compute[74776]: No targets found.
Nov 22 15:01:52 user nova-compute[74776]: STATIC:
Nov 22 15:01:52 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d
Nov 22 15:01:52 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:01:52 user nova-compute[74776]:                 Iface Name: default
Nov 22 15:01:52 user nova-compute[74776]: FIRMWARE:
Nov 22 15:01:52 user nova-compute[74776]: No targets found.
Nov 22 15:01:52 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:01:52 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:01:52 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e298fa12-b41a-42ba-87ed-94756d999e30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c81111-1440-443c-8fb5-0e26dd670e96]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d (non-flash)
Nov 22 15:01:52 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d (non-flash)
Nov 22 15:01:52 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c3879f760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d'): ({'sdb'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Removing single pathed devices sdb {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bb7555-4c62-4a33-aff2-c9af5a20919c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4364853-195a-4c8e-a5b5-bc1cda60a421]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Flushing IO for device /dev/sdb {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19b8db9-a4a7-4c94-87d0-05dc4a29f5e4]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a81ec5-91f6-4898-9f20-b6eaa5c388cb]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea50fa05-f049-42aa-8dfc-66044304bf90]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f64293c-bbf8-468d-9a13-6fe472965dd6]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d, portal: 172.16.0.220,3260]
Nov 22 15:01:52 user nova-compute[74776]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d, portal: 172.16.0.220,3260] successful.
Nov 22 15:01:52 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0341c566-da9f-43c6-a441-6781d7d8de2d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ca902e-d8e8-478c-af81-82fe1111bb1a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] <== disconnect_volume: return (300ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:01:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:01:53 user nova-compute[74776]: DEBUG nova.objects.instance [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lazy-loading 'flavor' on Instance uuid 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:01:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f6f2fea0-bc88-4200-959c-7d056bd978b7 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.652s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:01:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:01:56 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:01:57 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:02:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:02:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "9a11c064-b17b-4776-9388-6000442fe07f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:02:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "9a11c064-b17b-4776-9388-6000442fe07f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG nova.compute.manager [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 15:02:01 user nova-compute[74776]: INFO nova.compute.claims [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Claim successful on node user
Nov 22 15:02:01 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG nova.compute.manager [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG nova.compute.manager [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG nova.network.neutron [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 15:02:01 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 15:02:01 user nova-compute[74776]: DEBUG nova.compute.manager [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG nova.policy [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5cce524a8c6419aa76fb4b02861377e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6764076f2a428ea35c11476a3e7231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 15:02:01 user nova-compute[74776]: INFO nova.virt.block_device [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Booting with volume 159b7fb3-5263-4d0f-9280-28957d8ff931 at /dev/vda
Nov 22 15:02:01 user nova-compute[74776]: DEBUG os_brick.utils [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91567fe-6f74-490c-9a0c-5616d2b6ac07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d08960-7ac9-45c1-a5c5-9b8918ef9154]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[77711b12-9aa4-431e-9401-49b10b2a3da0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[211aa8e4-8bcd-4d64-b8bf-be93d5f4face]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:02:01 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:02:01 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1f9b2a-1a20-4f53-a746-f5926bb91ec8]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG os_brick.utils [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:02:01 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Updating existing volume attachment record: 58cdbf42-9933-47aa-ae3d-0c009c4127e2 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:02:02 user nova-compute[74776]: DEBUG nova.network.neutron [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Successfully created port: cb23e1d9-49e1-403d-a281-e6a527cd3c93 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:02:03 user nova-compute[74776]: DEBUG nova.network.neutron [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Successfully updated port: cb23e1d9-49e1-403d-a281-e6a527cd3c93 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:02:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "refresh_cache-9a11c064-b17b-4776-9388-6000442fe07f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:02:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquired lock "refresh_cache-9a11c064-b17b-4776-9388-6000442fe07f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:02:03 user nova-compute[74776]: DEBUG nova.network.neutron [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:02:03 user nova-compute[74776]: DEBUG nova.compute.manager [req-1fbcafa8-7f80-4247-999c-5fc2c392f9b6 req-02c565a4-a94c-4cf5-8f49-ee2c9884d0d4 service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Received event network-changed-cb23e1d9-49e1-403d-a281-e6a527cd3c93 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:02:03 user nova-compute[74776]: DEBUG nova.compute.manager [req-1fbcafa8-7f80-4247-999c-5fc2c392f9b6 req-02c565a4-a94c-4cf5-8f49-ee2c9884d0d4 service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Refreshing instance network info cache due to event network-changed-cb23e1d9-49e1-403d-a281-e6a527cd3c93. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:02:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1fbcafa8-7f80-4247-999c-5fc2c392f9b6 req-02c565a4-a94c-4cf5-8f49-ee2c9884d0d4 service nova] Acquiring lock "refresh_cache-9a11c064-b17b-4776-9388-6000442fe07f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:02:03 user nova-compute[74776]: DEBUG nova.network.neutron [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:02:03 user nova-compute[74776]: DEBUG nova.network.neutron [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Updating instance_info_cache with network_info: [{"id": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "address": "fa:16:3e:8f:04:6f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb23e1d9-49", "ovs_interfaceid": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:02:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Releasing lock "refresh_cache-9a11c064-b17b-4776-9388-6000442fe07f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:02:03 user nova-compute[74776]: DEBUG nova.compute.manager [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Instance network_info: |[{"id": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "address": "fa:16:3e:8f:04:6f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb23e1d9-49", "ovs_interfaceid": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 15:02:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1fbcafa8-7f80-4247-999c-5fc2c392f9b6 req-02c565a4-a94c-4cf5-8f49-ee2c9884d0d4 service nova] Acquired lock "refresh_cache-9a11c064-b17b-4776-9388-6000442fe07f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:02:03 user nova-compute[74776]: DEBUG nova.network.neutron [req-1fbcafa8-7f80-4247-999c-5fc2c392f9b6 req-02c565a4-a94c-4cf5-8f49-ee2c9884d0d4 service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Refreshing network info cache for port cb23e1d9-49e1-403d-a281-e6a527cd3c93 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:02:04 user nova-compute[74776]: DEBUG nova.network.neutron [req-1fbcafa8-7f80-4247-999c-5fc2c392f9b6 req-02c565a4-a94c-4cf5-8f49-ee2c9884d0d4 service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Updated VIF entry in instance network info cache for port cb23e1d9-49e1-403d-a281-e6a527cd3c93. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:02:04 user nova-compute[74776]: DEBUG nova.network.neutron [req-1fbcafa8-7f80-4247-999c-5fc2c392f9b6 req-02c565a4-a94c-4cf5-8f49-ee2c9884d0d4 service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Updating instance_info_cache with network_info: [{"id": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "address": "fa:16:3e:8f:04:6f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb23e1d9-49", "ovs_interfaceid": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:02:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1fbcafa8-7f80-4247-999c-5fc2c392f9b6 req-02c565a4-a94c-4cf5-8f49-ee2c9884d0d4 service nova] Releasing lock "refresh_cache-9a11c064-b17b-4776-9388-6000442fe07f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:02:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.compute.manager [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 15:02:09 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Creating image(s)
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Did not create local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Ensure instance console log exists: /opt/stack/data/nova/instances/9a11c064-b17b-4776-9388-6000442fe07f/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Start _get_guest_xml network_info=[{"id": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "address": "fa:16:3e:8f:04:6f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb23e1d9-49", "ovs_interfaceid": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '58cdbf42-9933-47aa-ae3d-0c009c4127e2', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjSshXem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9a11c064-b17b-4776-9388-6000442fe07f', 'attached_at': '', 'detached_at': '', 'volume_id': '159b7fb3-5263-4d0f-9280-28957d8ff931', 'serial': '159b7fb3-5263-4d0f-9280-28957d8ff931'}, 'boot_index': 0, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:02:09 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:02:09 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjSshXem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:02:09 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:02:09 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:02:09 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e2a828-ad96-4e52-bf40-be999eee2eb5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:02:09 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[305bd924-a4db-41e0-a8dc-6d509e26bc61]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931] added
Nov 22 15:02:09 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24a51d8-8c40-4c20-909a-9f3045acc5d6]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24a1ea9-64ce-4fb0-85de-7ac0f3938bc0]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjSshXem {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjSshXem" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1642e43-922c-4281-8ab6-7369d7c46f1b]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kjSshXem'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa6af32-e97f-4e0d-bdbe-7ff2edcc419f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c047e9-0b80-44ca-9350-d2430c326f01]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 15:02:09 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 15:02:09 user nova-compute[74776]:  {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:02:09 user nova-compute[74776]: WARNING os_brick.initiator.connectors.iscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 15:02:09 user nova-compute[74776]: 
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f88209-f492-4b5a-8b38-c34aa8aa8b0c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931, portal: 172.16.0.220,3260]
Nov 22 15:02:09 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931, portal: 172.16.0.220,3260] successful.
Nov 22 15:02:09 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d739c3e-5cd2-42be-b7c5-76c501cb79b8]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac2b4ef-266b-482c-9b91-31a3531aa028]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:02:09 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:02:09 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d09e7b-50e0-416f-b731-73a8271f2c76]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:09 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjSshXem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26466616130323638', 'path': '/dev/sdb'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466616130323638', 'path': '/dev/sdb'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2005445613',display_name='tempest-TestVolumeBootPattern-server-2005445613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2005445613',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB596wO3Zc22AAnzKVxuS9gk5vbChvgktvxVxXEmM2zx1YqGq6iZTXv+hgGEsOzb88w0gyInCqMJG4uw6qi46//XWRxR2yJsl2y9nTchbI5Yumea0irnLv6OU6PAmKKUUA==',key_name='tempest-TestVolumeBootPattern-1110540872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f6764076f2a428ea35c11476a3e7231',ramdisk_id='',reservation_id='r-cbqkkp85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1931721751',owner_user_name='tempest-TestVolumeBootPattern-1931721751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:02:02Z,user_data=None,user_id='d5cce524a8c6419aa76fb4b02861377e',uuid=9a11c064-b17b-4776-9388-6000442fe07f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "address": "fa:16:3e:8f:04:6f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb23e1d9-49", "ovs_interfaceid": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converting VIF {"id": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "address": "fa:16:3e:8f:04:6f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb23e1d9-49", "ovs_interfaceid": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:04:6f,bridge_name='br-int',has_traffic_filtering=True,id=cb23e1d9-49e1-403d-a281-e6a527cd3c93,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb23e1d9-49') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG nova.objects.instance [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a11c064-b17b-4776-9388-6000442fe07f {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:02:10 user nova-compute[74776]:   <uuid>9a11c064-b17b-4776-9388-6000442fe07f</uuid>
Nov 22 15:02:10 user nova-compute[74776]:   <name>instance-00000033</name>
Nov 22 15:02:10 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 15:02:10 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 15:02:10 user nova-compute[74776]:   <metadata>
Nov 22 15:02:10 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:02:10 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 15:02:10 user nova-compute[74776]:       <nova:name>tempest-TestVolumeBootPattern-server-2005445613</nova:name>
Nov 22 15:02:10 user nova-compute[74776]:       <nova:creationTime>2023-11-22 15:02:09</nova:creationTime>
Nov 22 15:02:10 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 15:02:10 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 15:02:10 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 15:02:10 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 15:02:10 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:02:10 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:02:10 user nova-compute[74776]:       </nova:flavor>
Nov 22 15:02:10 user nova-compute[74776]:       <nova:owner>
Nov 22 15:02:10 user nova-compute[74776]:         <nova:user uuid="d5cce524a8c6419aa76fb4b02861377e">tempest-TestVolumeBootPattern-1931721751-project-member</nova:user>
Nov 22 15:02:10 user nova-compute[74776]:         <nova:project uuid="2f6764076f2a428ea35c11476a3e7231">tempest-TestVolumeBootPattern-1931721751</nova:project>
Nov 22 15:02:10 user nova-compute[74776]:       </nova:owner>
Nov 22 15:02:10 user nova-compute[74776]:       <nova:ports>
Nov 22 15:02:10 user nova-compute[74776]:         <nova:port uuid="cb23e1d9-49e1-403d-a281-e6a527cd3c93">
Nov 22 15:02:10 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 22 15:02:10 user nova-compute[74776]:         </nova:port>
Nov 22 15:02:10 user nova-compute[74776]:       </nova:ports>
Nov 22 15:02:10 user nova-compute[74776]:     </nova:instance>
Nov 22 15:02:10 user nova-compute[74776]:   </metadata>
Nov 22 15:02:10 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 15:02:10 user nova-compute[74776]:     <system>
Nov 22 15:02:10 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:02:10 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:02:10 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 15:02:10 user nova-compute[74776]:       <entry name="serial">9a11c064-b17b-4776-9388-6000442fe07f</entry>
Nov 22 15:02:10 user nova-compute[74776]:       <entry name="uuid">9a11c064-b17b-4776-9388-6000442fe07f</entry>
Nov 22 15:02:10 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:02:10 user nova-compute[74776]:     </system>
Nov 22 15:02:10 user nova-compute[74776]:   </sysinfo>
Nov 22 15:02:10 user nova-compute[74776]:   <os>
Nov 22 15:02:10 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:02:10 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 15:02:10 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 15:02:10 user nova-compute[74776]:   </os>
Nov 22 15:02:10 user nova-compute[74776]:   <features>
Nov 22 15:02:10 user nova-compute[74776]:     <acpi/>
Nov 22 15:02:10 user nova-compute[74776]:     <apic/>
Nov 22 15:02:10 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 15:02:10 user nova-compute[74776]:   </features>
Nov 22 15:02:10 user nova-compute[74776]:   <clock offset="utc">
Nov 22 15:02:10 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:02:10 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:02:10 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 15:02:10 user nova-compute[74776]:   </clock>
Nov 22 15:02:10 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 15:02:10 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 15:02:10 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:02:10 user nova-compute[74776]:   </cpu>
Nov 22 15:02:10 user nova-compute[74776]:   <devices>
Nov 22 15:02:10 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 15:02:10 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:02:10 user nova-compute[74776]:       <source dev="/dev/sdb"/>
Nov 22 15:02:10 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 15:02:10 user nova-compute[74776]:       <serial>159b7fb3-5263-4d0f-9280-28957d8ff931</serial>
Nov 22 15:02:10 user nova-compute[74776]:     </disk>
Nov 22 15:02:10 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 15:02:10 user nova-compute[74776]:       <mac address="fa:16:3e:8f:04:6f"/>
Nov 22 15:02:10 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 15:02:10 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 15:02:10 user nova-compute[74776]:       <target dev="tapcb23e1d9-49"/>
Nov 22 15:02:10 user nova-compute[74776]:     </interface>
Nov 22 15:02:10 user nova-compute[74776]:     <serial type="pty">
Nov 22 15:02:10 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/9a11c064-b17b-4776-9388-6000442fe07f/console.log" append="off"/>
Nov 22 15:02:10 user nova-compute[74776]:     </serial>
Nov 22 15:02:10 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:02:10 user nova-compute[74776]:     <video>
Nov 22 15:02:10 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 15:02:10 user nova-compute[74776]:     </video>
Nov 22 15:02:10 user nova-compute[74776]:     <rng model="virtio">
Nov 22 15:02:10 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:02:10 user nova-compute[74776]:     </rng>
Nov 22 15:02:10 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:02:10 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 15:02:10 user nova-compute[74776]:       <stats period="10"/>
Nov 22 15:02:10 user nova-compute[74776]:     </memballoon>
Nov 22 15:02:10 user nova-compute[74776]:   </devices>
Nov 22 15:02:10 user nova-compute[74776]: </domain>
Nov 22 15:02:10 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2005445613',display_name='tempest-TestVolumeBootPattern-server-2005445613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2005445613',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB596wO3Zc22AAnzKVxuS9gk5vbChvgktvxVxXEmM2zx1YqGq6iZTXv+hgGEsOzb88w0gyInCqMJG4uw6qi46//XWRxR2yJsl2y9nTchbI5Yumea0irnLv6OU6PAmKKUUA==',key_name='tempest-TestVolumeBootPattern-1110540872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f6764076f2a428ea35c11476a3e7231',ramdisk_id='',reservation_id='r-cbqkkp85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1931721751',owner_user_name='tempest-TestVolumeBootPattern-1931721751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:02:02Z,user_data=None,user_id='d5cce524a8c6419aa76fb4b02861377e',uuid=9a11c064-b17b-4776-9388-6000442fe07f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "address": "fa:16:3e:8f:04:6f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb23e1d9-49", "ovs_interfaceid": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converting VIF {"id": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "address": "fa:16:3e:8f:04:6f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb23e1d9-49", "ovs_interfaceid": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:04:6f,bridge_name='br-int',has_traffic_filtering=True,id=cb23e1d9-49e1-403d-a281-e6a527cd3c93,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb23e1d9-49') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG os_vif [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:04:6f,bridge_name='br-int',has_traffic_filtering=True,id=cb23e1d9-49e1-403d-a281-e6a527cd3c93,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb23e1d9-49') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0550a58b-8062-50a5-856b-428ea25f5670', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb23e1d9-49, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb23e1d9-49, col_values=(('qos', UUID('fb4e8007-9053-4eb0-a3fd-9b2b6beedf82')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb23e1d9-49, col_values=(('external_ids', {'iface-id': 'cb23e1d9-49e1-403d-a281-e6a527cd3c93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:04:6f', 'vm-uuid': '9a11c064-b17b-4776-9388-6000442fe07f'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:02:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:10 user nova-compute[74776]: INFO os_vif [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:04:6f,bridge_name='br-int',has_traffic_filtering=True,id=cb23e1d9-49e1-403d-a281-e6a527cd3c93,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb23e1d9-49')
Nov 22 15:02:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:02:11 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] No VIF found with MAC fa:16:3e:8f:04:6f, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:02:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-48959096-7ae5-4906-9b3e-bcaf72d466d1 req-7d10f83a-3504-456d-a97b-90fed78cdd1e service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Received event network-vif-plugged-cb23e1d9-49e1-403d-a281-e6a527cd3c93 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:02:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-48959096-7ae5-4906-9b3e-bcaf72d466d1 req-7d10f83a-3504-456d-a97b-90fed78cdd1e service nova] Acquiring lock "9a11c064-b17b-4776-9388-6000442fe07f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:02:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-48959096-7ae5-4906-9b3e-bcaf72d466d1 req-7d10f83a-3504-456d-a97b-90fed78cdd1e service nova] Lock "9a11c064-b17b-4776-9388-6000442fe07f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:02:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-48959096-7ae5-4906-9b3e-bcaf72d466d1 req-7d10f83a-3504-456d-a97b-90fed78cdd1e service nova] Lock "9a11c064-b17b-4776-9388-6000442fe07f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:02:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-48959096-7ae5-4906-9b3e-bcaf72d466d1 req-7d10f83a-3504-456d-a97b-90fed78cdd1e service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] No waiting events found dispatching network-vif-plugged-cb23e1d9-49e1-403d-a281-e6a527cd3c93 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:02:12 user nova-compute[74776]: WARNING nova.compute.manager [req-48959096-7ae5-4906-9b3e-bcaf72d466d1 req-7d10f83a-3504-456d-a97b-90fed78cdd1e service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Received unexpected event network-vif-plugged-cb23e1d9-49e1-403d-a281-e6a527cd3c93 for instance with vm_state building and task_state spawning.
Nov 22 15:02:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:14 user nova-compute[74776]: DEBUG nova.compute.manager [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 15:02:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 15:02:14 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Instance spawned successfully.
Nov 22 15:02:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 15:02:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:02:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:02:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:02:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:02:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:02:14 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:02:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-1b879645-ca70-4ec3-bafe-118c9a6d96e2 req-965e3b57-a9c2-45cd-ae43-160b767e9300 service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Received event network-vif-plugged-cb23e1d9-49e1-403d-a281-e6a527cd3c93 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:02:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1b879645-ca70-4ec3-bafe-118c9a6d96e2 req-965e3b57-a9c2-45cd-ae43-160b767e9300 service nova] Acquiring lock "9a11c064-b17b-4776-9388-6000442fe07f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:02:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1b879645-ca70-4ec3-bafe-118c9a6d96e2 req-965e3b57-a9c2-45cd-ae43-160b767e9300 service nova] Lock "9a11c064-b17b-4776-9388-6000442fe07f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:02:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-1b879645-ca70-4ec3-bafe-118c9a6d96e2 req-965e3b57-a9c2-45cd-ae43-160b767e9300 service nova] Lock "9a11c064-b17b-4776-9388-6000442fe07f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:02:14 user nova-compute[74776]: DEBUG nova.compute.manager [req-1b879645-ca70-4ec3-bafe-118c9a6d96e2 req-965e3b57-a9c2-45cd-ae43-160b767e9300 service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] No waiting events found dispatching network-vif-plugged-cb23e1d9-49e1-403d-a281-e6a527cd3c93 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:02:14 user nova-compute[74776]: WARNING nova.compute.manager [req-1b879645-ca70-4ec3-bafe-118c9a6d96e2 req-965e3b57-a9c2-45cd-ae43-160b767e9300 service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Received unexpected event network-vif-plugged-cb23e1d9-49e1-403d-a281-e6a527cd3c93 for instance with vm_state building and task_state spawning.
Nov 22 15:02:14 user nova-compute[74776]: INFO nova.compute.manager [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 22 15:02:14 user nova-compute[74776]: DEBUG nova.compute.manager [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:02:14 user nova-compute[74776]: INFO nova.compute.manager [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Took 13.46 seconds to build instance.
Nov 22 15:02:14 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-bf934cc2-382a-43c8-b70b-b341662f560d tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "9a11c064-b17b-4776-9388-6000442fe07f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.631s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:02:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:02:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:02:23 user nova-compute[74776]: DEBUG nova.objects.instance [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lazy-loading 'flavor' on Instance uuid 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:02:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:02:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:02:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:02:23 user nova-compute[74776]: INFO nova.compute.manager [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Attaching volume 33d0dd0a-a9a2-4ce6-a067-752bad67e22e to /dev/vdb
Nov 22 15:02:23 user nova-compute[74776]: DEBUG os_brick.utils [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:02:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffbcdda-8bc0-4d32-9531-bd659f83aa4f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9d9696-1900-4ad3-b42a-d9098273cc92]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae78f86-eae6-4b8e-8c06-ae57439c8278]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae953dc1-416c-4a0b-8929-5b7d12afe909]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:02:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:02:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:23 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:02:23 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:02:23 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[172cca3f-49de-4ea7-8a97-af907e1236a2]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:02:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:02:24 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:02:24 user nova-compute[74776]: DEBUG os_brick.utils [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:02:24 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Updating existing volume attachment record: 39f043f8-8132-4f37-88ba-ab188e71f9ec {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:02:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:02:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StEFnVjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:02:29 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:02:29 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:02:29 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[199ae394-6be0-4827-b72e-f5f746de1793]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:02:29 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c2d5de-6062-43ec-848c-52c3664c0f67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e] added
Nov 22 15:02:29 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9d9d10-8fd1-4131-b196-6f0a101e62f3]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9996f387-0809-4498-a90e-60868163ea6a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v StEFnVjc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v StEFnVjc" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[955bf1b5-f6fa-4cce-a1ab-49d57f6cd810]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'StEFnVjc'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14abe7a-a53a-4b50-94ec-35c683a93b91]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[171616e2-f101-44a9-90c3-a233ec542f88]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:02:29 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:02:29 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ca8bf7-4cca-46e3-9e09-3efcf64bbb94]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e, portal: 172.16.0.220,3260]
Nov 22 15:02:29 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e, portal: 172.16.0.220,3260] successful.
Nov 22 15:02:29 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[57185527-f405-44fc-9d2a-64cb762af02e]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5662482-c3ed-4629-8ccf-da8e0f350659]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:02:29 user nova-compute[74776]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e (non-flash)
Nov 22 15:02:29 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:02:29 user nova-compute[74776]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e (non-flash)
Nov 22 15:02:29 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38ad924-9cf6-4fb2-8f31-89f25afeff6d]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:02:29 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StEFnVjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:02:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:02:30 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26563363135316261', 'path': '/dev/sdc'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:02:30 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563363135316261', 'path': '/dev/sdc'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:02:30 user nova-compute[74776]: DEBUG nova.objects.instance [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lazy-loading 'flavor' on Instance uuid 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:02:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 15:02:31 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:02:31 user nova-compute[74776]:   <source dev="/dev/sdc"/>
Nov 22 15:02:31 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:02:31 user nova-compute[74776]:   <serial>33d0dd0a-a9a2-4ce6-a067-752bad67e22e</serial>
Nov 22 15:02:31 user nova-compute[74776]: </disk>
Nov 22 15:02:31 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 15:02:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:02:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:02:31 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] No VIF found with MAC fa:16:3e:93:2c:72, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:02:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:31 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6f281b68-a1a2-47fa-be5e-80d36083b437 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.815s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:02:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:02:33 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:02:33 user nova-compute[74776]: INFO nova.compute.manager [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Detaching volume 33d0dd0a-a9a2-4ce6-a067-752bad67e22e
Nov 22 15:02:33 user nova-compute[74776]: INFO nova.virt.block_device [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Attempting to driver detach volume 33d0dd0a-a9a2-4ce6-a067-752bad67e22e from mountpoint /dev/vdb
Nov 22 15:02:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Attempting to detach device vdb from instance 9d4fd442-1998-409d-84b0-c76ec9a5670d from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 15:02:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:02:33 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:02:33 user nova-compute[74776]:   <source dev="/dev/sdc"/>
Nov 22 15:02:33 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:02:33 user nova-compute[74776]:   <serial>33d0dd0a-a9a2-4ce6-a067-752bad67e22e</serial>
Nov 22 15:02:33 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:02:33 user nova-compute[74776]: </disk>
Nov 22 15:02:33 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:02:33 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Successfully detached device vdb from instance 9d4fd442-1998-409d-84b0-c76ec9a5670d from the persistent domain config.
Nov 22 15:02:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9d4fd442-1998-409d-84b0-c76ec9a5670d from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 15:02:33 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:02:33 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:02:33 user nova-compute[74776]:   <source dev="/dev/sdc"/>
Nov 22 15:02:33 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:02:33 user nova-compute[74776]:   <serial>33d0dd0a-a9a2-4ce6-a067-752bad67e22e</serial>
Nov 22 15:02:33 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:02:33 user nova-compute[74776]: </disk>
Nov 22 15:02:33 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:02:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 15:02:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:40 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:02:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:42 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:02:42 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:02:42 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 15:02:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:02:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:02:42 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 15:02:42 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:02:43 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Updating instance_info_cache with network_info: [{"id": "29c2b1de-7b59-4466-941f-31cbaf33283b", "address": "fa:16:3e:93:2c:72", "network": {"id": "ab23dced-504d-456e-97eb-bbf452866cd7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1753613074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41137c06323a439f987365dc7b885fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c2b1de-7b", "ovs_interfaceid": "29c2b1de-7b59-4466-941f-31cbaf33283b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:02:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:02:43 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 15:02:43 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:02:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:02:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:02:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:02:43 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:02:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:44 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:02:44 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:02:44 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:02:44 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8798MB free_disk=25.035186767578125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:02:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:02:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:02:44 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 9d4fd442-1998-409d-84b0-c76ec9a5670d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:02:44 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 9a11c064-b17b-4776-9388-6000442fe07f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:02:44 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:02:44 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:02:44 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing inventories for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 15:02:44 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating ProviderTree inventory for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 15:02:44 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating inventory in ProviderTree for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 15:02:44 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing aggregate associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, aggregates: None {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 15:02:44 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing trait associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 15:02:44 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:02:44 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:02:44 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:02:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.403s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:02:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:48 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:02:49 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:02:49 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:02:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:02:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 15:02:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:02:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:02:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:02:51 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:02:51 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:02:54 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9d4fd442-1998-409d-84b0-c76ec9a5670d is timed out.
Nov 22 15:02:54 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Successfully detached device vdb from instance 9d4fd442-1998-409d-84b0-c76ec9a5670d from the live domain config.
Nov 22 15:02:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StEFnVjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:02:54 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:02:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd12cbe9-74f1-4ace-9dd9-846d3fb2fb64]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:02:54 user nova-compute[74776]: No targets found.
Nov 22 15:02:54 user nova-compute[74776]: iSNS:
Nov 22 15:02:54 user nova-compute[74776]: No targets found.
Nov 22 15:02:54 user nova-compute[74776]: STATIC:
Nov 22 15:02:54 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e
Nov 22 15:02:54 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:02:54 user nova-compute[74776]:                 Iface Name: default
Nov 22 15:02:54 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931
Nov 22 15:02:54 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:02:54 user nova-compute[74776]:                 Iface Name: default
Nov 22 15:02:54 user nova-compute[74776]: FIRMWARE:
Nov 22 15:02:54 user nova-compute[74776]: No targets found.
Nov 22 15:02:54 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:02:54 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:02:54 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[efde7d74-c3ea-458c-99fa-623daef5fb17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[72777712-6bbf-4a53-af61-f22143866490]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:02:54 user nova-compute[74776]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e (non-flash)
Nov 22 15:02:54 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:02:54 user nova-compute[74776]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e (non-flash)
Nov 22 15:02:54 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c385fdbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e'): ({'sdc'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Removing single pathed devices sdc {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a041736-9405-4c61-84c9-daff6d1e4b84]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba2c672-7ed6-44a1-a316-a2d1523f5b7e]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Flushing IO for device /dev/sdc {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bd273f-fe09-4db4-9bda-20c2c7980e8d]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d793b2e-521c-48d3-9497-c85a270ef8b4]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9530e5f5-7e8e-43d4-b629-330cf492f74d]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8effe7c2-1d3a-4401-a197-bc974aa7dc19]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e, portal: 172.16.0.220,3260]
Nov 22 15:02:54 user nova-compute[74776]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e, portal: 172.16.0.220,3260] successful.
Nov 22 15:02:54 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33d0dd0a-a9a2-4ce6-a067-752bad67e22e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1ae9e7-326b-456c-a3b4-7122fc51a465]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] <== disconnect_volume: return (284ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:02:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:02:55 user nova-compute[74776]: DEBUG nova.objects.instance [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lazy-loading 'flavor' on Instance uuid 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:02:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-df9cc27d-0ce7-423a-ab86-c363a10c303f tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.660s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:02:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:02:57 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:02:57 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:03:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:03:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:03:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 15:03:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:03:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:03:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:03:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:03:06 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:03:06 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:03:09 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:03:09 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74776) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 15:03:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:03:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:03:17 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:03:17 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 15:03:17 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] There are 0 instances to clean {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 15:03:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:03:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:03:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:03:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:03:26 user nova-compute[74776]: DEBUG nova.objects.instance [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lazy-loading 'flavor' on Instance uuid 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:03:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:03:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:03:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:03:26 user nova-compute[74776]: INFO nova.compute.manager [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Attaching volume 5ac72821-e89e-463b-b2fc-df5568eb3b73 to /dev/vdb
Nov 22 15:03:27 user nova-compute[74776]: DEBUG os_brick.utils [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:03:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5493040-53f6-4203-94a8-e202702d7915]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff07d0b-9a4a-4ca6-aaed-238560047fd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c2343f-129c-4fd8-b8e4-c87d836bd782]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccff1b9f-5c6f-4605-bcdf-f097fbec2bb1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:03:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:03:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:27 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:03:27 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:03:27 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bdab13-aa46-456a-af07-caeb452e63b7]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:03:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:03:27 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:03:27 user nova-compute[74776]: DEBUG os_brick.utils [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:03:27 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Updating existing volume attachment record: 87811dd7-b673-4948-b020-7df3c28ae18d {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:03:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:03:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:03:32 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:03:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMleSvxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:03:32 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:03:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:03:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:03:32 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:03:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:03:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:03:32 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:03:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:32 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3872fc63-7f4b-4823-b349-41829cdd2f47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:03:32 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:03:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:32 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f0cedf-cc8e-40b1-b27d-51365cd8ac7f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73] added
Nov 22 15:03:32 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:03:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:32 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dca2d12-455f-4277-827a-98a1ebdf3e49]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:03:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:32 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec723a6-1ca5-40a1-8930-9eb1eac36e04]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:32 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:03:32 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMleSvxs {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMleSvxs" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2e3286-d3ff-4b0a-b2c4-a196cb6e7060]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QMleSvxs'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cec2784-b85b-4b6f-aa49-0cdc08b65f40]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e96f075-d3d6-491f-9b14-b182b244bca6]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:03:33 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:03:33 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[86835d0b-e94b-4d04-8df7-d83ab16b03bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73, portal: 172.16.0.220,3260]
Nov 22 15:03:33 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73, portal: 172.16.0.220,3260] successful.
Nov 22 15:03:33 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0251cd-49e6-4470-8cf0-eaab9aeb51bd]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c123a0-f8eb-48ab-803d-73a9fa4fbcb6]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:03:33 user nova-compute[74776]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 (non-flash)
Nov 22 15:03:33 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:03:33 user nova-compute[74776]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 (non-flash)
Nov 22 15:03:33 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] HCTL ('34', '-', '-', 0) found on session 62 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[63828e98-3a7a-489a-9c42-5bec32b5fbdf]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:03:33 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMleSvxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:03:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:03:34 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26635346531623239', 'path': '/dev/sdc'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:03:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635346531623239', 'path': '/dev/sdc'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:03:34 user nova-compute[74776]: DEBUG nova.objects.instance [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lazy-loading 'flavor' on Instance uuid 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:03:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 15:03:34 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:03:34 user nova-compute[74776]:   <source dev="/dev/sdc"/>
Nov 22 15:03:34 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:03:34 user nova-compute[74776]:   <serial>5ac72821-e89e-463b-b2fc-df5568eb3b73</serial>
Nov 22 15:03:34 user nova-compute[74776]: </disk>
Nov 22 15:03:34 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 15:03:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:03:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:03:34 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] No VIF found with MAC fa:16:3e:93:2c:72, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:03:34 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-4b31ded7-fa05-48c0-a451-727c5e82add1 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.755s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:03:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:03:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:03:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:03:37 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:03:37 user nova-compute[74776]: INFO nova.compute.manager [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Detaching volume 5ac72821-e89e-463b-b2fc-df5568eb3b73
Nov 22 15:03:37 user nova-compute[74776]: INFO nova.virt.block_device [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Attempting to driver detach volume 5ac72821-e89e-463b-b2fc-df5568eb3b73 from mountpoint /dev/vdb
Nov 22 15:03:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Attempting to detach device vdb from instance 9d4fd442-1998-409d-84b0-c76ec9a5670d from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 15:03:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:03:37 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:03:37 user nova-compute[74776]:   <source dev="/dev/sdc"/>
Nov 22 15:03:37 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:03:37 user nova-compute[74776]:   <serial>5ac72821-e89e-463b-b2fc-df5568eb3b73</serial>
Nov 22 15:03:37 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:03:37 user nova-compute[74776]: </disk>
Nov 22 15:03:37 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:03:37 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Successfully detached device vdb from instance 9d4fd442-1998-409d-84b0-c76ec9a5670d from the persistent domain config.
Nov 22 15:03:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9d4fd442-1998-409d-84b0-c76ec9a5670d from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 15:03:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:03:37 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:03:37 user nova-compute[74776]:   <source dev="/dev/sdc"/>
Nov 22 15:03:37 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:03:37 user nova-compute[74776]:   <serial>5ac72821-e89e-463b-b2fc-df5568eb3b73</serial>
Nov 22 15:03:37 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:03:37 user nova-compute[74776]: </disk>
Nov 22 15:03:37 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:03:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 15:03:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:03:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:03:42 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:03:42 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:03:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-9a11c064-b17b-4776-9388-6000442fe07f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:03:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-9a11c064-b17b-4776-9388-6000442fe07f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:03:42 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 15:03:43 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Updating instance_info_cache with network_info: [{"id": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "address": "fa:16:3e:8f:04:6f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb23e1d9-49", "ovs_interfaceid": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:03:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-9a11c064-b17b-4776-9388-6000442fe07f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:03:43 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 15:03:43 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:03:45 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:03:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:03:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:03:45 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:03:45 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:03:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:45 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:03:46 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:03:46 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:03:46 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:03:46 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8848MB free_disk=25.034217834472656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:03:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:03:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:03:46 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 9d4fd442-1998-409d-84b0-c76ec9a5670d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:03:46 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 9a11c064-b17b-4776-9388-6000442fe07f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:03:46 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:03:46 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:03:46 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:03:46 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:03:46 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:03:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:03:48 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:03:49 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:03:49 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:03:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:03:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:03:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 15:03:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:03:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:03:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:03:51 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:03:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:03:52 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:03:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-29d42b9c-4414-422f-9a6e-12f61e4b7ba8 req-6739936a-97d7-43de-a1fa-941a867b2587 service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Received event network-changed-cb23e1d9-49e1-403d-a281-e6a527cd3c93 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:03:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-29d42b9c-4414-422f-9a6e-12f61e4b7ba8 req-6739936a-97d7-43de-a1fa-941a867b2587 service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Refreshing instance network info cache due to event network-changed-cb23e1d9-49e1-403d-a281-e6a527cd3c93. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:03:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29d42b9c-4414-422f-9a6e-12f61e4b7ba8 req-6739936a-97d7-43de-a1fa-941a867b2587 service nova] Acquiring lock "refresh_cache-9a11c064-b17b-4776-9388-6000442fe07f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:03:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29d42b9c-4414-422f-9a6e-12f61e4b7ba8 req-6739936a-97d7-43de-a1fa-941a867b2587 service nova] Acquired lock "refresh_cache-9a11c064-b17b-4776-9388-6000442fe07f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:03:53 user nova-compute[74776]: DEBUG nova.network.neutron [req-29d42b9c-4414-422f-9a6e-12f61e4b7ba8 req-6739936a-97d7-43de-a1fa-941a867b2587 service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Refreshing network info cache for port cb23e1d9-49e1-403d-a281-e6a527cd3c93 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:03:53 user nova-compute[74776]: DEBUG nova.network.neutron [req-29d42b9c-4414-422f-9a6e-12f61e4b7ba8 req-6739936a-97d7-43de-a1fa-941a867b2587 service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Updated VIF entry in instance network info cache for port cb23e1d9-49e1-403d-a281-e6a527cd3c93. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:03:53 user nova-compute[74776]: DEBUG nova.network.neutron [req-29d42b9c-4414-422f-9a6e-12f61e4b7ba8 req-6739936a-97d7-43de-a1fa-941a867b2587 service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Updating instance_info_cache with network_info: [{"id": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "address": "fa:16:3e:8f:04:6f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb23e1d9-49", "ovs_interfaceid": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:03:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-29d42b9c-4414-422f-9a6e-12f61e4b7ba8 req-6739936a-97d7-43de-a1fa-941a867b2587 service nova] Releasing lock "refresh_cache-9a11c064-b17b-4776-9388-6000442fe07f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:03:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:03:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:03:57 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9d4fd442-1998-409d-84b0-c76ec9a5670d is timed out.
Nov 22 15:03:57 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Successfully detached device vdb from instance 9d4fd442-1998-409d-84b0-c76ec9a5670d from the live domain config.
Nov 22 15:03:57 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMleSvxs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:03:57 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:03:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1e5a08-a832-49e3-b485-637f6cd49b23]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:03:57 user nova-compute[74776]: No targets found.
Nov 22 15:03:57 user nova-compute[74776]: iSNS:
Nov 22 15:03:57 user nova-compute[74776]: No targets found.
Nov 22 15:03:57 user nova-compute[74776]: STATIC:
Nov 22 15:03:57 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931
Nov 22 15:03:57 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:03:57 user nova-compute[74776]:                 Iface Name: default
Nov 22 15:03:57 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73
Nov 22 15:03:57 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:03:57 user nova-compute[74776]:                 Iface Name: default
Nov 22 15:03:57 user nova-compute[74776]: FIRMWARE:
Nov 22 15:03:57 user nova-compute[74776]: No targets found.
Nov 22 15:03:57 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:03:57 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:03:57 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb7e8bd-d28a-4ad7-9c6f-175849ffd6d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c5cba4-7d7f-455f-8622-11d4cb546ba2]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:03:57 user nova-compute[74776]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 (non-flash)
Nov 22 15:03:57 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:03:57 user nova-compute[74776]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 (non-flash)
Nov 22 15:03:57 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c387d9090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73'): ({'sdc'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Removing single pathed devices sdc {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dcfe4c-8712-4862-a9b3-10e4ac3b2019]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6dd547-bc59-4abe-9584-7860e8125872]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Flushing IO for device /dev/sdc {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e107d2-a2e7-4a7b-b099-ab8d77af232b]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4375964c-9408-4c18-b100-11e98a3acce3]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4ff1af-53f6-4c91-a9e4-8a463438a62f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e41917d-7aa1-46a8-a8a8-ba84d25df813]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73, portal: 172.16.0.220,3260]
Nov 22 15:03:57 user nova-compute[74776]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73, portal: 172.16.0.220,3260] successful.
Nov 22 15:03:57 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:03:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:03:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac72821-e89e-463b-b2fc-df5568eb3b73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:03:58 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d158048-fd1a-4cc8-a905-a75c38ab3f7a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:03:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:03:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:03:58 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] <== disconnect_volume: return (300ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:03:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:03:58 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:03:58 user nova-compute[74776]: DEBUG nova.objects.instance [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lazy-loading 'flavor' on Instance uuid 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:03:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-367631fe-424b-4983-9ef0-3b7f7a1d1399 tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.658s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:04:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "3699ada6-b27d-4987-a546-745897748243" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:04:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "3699ada6-b27d-4987-a546-745897748243" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:04:00 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 15:04:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:04:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:04:00 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 15:04:00 user nova-compute[74776]: INFO nova.compute.claims [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Claim successful on node user
Nov 22 15:04:00 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:04:00 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:04:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:04:00 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 15:04:00 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 15:04:00 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 15:04:00 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 15:04:00 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 15:04:00 user nova-compute[74776]: INFO nova.virt.block_device [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Booting with volume b0c0aa36-1fe7-44d4-a60e-d843442d3156 at /dev/vda
Nov 22 15:04:00 user nova-compute[74776]: DEBUG nova.policy [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5cce524a8c6419aa76fb4b02861377e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6764076f2a428ea35c11476a3e7231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG os_brick.utils [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ac7529-b86c-4fb4-9823-0f6c55422108]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e626dac0-abac-42b6-a748-54c3ab7236ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4dcb4e-a9a9-48f8-b1cf-bd975f6ad643]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9186ec4-9dac-4e2f-aad2-1e51822b233c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:04:01 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:04:01 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb25f1be-ec7c-49e5-b774-03e5754fe2de]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG os_brick.utils [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Updating existing volume attachment record: c3d2e961-d8c8-4422-a1b1-5dc55e868538 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:01 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Successfully created port: 8ccb3bb2-5b87-477f-b534-67569e3c8fe3 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:04:02 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Successfully updated port: 8ccb3bb2-5b87-477f-b534-67569e3c8fe3 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:04:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "refresh_cache-3699ada6-b27d-4987-a546-745897748243" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:04:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquired lock "refresh_cache-3699ada6-b27d-4987-a546-745897748243" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:04:02 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:04:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-eb47b8a9-c44d-4341-9039-0d7774aaca5d req-6585e10c-b394-435a-b7e6-7683452bc1bb service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Received event network-changed-8ccb3bb2-5b87-477f-b534-67569e3c8fe3 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:04:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-eb47b8a9-c44d-4341-9039-0d7774aaca5d req-6585e10c-b394-435a-b7e6-7683452bc1bb service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Refreshing instance network info cache due to event network-changed-8ccb3bb2-5b87-477f-b534-67569e3c8fe3. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:04:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-eb47b8a9-c44d-4341-9039-0d7774aaca5d req-6585e10c-b394-435a-b7e6-7683452bc1bb service nova] Acquiring lock "refresh_cache-3699ada6-b27d-4987-a546-745897748243" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:04:02 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:04:03 user nova-compute[74776]: DEBUG nova.network.neutron [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Updating instance_info_cache with network_info: [{"id": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "address": "fa:16:3e:e9:fe:13", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccb3bb2-5b", "ovs_interfaceid": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:04:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Releasing lock "refresh_cache-3699ada6-b27d-4987-a546-745897748243" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:04:03 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Instance network_info: |[{"id": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "address": "fa:16:3e:e9:fe:13", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccb3bb2-5b", "ovs_interfaceid": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 15:04:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-eb47b8a9-c44d-4341-9039-0d7774aaca5d req-6585e10c-b394-435a-b7e6-7683452bc1bb service nova] Acquired lock "refresh_cache-3699ada6-b27d-4987-a546-745897748243" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:04:03 user nova-compute[74776]: DEBUG nova.network.neutron [req-eb47b8a9-c44d-4341-9039-0d7774aaca5d req-6585e10c-b394-435a-b7e6-7683452bc1bb service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Refreshing network info cache for port 8ccb3bb2-5b87-477f-b534-67569e3c8fe3 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:04:03 user nova-compute[74776]: DEBUG nova.network.neutron [req-eb47b8a9-c44d-4341-9039-0d7774aaca5d req-6585e10c-b394-435a-b7e6-7683452bc1bb service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Updated VIF entry in instance network info cache for port 8ccb3bb2-5b87-477f-b534-67569e3c8fe3. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:04:03 user nova-compute[74776]: DEBUG nova.network.neutron [req-eb47b8a9-c44d-4341-9039-0d7774aaca5d req-6585e10c-b394-435a-b7e6-7683452bc1bb service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Updating instance_info_cache with network_info: [{"id": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "address": "fa:16:3e:e9:fe:13", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccb3bb2-5b", "ovs_interfaceid": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:04:03 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-eb47b8a9-c44d-4341-9039-0d7774aaca5d req-6585e10c-b394-435a-b7e6-7683452bc1bb service nova] Releasing lock "refresh_cache-3699ada6-b27d-4987-a546-745897748243" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:04:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 15:04:07 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Creating image(s)
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Did not create local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Ensure instance console log exists: /opt/stack/data/nova/instances/3699ada6-b27d-4987-a546-745897748243/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Start _get_guest_xml network_info=[{"id": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "address": "fa:16:3e:e9:fe:13", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccb3bb2-5b", "ovs_interfaceid": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c3d2e961-d8c8-4422-a1b1-5dc55e868538', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGkgOcSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3699ada6-b27d-4987-a546-745897748243', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0c0aa36-1fe7-44d4-a60e-d843442d3156', 'serial': 'b0c0aa36-1fe7-44d4-a60e-d843442d3156'}, 'boot_index': 0, 'volume_type': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:04:07 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:04:07 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGkgOcSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:04:07 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:04:07 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:04:07 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ec103e-f6ed-4f2b-826b-fad5885fb224]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:04:07 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1f914a-e1d7-48b8-8b53-87dba0b70dbd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156] added
Nov 22 15:04:07 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8c31a9-48c7-40dc-a772-ede8086b6983]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[72705c70-07c3-49fe-b89d-428e2c065d16]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TGkgOcSp {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TGkgOcSp" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae920c4b-e93c-4d99-bf55-abf45bf0111e]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TGkgOcSp'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23b9774-59f0-43b1-824e-571d2572115a]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[457fdbd4-bf10-4bb3-849e-e5967c16c5bd]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:04:07 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:04:07 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[643a787f-b99b-4ff8-813a-0b02cb29af5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156, portal: 172.16.0.220,3260]
Nov 22 15:04:07 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156, portal: 172.16.0.220,3260] successful.
Nov 22 15:04:07 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af67b68-2145-4167-ae6f-77e3ba85a409]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[06aa5f96-9a3f-4eed-b569-16491eb65c3e]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:04:07 user nova-compute[74776]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 (non-flash)
Nov 22 15:04:07 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:04:07 user nova-compute[74776]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 (non-flash)
Nov 22 15:04:07 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[052f0e61-8a25-42fc-a57d-c4826dcbf6cc]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:04:07 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGkgOcSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26136353865343866', 'path': '/dev/sdc'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136353865343866', 'path': '/dev/sdc'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-330164992',display_name='tempest-TestVolumeBootPattern-server-330164992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-330164992',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB596wO3Zc22AAnzKVxuS9gk5vbChvgktvxVxXEmM2zx1YqGq6iZTXv+hgGEsOzb88w0gyInCqMJG4uw6qi46//XWRxR2yJsl2y9nTchbI5Yumea0irnLv6OU6PAmKKUUA==',key_name='tempest-TestVolumeBootPattern-1110540872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f6764076f2a428ea35c11476a3e7231',ramdisk_id='',reservation_id='r-3s3icej4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1931721751',owner_user_name='tempest-TestVolumeBootPattern-1931721751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:04:01Z,user_data=None,user_id='d5cce524a8c6419aa76fb4b02861377e',uuid=3699ada6-b27d-4987-a546-745897748243,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "address": "fa:16:3e:e9:fe:13", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccb3bb2-5b", "ovs_interfaceid": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converting VIF {"id": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "address": "fa:16:3e:e9:fe:13", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccb3bb2-5b", "ovs_interfaceid": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:fe:13,bridge_name='br-int',has_traffic_filtering=True,id=8ccb3bb2-5b87-477f-b534-67569e3c8fe3,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccb3bb2-5b') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG nova.objects.instance [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lazy-loading 'pci_devices' on Instance uuid 3699ada6-b27d-4987-a546-745897748243 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:04:08 user nova-compute[74776]:   <uuid>3699ada6-b27d-4987-a546-745897748243</uuid>
Nov 22 15:04:08 user nova-compute[74776]:   <name>instance-00000034</name>
Nov 22 15:04:08 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 15:04:08 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 15:04:08 user nova-compute[74776]:   <metadata>
Nov 22 15:04:08 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:04:08 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 15:04:08 user nova-compute[74776]:       <nova:name>tempest-TestVolumeBootPattern-server-330164992</nova:name>
Nov 22 15:04:08 user nova-compute[74776]:       <nova:creationTime>2023-11-22 15:04:07</nova:creationTime>
Nov 22 15:04:08 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 15:04:08 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 15:04:08 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 15:04:08 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 15:04:08 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:04:08 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:04:08 user nova-compute[74776]:       </nova:flavor>
Nov 22 15:04:08 user nova-compute[74776]:       <nova:owner>
Nov 22 15:04:08 user nova-compute[74776]:         <nova:user uuid="d5cce524a8c6419aa76fb4b02861377e">tempest-TestVolumeBootPattern-1931721751-project-member</nova:user>
Nov 22 15:04:08 user nova-compute[74776]:         <nova:project uuid="2f6764076f2a428ea35c11476a3e7231">tempest-TestVolumeBootPattern-1931721751</nova:project>
Nov 22 15:04:08 user nova-compute[74776]:       </nova:owner>
Nov 22 15:04:08 user nova-compute[74776]:       <nova:ports>
Nov 22 15:04:08 user nova-compute[74776]:         <nova:port uuid="8ccb3bb2-5b87-477f-b534-67569e3c8fe3">
Nov 22 15:04:08 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 22 15:04:08 user nova-compute[74776]:         </nova:port>
Nov 22 15:04:08 user nova-compute[74776]:       </nova:ports>
Nov 22 15:04:08 user nova-compute[74776]:     </nova:instance>
Nov 22 15:04:08 user nova-compute[74776]:   </metadata>
Nov 22 15:04:08 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 15:04:08 user nova-compute[74776]:     <system>
Nov 22 15:04:08 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:04:08 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:04:08 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 15:04:08 user nova-compute[74776]:       <entry name="serial">3699ada6-b27d-4987-a546-745897748243</entry>
Nov 22 15:04:08 user nova-compute[74776]:       <entry name="uuid">3699ada6-b27d-4987-a546-745897748243</entry>
Nov 22 15:04:08 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:04:08 user nova-compute[74776]:     </system>
Nov 22 15:04:08 user nova-compute[74776]:   </sysinfo>
Nov 22 15:04:08 user nova-compute[74776]:   <os>
Nov 22 15:04:08 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:04:08 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 15:04:08 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 15:04:08 user nova-compute[74776]:   </os>
Nov 22 15:04:08 user nova-compute[74776]:   <features>
Nov 22 15:04:08 user nova-compute[74776]:     <acpi/>
Nov 22 15:04:08 user nova-compute[74776]:     <apic/>
Nov 22 15:04:08 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 15:04:08 user nova-compute[74776]:   </features>
Nov 22 15:04:08 user nova-compute[74776]:   <clock offset="utc">
Nov 22 15:04:08 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:04:08 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:04:08 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 15:04:08 user nova-compute[74776]:   </clock>
Nov 22 15:04:08 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 15:04:08 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 15:04:08 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:04:08 user nova-compute[74776]:   </cpu>
Nov 22 15:04:08 user nova-compute[74776]:   <devices>
Nov 22 15:04:08 user nova-compute[74776]:     <disk type="block" device="disk">
Nov 22 15:04:08 user nova-compute[74776]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:04:08 user nova-compute[74776]:       <source dev="/dev/sdc"/>
Nov 22 15:04:08 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 15:04:08 user nova-compute[74776]:       <serial>b0c0aa36-1fe7-44d4-a60e-d843442d3156</serial>
Nov 22 15:04:08 user nova-compute[74776]:     </disk>
Nov 22 15:04:08 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 15:04:08 user nova-compute[74776]:       <mac address="fa:16:3e:e9:fe:13"/>
Nov 22 15:04:08 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 15:04:08 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 15:04:08 user nova-compute[74776]:       <target dev="tap8ccb3bb2-5b"/>
Nov 22 15:04:08 user nova-compute[74776]:     </interface>
Nov 22 15:04:08 user nova-compute[74776]:     <serial type="pty">
Nov 22 15:04:08 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/3699ada6-b27d-4987-a546-745897748243/console.log" append="off"/>
Nov 22 15:04:08 user nova-compute[74776]:     </serial>
Nov 22 15:04:08 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:04:08 user nova-compute[74776]:     <video>
Nov 22 15:04:08 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 15:04:08 user nova-compute[74776]:     </video>
Nov 22 15:04:08 user nova-compute[74776]:     <rng model="virtio">
Nov 22 15:04:08 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:04:08 user nova-compute[74776]:     </rng>
Nov 22 15:04:08 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:04:08 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 15:04:08 user nova-compute[74776]:       <stats period="10"/>
Nov 22 15:04:08 user nova-compute[74776]:     </memballoon>
Nov 22 15:04:08 user nova-compute[74776]:   </devices>
Nov 22 15:04:08 user nova-compute[74776]: </domain>
Nov 22 15:04:08 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-330164992',display_name='tempest-TestVolumeBootPattern-server-330164992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-330164992',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB596wO3Zc22AAnzKVxuS9gk5vbChvgktvxVxXEmM2zx1YqGq6iZTXv+hgGEsOzb88w0gyInCqMJG4uw6qi46//XWRxR2yJsl2y9nTchbI5Yumea0irnLv6OU6PAmKKUUA==',key_name='tempest-TestVolumeBootPattern-1110540872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f6764076f2a428ea35c11476a3e7231',ramdisk_id='',reservation_id='r-3s3icej4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1931721751',owner_user_name='tempest-TestVolumeBootPattern-1931721751-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:04:01Z,user_data=None,user_id='d5cce524a8c6419aa76fb4b02861377e',uuid=3699ada6-b27d-4987-a546-745897748243,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "address": "fa:16:3e:e9:fe:13", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccb3bb2-5b", "ovs_interfaceid": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converting VIF {"id": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "address": "fa:16:3e:e9:fe:13", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccb3bb2-5b", "ovs_interfaceid": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:fe:13,bridge_name='br-int',has_traffic_filtering=True,id=8ccb3bb2-5b87-477f-b534-67569e3c8fe3,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccb3bb2-5b') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG os_vif [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:fe:13,bridge_name='br-int',has_traffic_filtering=True,id=8ccb3bb2-5b87-477f-b534-67569e3c8fe3,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccb3bb2-5b') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef70f893-ac23-52ff-993d-a140e6a3492e', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ccb3bb2-5b, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ccb3bb2-5b, col_values=(('qos', UUID('489f1b43-3caa-4686-bfc1-9c0fa5e9a546')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ccb3bb2-5b, col_values=(('external_ids', {'iface-id': '8ccb3bb2-5b87-477f-b534-67569e3c8fe3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:fe:13', 'vm-uuid': '3699ada6-b27d-4987-a546-745897748243'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:08 user nova-compute[74776]: INFO os_vif [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:fe:13,bridge_name='br-int',has_traffic_filtering=True,id=8ccb3bb2-5b87-477f-b534-67569e3c8fe3,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccb3bb2-5b')
Nov 22 15:04:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:04:08 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] No VIF found with MAC fa:16:3e:e9:fe:13, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:04:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:10 user nova-compute[74776]: DEBUG nova.compute.manager [req-0fbbb8e2-8317-46ec-81cc-ddbc837de444 req-385ea09e-d667-4dd2-a3c2-911af7ce9230 service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Received event network-vif-plugged-8ccb3bb2-5b87-477f-b534-67569e3c8fe3 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:04:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0fbbb8e2-8317-46ec-81cc-ddbc837de444 req-385ea09e-d667-4dd2-a3c2-911af7ce9230 service nova] Acquiring lock "3699ada6-b27d-4987-a546-745897748243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:04:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0fbbb8e2-8317-46ec-81cc-ddbc837de444 req-385ea09e-d667-4dd2-a3c2-911af7ce9230 service nova] Lock "3699ada6-b27d-4987-a546-745897748243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:04:10 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-0fbbb8e2-8317-46ec-81cc-ddbc837de444 req-385ea09e-d667-4dd2-a3c2-911af7ce9230 service nova] Lock "3699ada6-b27d-4987-a546-745897748243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:04:10 user nova-compute[74776]: DEBUG nova.compute.manager [req-0fbbb8e2-8317-46ec-81cc-ddbc837de444 req-385ea09e-d667-4dd2-a3c2-911af7ce9230 service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] No waiting events found dispatching network-vif-plugged-8ccb3bb2-5b87-477f-b534-67569e3c8fe3 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:04:10 user nova-compute[74776]: WARNING nova.compute.manager [req-0fbbb8e2-8317-46ec-81cc-ddbc837de444 req-385ea09e-d667-4dd2-a3c2-911af7ce9230 service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Received unexpected event network-vif-plugged-8ccb3bb2-5b87-477f-b534-67569e3c8fe3 for instance with vm_state building and task_state spawning.
Nov 22 15:04:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 15:04:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 15:04:12 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 3699ada6-b27d-4987-a546-745897748243] Instance spawned successfully.
Nov 22 15:04:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 15:04:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:04:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:04:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:04:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:04:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:04:12 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:04:12 user nova-compute[74776]: INFO nova.compute.manager [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Took 4.84 seconds to spawn the instance on the hypervisor.
Nov 22 15:04:12 user nova-compute[74776]: DEBUG nova.compute.manager [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:04:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-f6014b68-0bd2-4400-8d55-cf663f3d2bf3 req-2789b623-829e-41e5-a06e-645250ffb7d3 service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Received event network-vif-plugged-8ccb3bb2-5b87-477f-b534-67569e3c8fe3 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:04:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f6014b68-0bd2-4400-8d55-cf663f3d2bf3 req-2789b623-829e-41e5-a06e-645250ffb7d3 service nova] Acquiring lock "3699ada6-b27d-4987-a546-745897748243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:04:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f6014b68-0bd2-4400-8d55-cf663f3d2bf3 req-2789b623-829e-41e5-a06e-645250ffb7d3 service nova] Lock "3699ada6-b27d-4987-a546-745897748243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:04:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-f6014b68-0bd2-4400-8d55-cf663f3d2bf3 req-2789b623-829e-41e5-a06e-645250ffb7d3 service nova] Lock "3699ada6-b27d-4987-a546-745897748243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:04:12 user nova-compute[74776]: DEBUG nova.compute.manager [req-f6014b68-0bd2-4400-8d55-cf663f3d2bf3 req-2789b623-829e-41e5-a06e-645250ffb7d3 service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] No waiting events found dispatching network-vif-plugged-8ccb3bb2-5b87-477f-b534-67569e3c8fe3 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:04:12 user nova-compute[74776]: WARNING nova.compute.manager [req-f6014b68-0bd2-4400-8d55-cf663f3d2bf3 req-2789b623-829e-41e5-a06e-645250ffb7d3 service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Received unexpected event network-vif-plugged-8ccb3bb2-5b87-477f-b534-67569e3c8fe3 for instance with vm_state building and task_state spawning.
Nov 22 15:04:12 user nova-compute[74776]: INFO nova.compute.manager [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Took 11.74 seconds to build instance.
Nov 22 15:04:12 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-0bd404bd-4d0a-403e-9d57-41e72f5ebe09 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "3699ada6-b27d-4987-a546-745897748243" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.840s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:04:13 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:04:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 15:04:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:04:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:04:18 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:23 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:04:23 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 15:04:23 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 9a11c064-b17b-4776-9388-6000442fe07f {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 15:04:23 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 3699ada6-b27d-4987-a546-745897748243 {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 15:04:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:04:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:04:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "9a11c064-b17b-4776-9388-6000442fe07f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:04:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "9a11c064-b17b-4776-9388-6000442fe07f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:04:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "3699ada6-b27d-4987-a546-745897748243" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:04:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "3699ada6-b27d-4987-a546-745897748243" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:04:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:04:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "9a11c064-b17b-4776-9388-6000442fe07f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:04:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "3699ada6-b27d-4987-a546-745897748243" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:04:23 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:04:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:28 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:38 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:42 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:04:42 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:04:42 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 15:04:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:04:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:04:42 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 15:04:42 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:04:43 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Updating instance_info_cache with network_info: [{"id": "29c2b1de-7b59-4466-941f-31cbaf33283b", "address": "fa:16:3e:93:2c:72", "network": {"id": "ab23dced-504d-456e-97eb-bbf452866cd7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1753613074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41137c06323a439f987365dc7b885fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c2b1de-7b", "ovs_interfaceid": "29c2b1de-7b59-4466-941f-31cbaf33283b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:04:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-9d4fd442-1998-409d-84b0-c76ec9a5670d" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:04:43 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 15:04:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:44 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:04:47 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:04:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:04:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:04:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:04:47 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:04:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:04:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:04:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:04:48 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:04:48 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:04:48 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:04:48 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:04:48 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:04:48 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8700MB free_disk=25.031902313232422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:04:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:04:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:04:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:04:48 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 9d4fd442-1998-409d-84b0-c76ec9a5670d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:04:48 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 9a11c064-b17b-4776-9388-6000442fe07f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:04:48 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 3699ada6-b27d-4987-a546-745897748243 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:04:48 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:04:48 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:04:48 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:04:48 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:04:48 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:04:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:04:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:04:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:04:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "9d4fd442-1998-409d-84b0-c76ec9a5670d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:04:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:04:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:04:49 user nova-compute[74776]: INFO nova.compute.manager [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Terminating instance
Nov 22 15:04:49 user nova-compute[74776]: DEBUG nova.compute.manager [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 15:04:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:49 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-ff7ccfe5-bbd1-4d4a-b739-5e57736bfb3a req-aac19451-a33f-408b-ad78-30f224d7e2ed service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Received event network-vif-unplugged-29c2b1de-7b59-4466-941f-31cbaf33283b {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ff7ccfe5-bbd1-4d4a-b739-5e57736bfb3a req-aac19451-a33f-408b-ad78-30f224d7e2ed service nova] Acquiring lock "9d4fd442-1998-409d-84b0-c76ec9a5670d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ff7ccfe5-bbd1-4d4a-b739-5e57736bfb3a req-aac19451-a33f-408b-ad78-30f224d7e2ed service nova] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ff7ccfe5-bbd1-4d4a-b739-5e57736bfb3a req-aac19451-a33f-408b-ad78-30f224d7e2ed service nova] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-ff7ccfe5-bbd1-4d4a-b739-5e57736bfb3a req-aac19451-a33f-408b-ad78-30f224d7e2ed service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] No waiting events found dispatching network-vif-unplugged-29c2b1de-7b59-4466-941f-31cbaf33283b {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG nova.compute.manager [req-ff7ccfe5-bbd1-4d4a-b739-5e57736bfb3a req-aac19451-a33f-408b-ad78-30f224d7e2ed service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Received event network-vif-unplugged-29c2b1de-7b59-4466-941f-31cbaf33283b for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:04:50 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Instance destroyed successfully.
Nov 22 15:04:50 user nova-compute[74776]: DEBUG nova.objects.instance [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lazy-loading 'resources' on Instance uuid 9d4fd442-1998-409d-84b0-c76ec9a5670d {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T14:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1623062926',display_name='tempest-SnapshotDataIntegrityTests-server-1623062926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1623062926',id=49,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH69bfY3T4FVEUA5MXSB19jTWlL/AvFn5pTobr755Z162N/1t5IgP34aFa5YYV1rubJh1Eb8TVLqJFNis0qC3EeHf5AWpGhG4RFIqwLI015HO+o7flLXfBHYYngGAUQF4A==',key_name='tempest-keypair-1198651069',keypairs=<?>,launch_index=0,launched_at=2023-11-22T14:58:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41137c06323a439f987365dc7b885fd5',ramdisk_id='',reservation_id='r-f4c6uef4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1997075541',owner_user_name='tempest-SnapshotDataIntegrityTests-1997075541-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T14:58:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='874a278f90444a69b1824c4d161efe99',uuid=9d4fd442-1998-409d-84b0-c76ec9a5670d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29c2b1de-7b59-4466-941f-31cbaf33283b", "address": "fa:16:3e:93:2c:72", "network": {"id": "ab23dced-504d-456e-97eb-bbf452866cd7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1753613074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41137c06323a439f987365dc7b885fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c2b1de-7b", "ovs_interfaceid": "29c2b1de-7b59-4466-941f-31cbaf33283b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Converting VIF {"id": "29c2b1de-7b59-4466-941f-31cbaf33283b", "address": "fa:16:3e:93:2c:72", "network": {"id": "ab23dced-504d-456e-97eb-bbf452866cd7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1753613074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41137c06323a439f987365dc7b885fd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c2b1de-7b", "ovs_interfaceid": "29c2b1de-7b59-4466-941f-31cbaf33283b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=29c2b1de-7b59-4466-941f-31cbaf33283b,network=Network(ab23dced-504d-456e-97eb-bbf452866cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c2b1de-7b') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG os_vif [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=29c2b1de-7b59-4466-941f-31cbaf33283b,network=Network(ab23dced-504d-456e-97eb-bbf452866cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c2b1de-7b') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29c2b1de-7b, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82fdbc52-cb69-4bb8-9ccf-78c8bc444e2b) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:04:50 user nova-compute[74776]: INFO os_vif [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:2c:72,bridge_name='br-int',has_traffic_filtering=True,id=29c2b1de-7b59-4466-941f-31cbaf33283b,network=Network(ab23dced-504d-456e-97eb-bbf452866cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c2b1de-7b')
Nov 22 15:04:50 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Deleting instance files /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d_del
Nov 22 15:04:50 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Deletion of /opt/stack/data/nova/instances/9d4fd442-1998-409d-84b0-c76ec9a5670d_del complete
Nov 22 15:04:50 user nova-compute[74776]: INFO nova.compute.manager [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 22 15:04:50 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:04:50 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:04:51 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:04:51 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Took 0.81 seconds to deallocate network for instance.
Nov 22 15:04:51 user nova-compute[74776]: DEBUG nova.compute.manager [req-5e216ff1-69a3-45e4-bdc6-2a6b896d776c req-ee3f0cd1-0587-4eaf-9f2f-0fd9339478bb service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Received event network-vif-deleted-29c2b1de-7b59-4466-941f-31cbaf33283b {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:04:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:04:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:04:51 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:04:51 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:04:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:04:51 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Deleted allocations for instance 9d4fd442-1998-409d-84b0-c76ec9a5670d
Nov 22 15:04:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f581e0a7-9c35-4a48-8295-3ac54265ae0b tempest-SnapshotDataIntegrityTests-1997075541 tempest-SnapshotDataIntegrityTests-1997075541-project-member] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.044s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:04:52 user nova-compute[74776]: DEBUG nova.compute.manager [req-ede60a14-660f-4398-9c29-7d300e7441d9 req-ed489edb-4bfb-4b52-aaa0-e43da03e7fd9 service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Received event network-vif-plugged-29c2b1de-7b59-4466-941f-31cbaf33283b {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:04:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ede60a14-660f-4398-9c29-7d300e7441d9 req-ed489edb-4bfb-4b52-aaa0-e43da03e7fd9 service nova] Acquiring lock "9d4fd442-1998-409d-84b0-c76ec9a5670d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:04:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ede60a14-660f-4398-9c29-7d300e7441d9 req-ed489edb-4bfb-4b52-aaa0-e43da03e7fd9 service nova] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:04:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-ede60a14-660f-4398-9c29-7d300e7441d9 req-ed489edb-4bfb-4b52-aaa0-e43da03e7fd9 service nova] Lock "9d4fd442-1998-409d-84b0-c76ec9a5670d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:04:52 user nova-compute[74776]: DEBUG nova.compute.manager [req-ede60a14-660f-4398-9c29-7d300e7441d9 req-ed489edb-4bfb-4b52-aaa0-e43da03e7fd9 service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] No waiting events found dispatching network-vif-plugged-29c2b1de-7b59-4466-941f-31cbaf33283b {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:04:52 user nova-compute[74776]: WARNING nova.compute.manager [req-ede60a14-660f-4398-9c29-7d300e7441d9 req-ed489edb-4bfb-4b52-aaa0-e43da03e7fd9 service nova] [instance: 9d4fd442-1998-409d-84b0-c76ec9a5670d] Received unexpected event network-vif-plugged-29c2b1de-7b59-4466-941f-31cbaf33283b for instance with vm_state deleted and task_state None.
Nov 22 15:04:52 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:04:53 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:04:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:04:58 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:04:59 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:05:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:05:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 15:05:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:05:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:05:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:05:11 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:05:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:05:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:05:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:05:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:05:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:43 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:05:43 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:05:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-9a11c064-b17b-4776-9388-6000442fe07f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:05:43 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-9a11c064-b17b-4776-9388-6000442fe07f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:05:43 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 15:05:44 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Updating instance_info_cache with network_info: [{"id": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "address": "fa:16:3e:8f:04:6f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb23e1d9-49", "ovs_interfaceid": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:05:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-9a11c064-b17b-4776-9388-6000442fe07f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:05:44 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 15:05:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:46 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:05:49 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:05:49 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:05:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:05:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:05:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:05:49 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:05:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:05:49 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:05:50 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:05:50 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:05:50 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8908MB free_disk=25.058582305908203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:05:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:05:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:05:50 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 9a11c064-b17b-4776-9388-6000442fe07f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:05:50 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 3699ada6-b27d-4987-a546-745897748243 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:05:50 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:05:50 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:05:50 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:05:50 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:05:50 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:05:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:05:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:52 user nova-compute[74776]: DEBUG nova.compute.manager [req-e8d0b827-feda-4a84-9f98-ad83c85a5db3 req-518d9621-3360-4b93-b550-400efb94b14c service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Received event network-changed-8ccb3bb2-5b87-477f-b534-67569e3c8fe3 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:05:52 user nova-compute[74776]: DEBUG nova.compute.manager [req-e8d0b827-feda-4a84-9f98-ad83c85a5db3 req-518d9621-3360-4b93-b550-400efb94b14c service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Refreshing instance network info cache due to event network-changed-8ccb3bb2-5b87-477f-b534-67569e3c8fe3. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:05:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e8d0b827-feda-4a84-9f98-ad83c85a5db3 req-518d9621-3360-4b93-b550-400efb94b14c service nova] Acquiring lock "refresh_cache-3699ada6-b27d-4987-a546-745897748243" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:05:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e8d0b827-feda-4a84-9f98-ad83c85a5db3 req-518d9621-3360-4b93-b550-400efb94b14c service nova] Acquired lock "refresh_cache-3699ada6-b27d-4987-a546-745897748243" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:05:52 user nova-compute[74776]: DEBUG nova.network.neutron [req-e8d0b827-feda-4a84-9f98-ad83c85a5db3 req-518d9621-3360-4b93-b550-400efb94b14c service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Refreshing network info cache for port 8ccb3bb2-5b87-477f-b534-67569e3c8fe3 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:05:52 user nova-compute[74776]: DEBUG nova.network.neutron [req-e8d0b827-feda-4a84-9f98-ad83c85a5db3 req-518d9621-3360-4b93-b550-400efb94b14c service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Updated VIF entry in instance network info cache for port 8ccb3bb2-5b87-477f-b534-67569e3c8fe3. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:05:52 user nova-compute[74776]: DEBUG nova.network.neutron [req-e8d0b827-feda-4a84-9f98-ad83c85a5db3 req-518d9621-3360-4b93-b550-400efb94b14c service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Updating instance_info_cache with network_info: [{"id": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "address": "fa:16:3e:e9:fe:13", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccb3bb2-5b", "ovs_interfaceid": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:05:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-e8d0b827-feda-4a84-9f98-ad83c85a5db3 req-518d9621-3360-4b93-b550-400efb94b14c service nova] Releasing lock "refresh_cache-3699ada6-b27d-4987-a546-745897748243" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:05:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-59354414-bc3e-41b9-b380-bee39c19e22d req-5f4367f0-631e-4c50-a337-d73728cf3f67 service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Received event network-changed-8ccb3bb2-5b87-477f-b534-67569e3c8fe3 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:05:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-59354414-bc3e-41b9-b380-bee39c19e22d req-5f4367f0-631e-4c50-a337-d73728cf3f67 service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Refreshing instance network info cache due to event network-changed-8ccb3bb2-5b87-477f-b534-67569e3c8fe3. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:05:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-59354414-bc3e-41b9-b380-bee39c19e22d req-5f4367f0-631e-4c50-a337-d73728cf3f67 service nova] Acquiring lock "refresh_cache-3699ada6-b27d-4987-a546-745897748243" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:05:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-59354414-bc3e-41b9-b380-bee39c19e22d req-5f4367f0-631e-4c50-a337-d73728cf3f67 service nova] Acquired lock "refresh_cache-3699ada6-b27d-4987-a546-745897748243" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:05:53 user nova-compute[74776]: DEBUG nova.network.neutron [req-59354414-bc3e-41b9-b380-bee39c19e22d req-5f4367f0-631e-4c50-a337-d73728cf3f67 service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Refreshing network info cache for port 8ccb3bb2-5b87-477f-b534-67569e3c8fe3 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:05:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "3699ada6-b27d-4987-a546-745897748243" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:05:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "3699ada6-b27d-4987-a546-745897748243" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:05:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "3699ada6-b27d-4987-a546-745897748243-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:05:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "3699ada6-b27d-4987-a546-745897748243-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:05:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "3699ada6-b27d-4987-a546-745897748243-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:05:53 user nova-compute[74776]: INFO nova.compute.manager [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Terminating instance
Nov 22 15:05:53 user nova-compute[74776]: DEBUG nova.compute.manager [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 15:05:53 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:05:53 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:05:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:53 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:05:53 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:53 user nova-compute[74776]: DEBUG nova.network.neutron [req-59354414-bc3e-41b9-b380-bee39c19e22d req-5f4367f0-631e-4c50-a337-d73728cf3f67 service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Updated VIF entry in instance network info cache for port 8ccb3bb2-5b87-477f-b534-67569e3c8fe3. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:05:53 user nova-compute[74776]: DEBUG nova.network.neutron [req-59354414-bc3e-41b9-b380-bee39c19e22d req-5f4367f0-631e-4c50-a337-d73728cf3f67 service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Updating instance_info_cache with network_info: [{"id": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "address": "fa:16:3e:e9:fe:13", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccb3bb2-5b", "ovs_interfaceid": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:05:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-59354414-bc3e-41b9-b380-bee39c19e22d req-5f4367f0-631e-4c50-a337-d73728cf3f67 service nova] Releasing lock "refresh_cache-3699ada6-b27d-4987-a546-745897748243" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:54 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 3699ada6-b27d-4987-a546-745897748243] Instance destroyed successfully.
Nov 22 15:05:54 user nova-compute[74776]: DEBUG nova.objects.instance [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lazy-loading 'resources' on Instance uuid 3699ada6-b27d-4987-a546-745897748243 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-330164992',display_name='tempest-TestVolumeBootPattern-server-330164992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-330164992',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB596wO3Zc22AAnzKVxuS9gk5vbChvgktvxVxXEmM2zx1YqGq6iZTXv+hgGEsOzb88w0gyInCqMJG4uw6qi46//XWRxR2yJsl2y9nTchbI5Yumea0irnLv6OU6PAmKKUUA==',key_name='tempest-TestVolumeBootPattern-1110540872',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:04:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f6764076f2a428ea35c11476a3e7231',ramdisk_id='',reservation_id='r-3s3icej4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1931721751',owner_user_name='tempest-TestVolumeBootPattern-1931721751-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:04:12Z,user_data=None,user_id='d5cce524a8c6419aa76fb4b02861377e',uuid=3699ada6-b27d-4987-a546-745897748243,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "address": "fa:16:3e:e9:fe:13", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccb3bb2-5b", "ovs_interfaceid": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converting VIF {"id": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "address": "fa:16:3e:e9:fe:13", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ccb3bb2-5b", "ovs_interfaceid": "8ccb3bb2-5b87-477f-b534-67569e3c8fe3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:fe:13,bridge_name='br-int',has_traffic_filtering=True,id=8ccb3bb2-5b87-477f-b534-67569e3c8fe3,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccb3bb2-5b') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG os_vif [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:fe:13,bridge_name='br-int',has_traffic_filtering=True,id=8ccb3bb2-5b87-477f-b534-67569e3c8fe3,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccb3bb2-5b') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ccb3bb2-5b, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=489f1b43-3caa-4686-bfc1-9c0fa5e9a546) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:05:54 user nova-compute[74776]: INFO os_vif [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:fe:13,bridge_name='br-int',has_traffic_filtering=True,id=8ccb3bb2-5b87-477f-b534-67569e3c8fe3,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ccb3bb2-5b')
Nov 22 15:05:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGkgOcSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:05:54 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:05:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea835686-11e3-4694-a205-de010b4d4fa6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:05:54 user nova-compute[74776]: No targets found.
Nov 22 15:05:54 user nova-compute[74776]: iSNS:
Nov 22 15:05:54 user nova-compute[74776]: No targets found.
Nov 22 15:05:54 user nova-compute[74776]: STATIC:
Nov 22 15:05:54 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931
Nov 22 15:05:54 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:05:54 user nova-compute[74776]:                 Iface Name: default
Nov 22 15:05:54 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156
Nov 22 15:05:54 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:05:54 user nova-compute[74776]:                 Iface Name: default
Nov 22 15:05:54 user nova-compute[74776]: FIRMWARE:
Nov 22 15:05:54 user nova-compute[74776]: No targets found.
Nov 22 15:05:54 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:05:54 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:05:54 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c144983-8e6d-4c4f-bc9c-0e320fced1ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[be76b643-3ace-4b32-96be-a8185cad9e1b]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:05:54 user nova-compute[74776]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 (non-flash)
Nov 22 15:05:54 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:05:54 user nova-compute[74776]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 (non-flash)
Nov 22 15:05:54 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c387d9f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156'): ({'sdc'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Removing single pathed devices sdc {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84b287b-b94d-4218-bb0c-115fe2ab059d]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8082aae9-3fe8-4412-b742-17d6a5c36d13]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Flushing IO for device /dev/sdc {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4877dee4-7d8d-421c-b66f-010057d0f849]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.098s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6e6cb1-4035-47f4-97fe-2f4d26a13221]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] SCSI volumes sdc have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d38812-eb42-4bba-9622-3b64c005a607]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c3fc99-0da0-4bbd-9b99-a70e6f5b2acd]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156, portal: 172.16.0.220,3260]
Nov 22 15:05:54 user nova-compute[74776]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156, portal: 172.16.0.220,3260] successful.
Nov 22 15:05:54 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG nova.compute.manager [req-72f3d391-be8a-4681-bd45-9615c951993c req-01c638fa-3c94-4994-bfe1-6fcb362ac46f service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Received event network-vif-unplugged-8ccb3bb2-5b87-477f-b534-67569e3c8fe3 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-72f3d391-be8a-4681-bd45-9615c951993c req-01c638fa-3c94-4994-bfe1-6fcb362ac46f service nova] Acquiring lock "3699ada6-b27d-4987-a546-745897748243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-72f3d391-be8a-4681-bd45-9615c951993c req-01c638fa-3c94-4994-bfe1-6fcb362ac46f service nova] Lock "3699ada6-b27d-4987-a546-745897748243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-72f3d391-be8a-4681-bd45-9615c951993c req-01c638fa-3c94-4994-bfe1-6fcb362ac46f service nova] Lock "3699ada6-b27d-4987-a546-745897748243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG nova.compute.manager [req-72f3d391-be8a-4681-bd45-9615c951993c req-01c638fa-3c94-4994-bfe1-6fcb362ac46f service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] No waiting events found dispatching network-vif-unplugged-8ccb3bb2-5b87-477f-b534-67569e3c8fe3 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG nova.compute.manager [req-72f3d391-be8a-4681-bd45-9615c951993c req-01c638fa-3c94-4994-bfe1-6fcb362ac46f service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Received event network-vif-unplugged-8ccb3bb2-5b87-477f-b534-67569e3c8fe3 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG nova.compute.manager [req-72f3d391-be8a-4681-bd45-9615c951993c req-01c638fa-3c94-4994-bfe1-6fcb362ac46f service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Received event network-vif-plugged-8ccb3bb2-5b87-477f-b534-67569e3c8fe3 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-72f3d391-be8a-4681-bd45-9615c951993c req-01c638fa-3c94-4994-bfe1-6fcb362ac46f service nova] Acquiring lock "3699ada6-b27d-4987-a546-745897748243-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-72f3d391-be8a-4681-bd45-9615c951993c req-01c638fa-3c94-4994-bfe1-6fcb362ac46f service nova] Lock "3699ada6-b27d-4987-a546-745897748243-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-72f3d391-be8a-4681-bd45-9615c951993c req-01c638fa-3c94-4994-bfe1-6fcb362ac46f service nova] Lock "3699ada6-b27d-4987-a546-745897748243-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG nova.compute.manager [req-72f3d391-be8a-4681-bd45-9615c951993c req-01c638fa-3c94-4994-bfe1-6fcb362ac46f service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] No waiting events found dispatching network-vif-plugged-8ccb3bb2-5b87-477f-b534-67569e3c8fe3 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:05:54 user nova-compute[74776]: WARNING nova.compute.manager [req-72f3d391-be8a-4681-bd45-9615c951993c req-01c638fa-3c94-4994-bfe1-6fcb362ac46f service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Received unexpected event network-vif-plugged-8ccb3bb2-5b87-477f-b534-67569e3c8fe3 for instance with vm_state active and task_state deleting.
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0c0aa36-1fe7-44d4-a60e-d843442d3156 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c3edc7-335d-48a5-b6fc-6fbc1f55043d]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] <== disconnect_volume: return (348ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:05:54 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Deleting instance files /opt/stack/data/nova/instances/3699ada6-b27d-4987-a546-745897748243_del
Nov 22 15:05:54 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Deletion of /opt/stack/data/nova/instances/3699ada6-b27d-4987-a546-745897748243_del complete
Nov 22 15:05:54 user nova-compute[74776]: INFO nova.compute.manager [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 22 15:05:54 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 3699ada6-b27d-4987-a546-745897748243] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 15:05:54 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 3699ada6-b27d-4987-a546-745897748243] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 15:05:55 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 3699ada6-b27d-4987-a546-745897748243] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:05:55 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 3699ada6-b27d-4987-a546-745897748243] Took 0.46 seconds to deallocate network for instance.
Nov 22 15:05:55 user nova-compute[74776]: DEBUG nova.compute.manager [req-fc6b807d-2c74-434b-ac74-f9d1fee62b11 req-82683fca-a62c-48ed-9d9d-6363ea9f4e01 service nova] [instance: 3699ada6-b27d-4987-a546-745897748243] Received event network-vif-deleted-8ccb3bb2-5b87-477f-b534-67569e3c8fe3 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:05:55 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:05:55 user nova-compute[74776]: INFO nova.compute.manager [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 3699ada6-b27d-4987-a546-745897748243] Took 0.75 seconds to detach 1 volumes for instance.
Nov 22 15:05:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:05:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:05:55 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:05:55 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:05:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:05:56 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Deleted allocations for instance 3699ada6-b27d-4987-a546-745897748243
Nov 22 15:05:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-e9312501-4514-4959-a44d-86900fd15226 tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "3699ada6-b27d-4987-a546-745897748243" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.835s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:05:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:59 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:05:59 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:05:59 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:06:04 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:06:09 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:06:14 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:06:19 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:06:24 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:06:29 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:06:34 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:06:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:06:43 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:06:43 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:06:43 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Didn't find any instances for network info cache update. {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 15:06:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:06:47 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:06:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:06:50 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:06:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:06:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:06:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:06:50 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:06:50 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74776) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 22 15:06:51 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:06:51 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:06:51 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8993MB free_disk=25.049793243408203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 9a11c064-b17b-4776-9388-6000442fe07f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "9a11c064-b17b-4776-9388-6000442fe07f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "9a11c064-b17b-4776-9388-6000442fe07f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "9a11c064-b17b-4776-9388-6000442fe07f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "9a11c064-b17b-4776-9388-6000442fe07f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "9a11c064-b17b-4776-9388-6000442fe07f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG nova.compute.manager [req-8bb518ae-7837-45ca-86c3-f30139dce7f4 req-46818fe7-97c8-43a8-bcba-b65b127be9b4 service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Received event network-changed-cb23e1d9-49e1-403d-a281-e6a527cd3c93 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG nova.compute.manager [req-8bb518ae-7837-45ca-86c3-f30139dce7f4 req-46818fe7-97c8-43a8-bcba-b65b127be9b4 service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Refreshing instance network info cache due to event network-changed-cb23e1d9-49e1-403d-a281-e6a527cd3c93. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8bb518ae-7837-45ca-86c3-f30139dce7f4 req-46818fe7-97c8-43a8-bcba-b65b127be9b4 service nova] Acquiring lock "refresh_cache-9a11c064-b17b-4776-9388-6000442fe07f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8bb518ae-7837-45ca-86c3-f30139dce7f4 req-46818fe7-97c8-43a8-bcba-b65b127be9b4 service nova] Acquired lock "refresh_cache-9a11c064-b17b-4776-9388-6000442fe07f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG nova.network.neutron [req-8bb518ae-7837-45ca-86c3-f30139dce7f4 req-46818fe7-97c8-43a8-bcba-b65b127be9b4 service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Refreshing network info cache for port cb23e1d9-49e1-403d-a281-e6a527cd3c93 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:06:51 user nova-compute[74776]: INFO nova.compute.manager [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Terminating instance
Nov 22 15:06:51 user nova-compute[74776]: DEBUG nova.compute.manager [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG nova.network.neutron [req-8bb518ae-7837-45ca-86c3-f30139dce7f4 req-46818fe7-97c8-43a8-bcba-b65b127be9b4 service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Updated VIF entry in instance network info cache for port cb23e1d9-49e1-403d-a281-e6a527cd3c93. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG nova.network.neutron [req-8bb518ae-7837-45ca-86c3-f30139dce7f4 req-46818fe7-97c8-43a8-bcba-b65b127be9b4 service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Updating instance_info_cache with network_info: [{"id": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "address": "fa:16:3e:8f:04:6f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb23e1d9-49", "ovs_interfaceid": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:06:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-8bb518ae-7837-45ca-86c3-f30139dce7f4 req-46818fe7-97c8-43a8-bcba-b65b127be9b4 service nova] Releasing lock "refresh_cache-9a11c064-b17b-4776-9388-6000442fe07f" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:06:52 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Instance destroyed successfully.
Nov 22 15:06:52 user nova-compute[74776]: DEBUG nova.objects.instance [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lazy-loading 'resources' on Instance uuid 9a11c064-b17b-4776-9388-6000442fe07f {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:02:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2005445613',display_name='tempest-TestVolumeBootPattern-server-2005445613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2005445613',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB596wO3Zc22AAnzKVxuS9gk5vbChvgktvxVxXEmM2zx1YqGq6iZTXv+hgGEsOzb88w0gyInCqMJG4uw6qi46//XWRxR2yJsl2y9nTchbI5Yumea0irnLv6OU6PAmKKUUA==',key_name='tempest-TestVolumeBootPattern-1110540872',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:02:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f6764076f2a428ea35c11476a3e7231',ramdisk_id='',reservation_id='r-cbqkkp85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1931721751',owner_user_name='tempest-TestVolumeBootPattern-1931721751-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:02:15Z,user_data=None,user_id='d5cce524a8c6419aa76fb4b02861377e',uuid=9a11c064-b17b-4776-9388-6000442fe07f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "address": "fa:16:3e:8f:04:6f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb23e1d9-49", "ovs_interfaceid": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converting VIF {"id": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "address": "fa:16:3e:8f:04:6f", "network": {"id": "179fc3c5-7f39-4901-9e38-ed1af28495dc", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-310674522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f6764076f2a428ea35c11476a3e7231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb23e1d9-49", "ovs_interfaceid": "cb23e1d9-49e1-403d-a281-e6a527cd3c93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:04:6f,bridge_name='br-int',has_traffic_filtering=True,id=cb23e1d9-49e1-403d-a281-e6a527cd3c93,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb23e1d9-49') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_vif [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:04:6f,bridge_name='br-int',has_traffic_filtering=True,id=cb23e1d9-49e1-403d-a281-e6a527cd3c93,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb23e1d9-49') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb23e1d9-49, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb4e8007-9053-4eb0-a3fd-9b2b6beedf82) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:06:52 user nova-compute[74776]: INFO os_vif [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:04:6f,bridge_name='br-int',has_traffic_filtering=True,id=cb23e1d9-49e1-403d-a281-e6a527cd3c93,network=Network(179fc3c5-7f39-4901-9e38-ed1af28495dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb23e1d9-49')
Nov 22 15:06:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjSshXem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:06:52 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceacb1b7-4bb6-4009-b3fa-b7e97eb711bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:06:52 user nova-compute[74776]: No targets found.
Nov 22 15:06:52 user nova-compute[74776]: iSNS:
Nov 22 15:06:52 user nova-compute[74776]: No targets found.
Nov 22 15:06:52 user nova-compute[74776]: STATIC:
Nov 22 15:06:52 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931
Nov 22 15:06:52 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:06:52 user nova-compute[74776]:                 Iface Name: default
Nov 22 15:06:52 user nova-compute[74776]: FIRMWARE:
Nov 22 15:06:52 user nova-compute[74776]: No targets found.
Nov 22 15:06:52 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:06:52 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:06:52 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[413afd90-2cff-4328-98c2-3a1a565a90b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bafe08e-b257-4393-852a-c30bb4dfe1a0]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:06:52 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 (non-flash)
Nov 22 15:06:52 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c587e3760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931'): ({'sdb'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Removing single pathed devices sdb {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9d2d92-d24f-449d-8007-266b3bc9bfb7]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56d3568-2842-4f92-98d0-083cd8bf103c]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Flushing IO for device /dev/sdb {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9cc6e9-a2f4-4a3c-8352-d7fcf5fb983f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[32355bad-e318-44ba-8f49-fac2ad154325]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOcec306bc-dfaa0268e0a6e9cc', '/dev/disk/by-id/scsi-26466616130323638', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_cec306bc') {{(pid=85789) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9d29a1-ec31-4301-86e7-03c9d28d5990]: (4, None) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5b1b85-7905-4889-81dc-6b03ffe7a0ee]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d861c01-879a-465c-a104-27c683f750fe]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931, portal: 172.16.0.220,3260]
Nov 22 15:06:52 user nova-compute[74776]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931, portal: 172.16.0.220,3260] successful.
Nov 22 15:06:52 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b7fb3-5263-4d0f-9280-28957d8ff931 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4976d5-ae28-493d-84af-6f2996d6f9ed]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] <== disconnect_volume: return (298ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:06:52 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Deleting instance files /opt/stack/data/nova/instances/9a11c064-b17b-4776-9388-6000442fe07f_del
Nov 22 15:06:52 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Deletion of /opt/stack/data/nova/instances/9a11c064-b17b-4776-9388-6000442fe07f_del complete
Nov 22 15:06:52 user nova-compute[74776]: INFO nova.compute.manager [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 22 15:06:52 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:06:52 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:06:53 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Took 0.48 seconds to deallocate network for instance.
Nov 22 15:06:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-b4debb4f-c3a1-48b3-bb60-b944bfba1f8b req-2c08728e-0720-4131-9f5e-81b22bb727c5 service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Received event network-vif-deleted-cb23e1d9-49e1-403d-a281-e6a527cd3c93 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:06:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-4b3f274b-5a5b-4846-98c3-f5ec2735fb64 req-341c3329-888a-439f-890f-010f5325431c service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Received event network-vif-unplugged-cb23e1d9-49e1-403d-a281-e6a527cd3c93 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:06:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4b3f274b-5a5b-4846-98c3-f5ec2735fb64 req-341c3329-888a-439f-890f-010f5325431c service nova] Acquiring lock "9a11c064-b17b-4776-9388-6000442fe07f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:06:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4b3f274b-5a5b-4846-98c3-f5ec2735fb64 req-341c3329-888a-439f-890f-010f5325431c service nova] Lock "9a11c064-b17b-4776-9388-6000442fe07f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:06:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4b3f274b-5a5b-4846-98c3-f5ec2735fb64 req-341c3329-888a-439f-890f-010f5325431c service nova] Lock "9a11c064-b17b-4776-9388-6000442fe07f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:06:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-4b3f274b-5a5b-4846-98c3-f5ec2735fb64 req-341c3329-888a-439f-890f-010f5325431c service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] No waiting events found dispatching network-vif-unplugged-cb23e1d9-49e1-403d-a281-e6a527cd3c93 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:06:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-4b3f274b-5a5b-4846-98c3-f5ec2735fb64 req-341c3329-888a-439f-890f-010f5325431c service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Received event network-vif-unplugged-cb23e1d9-49e1-403d-a281-e6a527cd3c93 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:06:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-4b3f274b-5a5b-4846-98c3-f5ec2735fb64 req-341c3329-888a-439f-890f-010f5325431c service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Received event network-vif-plugged-cb23e1d9-49e1-403d-a281-e6a527cd3c93 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:06:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4b3f274b-5a5b-4846-98c3-f5ec2735fb64 req-341c3329-888a-439f-890f-010f5325431c service nova] Acquiring lock "9a11c064-b17b-4776-9388-6000442fe07f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:06:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4b3f274b-5a5b-4846-98c3-f5ec2735fb64 req-341c3329-888a-439f-890f-010f5325431c service nova] Lock "9a11c064-b17b-4776-9388-6000442fe07f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:06:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-4b3f274b-5a5b-4846-98c3-f5ec2735fb64 req-341c3329-888a-439f-890f-010f5325431c service nova] Lock "9a11c064-b17b-4776-9388-6000442fe07f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:06:53 user nova-compute[74776]: DEBUG nova.compute.manager [req-4b3f274b-5a5b-4846-98c3-f5ec2735fb64 req-341c3329-888a-439f-890f-010f5325431c service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] No waiting events found dispatching network-vif-plugged-cb23e1d9-49e1-403d-a281-e6a527cd3c93 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:06:53 user nova-compute[74776]: WARNING nova.compute.manager [req-4b3f274b-5a5b-4846-98c3-f5ec2735fb64 req-341c3329-888a-439f-890f-010f5325431c service nova] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Received unexpected event network-vif-plugged-cb23e1d9-49e1-403d-a281-e6a527cd3c93 for instance with vm_state active and task_state deleting.
Nov 22 15:06:53 user nova-compute[74776]: INFO nova.compute.manager [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] [instance: 9a11c064-b17b-4776-9388-6000442fe07f] Took 0.72 seconds to detach 1 volumes for instance.
Nov 22 15:06:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:06:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:06:53 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:06:53 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:06:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:06:53 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Deleted allocations for instance 9a11c064-b17b-4776-9388-6000442fe07f
Nov 22 15:06:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-ec465b8c-c6ed-4b00-b1a1-1a184201c3bc tempest-TestVolumeBootPattern-1931721751 tempest-TestVolumeBootPattern-1931721751-project-member] Lock "9a11c064-b17b-4776-9388-6000442fe07f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.648s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:06:54 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:06:54 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:06:54 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:06:55 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:06:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:06:59 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:07:00 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:07:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:07:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:07:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:07:14 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:07:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:07:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:07:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:07:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:07:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:07:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:07:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:07:43 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:07:43 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:07:43 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 15:07:43 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Didn't find any instances for network info cache update. {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 15:07:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:07:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:07:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 15:07:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:07:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:07:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:07:48 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:07:49 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:07:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:07:51 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:07:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:07:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:07:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:07:51 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:07:52 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:07:52 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:07:52 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=9128MB free_disk=25.048503875732422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:07:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:07:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:07:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:07:52 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:07:52 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:07:52 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing inventories for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 15:07:52 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating ProviderTree inventory for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 15:07:52 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating inventory in ProviderTree for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 15:07:52 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing aggregate associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, aggregates: None {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 15:07:52 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing trait associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 15:07:52 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:07:52 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:07:52 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:07:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.445s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:07:54 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:07:55 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:07:56 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:07:56 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:07:56 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:07:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:08:01 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:08:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:08:02 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:08:07 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:08:12 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:08:17 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:08:19 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:08:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 15:08:19 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] There are 0 instances to clean {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 15:08:19 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:08:22 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:08:22 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:08:22 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74776) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 15:08:27 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:08:32 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:08:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:08:37 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:08:41 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:08:42 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:08:44 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:08:45 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:08:45 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:08:45 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 15:08:45 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Didn't find any instances for network info cache update. {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 15:08:46 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:08:47 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:08:49 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:08:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:08:51 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:08:51 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:08:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:08:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:08:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:08:51 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:08:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:08:52 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:08:52 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:08:52 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8836MB free_disk=25.04275131225586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:08:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:08:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:08:52 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:08:52 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:08:52 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:08:52 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:08:52 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:08:52 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:08:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:08:55 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:08:55 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:08:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:08:57 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:08:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:08:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:08:57 user nova-compute[74776]: DEBUG nova.compute.manager [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Starting instance... {{(pid=74776) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 22 15:08:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:08:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:08:57 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74776) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 22 15:08:57 user nova-compute[74776]: INFO nova.compute.claims [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Claim successful on node user
Nov 22 15:08:58 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.286s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG nova.compute.manager [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Start building networks asynchronously for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG nova.compute.manager [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Allocating IP information in the background. {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG nova.network.neutron [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] allocate_for_instance() {{(pid=74776) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 22 15:08:58 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 22 15:08:58 user nova-compute[74776]: DEBUG nova.compute.manager [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Start building block device mappings for instance. {{(pid=74776) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG nova.compute.manager [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Start spawning the instance on the hypervisor. {{(pid=74776) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Creating instance directory {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 22 15:08:58 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Creating image(s)
Nov 22 15:08:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "/opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "/opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG nova.policy [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f8ddd6924f84a66badc00566254193d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a744336c1694706a00440e12c12a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74776) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.190s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.193s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk 1073741824 {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e,backing_fmt=raw /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk 1073741824" returned: 0 in 0.064s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "8b46a9b21731c19ccb10b60bac0ad927511c4e4e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:08:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:08:59 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8b46a9b21731c19ccb10b60bac0ad927511c4e4e --force-share --output=json" returned: 0 in 0.239s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:08:59 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk. size=1073741824 {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 22 15:08:59 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:08:59 user nova-compute[74776]: DEBUG nova.network.neutron [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Successfully created port: f0c89949-4ef6-4b84-b494-a092990ada62 {{(pid=74776) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 22 15:08:59 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:08:59 user nova-compute[74776]: DEBUG nova.virt.disk.api [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Cannot resize image /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk to a smaller size. {{(pid=74776) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 22 15:08:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Created local disks {{(pid=74776) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 22 15:08:59 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Ensure instance console log exists: /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/console.log {{(pid=74776) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 22 15:08:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:08:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:08:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.network.neutron [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Successfully updated port: f0c89949-4ef6-4b84-b494-a092990ada62 {{(pid=74776) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquired lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.network.neutron [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Building network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-bcf43448-592a-45b4-a8e8-71025bb432b5 req-48df0264-4530-4f8e-aaf3-df9d82ee8e98 service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Received event network-changed-f0c89949-4ef6-4b84-b494-a092990ada62 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.compute.manager [req-bcf43448-592a-45b4-a8e8-71025bb432b5 req-48df0264-4530-4f8e-aaf3-df9d82ee8e98 service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Refreshing instance network info cache due to event network-changed-f0c89949-4ef6-4b84-b494-a092990ada62. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-bcf43448-592a-45b4-a8e8-71025bb432b5 req-48df0264-4530-4f8e-aaf3-df9d82ee8e98 service nova] Acquiring lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.network.neutron [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Instance cache missing network info. {{(pid=74776) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.network.neutron [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updating instance_info_cache with network_info: [{"id": "f0c89949-4ef6-4b84-b494-a092990ada62", "address": "fa:16:3e:8b:ca:d3", "network": {"id": "3d853efa-c1d2-4414-a938-5c09d94f636d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-851102905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a744336c1694706a00440e12c12a1b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c89949-4e", "ovs_interfaceid": "f0c89949-4ef6-4b84-b494-a092990ada62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Releasing lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.compute.manager [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Instance network_info: |[{"id": "f0c89949-4ef6-4b84-b494-a092990ada62", "address": "fa:16:3e:8b:ca:d3", "network": {"id": "3d853efa-c1d2-4414-a938-5c09d94f636d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-851102905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a744336c1694706a00440e12c12a1b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c89949-4e", "ovs_interfaceid": "f0c89949-4ef6-4b84-b494-a092990ada62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74776) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-bcf43448-592a-45b4-a8e8-71025bb432b5 req-48df0264-4530-4f8e-aaf3-df9d82ee8e98 service nova] Acquired lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.network.neutron [req-bcf43448-592a-45b4-a8e8-71025bb432b5 req-48df0264-4530-4f8e-aaf3-df9d82ee8e98 service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Refreshing network info cache for port f0c89949-4ef6-4b84-b494-a092990ada62 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Start _get_guest_xml network_info=[{"id": "f0c89949-4ef6-4b84-b494-a092990ada62", "address": "fa:16:3e:8b:ca:d3", "network": {"id": "3d853efa-c1d2-4414-a938-5c09d94f636d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-851102905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a744336c1694706a00440e12c12a1b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c89949-4e", "ovs_interfaceid": "f0c89949-4ef6-4b84-b494-a092990ada62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'ee204558-2a75-42f8-8c03-3c76a3916fa5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 22 15:09:00 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:09:00 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] CPU controller missing on host. {{(pid=74776) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.host [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] CPU controller found on host. {{(pid=74776) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74776) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-22T14:12:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-22T14:12:30Z,direct_url=<?>,disk_format='qcow2',id=ee204558-2a75-42f8-8c03-3c76a3916fa5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b02a2fa1d01d4cb3b0a21595749534e4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-22T14:12:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Flavor limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Image limits 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Flavor pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Image pref 0:0:0 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Got 1 possible topologies {{(pid=74776) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.hardware [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74776) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:08:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1801406545',display_name='tempest-SnapshotDataIntegrityTests-server-1801406545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1801406545',id=53,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4C4PmcF62GI3FDqhtkLrEZGFr5qarA/2UPJIXybtacoYlGK1An4YOTnUyff7d1wHSQCLMrwgvp2dngH68h+Zo0ErDmHX1HVUn9STd8sgp2CdkRAAob22yUXG0k+whI7A==',key_name='tempest-keypair-1219866838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a744336c1694706a00440e12c12a1b8',ramdisk_id='',reservation_id='r-ew8bc7qc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-731080679',owner_user_name='tempest-SnapshotDataIntegrityTests-731080679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:08:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8ddd6924f84a66badc00566254193d',uuid=6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0c89949-4ef6-4b84-b494-a092990ada62", "address": "fa:16:3e:8b:ca:d3", "network": {"id": "3d853efa-c1d2-4414-a938-5c09d94f636d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-851102905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a744336c1694706a00440e12c12a1b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c89949-4e", "ovs_interfaceid": "f0c89949-4ef6-4b84-b494-a092990ada62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74776) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Converting VIF {"id": "f0c89949-4ef6-4b84-b494-a092990ada62", "address": "fa:16:3e:8b:ca:d3", "network": {"id": "3d853efa-c1d2-4414-a938-5c09d94f636d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-851102905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a744336c1694706a00440e12c12a1b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c89949-4e", "ovs_interfaceid": "f0c89949-4ef6-4b84-b494-a092990ada62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ca:d3,bridge_name='br-int',has_traffic_filtering=True,id=f0c89949-4ef6-4b84-b494-a092990ada62,network=Network(3d853efa-c1d2-4414-a938-5c09d94f636d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0c89949-4e') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.objects.instance [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] End _get_guest_xml xml=<domain type="kvm">
Nov 22 15:09:00 user nova-compute[74776]:   <uuid>6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0</uuid>
Nov 22 15:09:00 user nova-compute[74776]:   <name>instance-00000035</name>
Nov 22 15:09:00 user nova-compute[74776]:   <memory>524288</memory>
Nov 22 15:09:00 user nova-compute[74776]:   <vcpu>1</vcpu>
Nov 22 15:09:00 user nova-compute[74776]:   <metadata>
Nov 22 15:09:00 user nova-compute[74776]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 22 15:09:00 user nova-compute[74776]:       <nova:package version="0.0.0"/>
Nov 22 15:09:00 user nova-compute[74776]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1801406545</nova:name>
Nov 22 15:09:00 user nova-compute[74776]:       <nova:creationTime>2023-11-22 15:09:00</nova:creationTime>
Nov 22 15:09:00 user nova-compute[74776]:       <nova:flavor name="m1.tiny">
Nov 22 15:09:00 user nova-compute[74776]:         <nova:memory>512</nova:memory>
Nov 22 15:09:00 user nova-compute[74776]:         <nova:disk>1</nova:disk>
Nov 22 15:09:00 user nova-compute[74776]:         <nova:swap>0</nova:swap>
Nov 22 15:09:00 user nova-compute[74776]:         <nova:ephemeral>0</nova:ephemeral>
Nov 22 15:09:00 user nova-compute[74776]:         <nova:vcpus>1</nova:vcpus>
Nov 22 15:09:00 user nova-compute[74776]:       </nova:flavor>
Nov 22 15:09:00 user nova-compute[74776]:       <nova:owner>
Nov 22 15:09:00 user nova-compute[74776]:         <nova:user uuid="2f8ddd6924f84a66badc00566254193d">tempest-SnapshotDataIntegrityTests-731080679-project-member</nova:user>
Nov 22 15:09:00 user nova-compute[74776]:         <nova:project uuid="8a744336c1694706a00440e12c12a1b8">tempest-SnapshotDataIntegrityTests-731080679</nova:project>
Nov 22 15:09:00 user nova-compute[74776]:       </nova:owner>
Nov 22 15:09:00 user nova-compute[74776]:       <nova:root type="image" uuid="ee204558-2a75-42f8-8c03-3c76a3916fa5"/>
Nov 22 15:09:00 user nova-compute[74776]:       <nova:ports>
Nov 22 15:09:00 user nova-compute[74776]:         <nova:port uuid="f0c89949-4ef6-4b84-b494-a092990ada62">
Nov 22 15:09:00 user nova-compute[74776]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 22 15:09:00 user nova-compute[74776]:         </nova:port>
Nov 22 15:09:00 user nova-compute[74776]:       </nova:ports>
Nov 22 15:09:00 user nova-compute[74776]:     </nova:instance>
Nov 22 15:09:00 user nova-compute[74776]:   </metadata>
Nov 22 15:09:00 user nova-compute[74776]:   <sysinfo type="smbios">
Nov 22 15:09:00 user nova-compute[74776]:     <system>
Nov 22 15:09:00 user nova-compute[74776]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 22 15:09:00 user nova-compute[74776]:       <entry name="product">OpenStack Nova</entry>
Nov 22 15:09:00 user nova-compute[74776]:       <entry name="version">0.0.0</entry>
Nov 22 15:09:00 user nova-compute[74776]:       <entry name="serial">6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0</entry>
Nov 22 15:09:00 user nova-compute[74776]:       <entry name="uuid">6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0</entry>
Nov 22 15:09:00 user nova-compute[74776]:       <entry name="family">Virtual Machine</entry>
Nov 22 15:09:00 user nova-compute[74776]:     </system>
Nov 22 15:09:00 user nova-compute[74776]:   </sysinfo>
Nov 22 15:09:00 user nova-compute[74776]:   <os>
Nov 22 15:09:00 user nova-compute[74776]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 22 15:09:00 user nova-compute[74776]:     <boot dev="hd"/>
Nov 22 15:09:00 user nova-compute[74776]:     <smbios mode="sysinfo"/>
Nov 22 15:09:00 user nova-compute[74776]:   </os>
Nov 22 15:09:00 user nova-compute[74776]:   <features>
Nov 22 15:09:00 user nova-compute[74776]:     <acpi/>
Nov 22 15:09:00 user nova-compute[74776]:     <apic/>
Nov 22 15:09:00 user nova-compute[74776]:     <vmcoreinfo/>
Nov 22 15:09:00 user nova-compute[74776]:   </features>
Nov 22 15:09:00 user nova-compute[74776]:   <clock offset="utc">
Nov 22 15:09:00 user nova-compute[74776]:     <timer name="pit" tickpolicy="delay"/>
Nov 22 15:09:00 user nova-compute[74776]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 22 15:09:00 user nova-compute[74776]:     <timer name="hpet" present="no"/>
Nov 22 15:09:00 user nova-compute[74776]:   </clock>
Nov 22 15:09:00 user nova-compute[74776]:   <cpu mode="custom" match="exact">
Nov 22 15:09:00 user nova-compute[74776]:     <model>Nehalem</model>
Nov 22 15:09:00 user nova-compute[74776]:     <topology sockets="1" cores="1" threads="1"/>
Nov 22 15:09:00 user nova-compute[74776]:   </cpu>
Nov 22 15:09:00 user nova-compute[74776]:   <devices>
Nov 22 15:09:00 user nova-compute[74776]:     <disk type="file" device="disk">
Nov 22 15:09:00 user nova-compute[74776]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 22 15:09:00 user nova-compute[74776]:       <source file="/opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk"/>
Nov 22 15:09:00 user nova-compute[74776]:       <target dev="vda" bus="virtio"/>
Nov 22 15:09:00 user nova-compute[74776]:     </disk>
Nov 22 15:09:00 user nova-compute[74776]:     <interface type="ethernet">
Nov 22 15:09:00 user nova-compute[74776]:       <mac address="fa:16:3e:8b:ca:d3"/>
Nov 22 15:09:00 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 15:09:00 user nova-compute[74776]:       <mtu size="1442"/>
Nov 22 15:09:00 user nova-compute[74776]:       <target dev="tapf0c89949-4e"/>
Nov 22 15:09:00 user nova-compute[74776]:     </interface>
Nov 22 15:09:00 user nova-compute[74776]:     <serial type="pty">
Nov 22 15:09:00 user nova-compute[74776]:       <log file="/opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/console.log" append="off"/>
Nov 22 15:09:00 user nova-compute[74776]:     </serial>
Nov 22 15:09:00 user nova-compute[74776]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 22 15:09:00 user nova-compute[74776]:     <video>
Nov 22 15:09:00 user nova-compute[74776]:       <model type="virtio"/>
Nov 22 15:09:00 user nova-compute[74776]:     </video>
Nov 22 15:09:00 user nova-compute[74776]:     <rng model="virtio">
Nov 22 15:09:00 user nova-compute[74776]:       <backend model="random">/dev/urandom</backend>
Nov 22 15:09:00 user nova-compute[74776]:     </rng>
Nov 22 15:09:00 user nova-compute[74776]:     <controller type="usb" index="0" model="none"/>
Nov 22 15:09:00 user nova-compute[74776]:     <memballoon model="virtio">
Nov 22 15:09:00 user nova-compute[74776]:       <stats period="10"/>
Nov 22 15:09:00 user nova-compute[74776]:     </memballoon>
Nov 22 15:09:00 user nova-compute[74776]:   </devices>
Nov 22 15:09:00 user nova-compute[74776]: </domain>
Nov 22 15:09:00 user nova-compute[74776]:  {{(pid=74776) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:08:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1801406545',display_name='tempest-SnapshotDataIntegrityTests-server-1801406545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1801406545',id=53,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4C4PmcF62GI3FDqhtkLrEZGFr5qarA/2UPJIXybtacoYlGK1An4YOTnUyff7d1wHSQCLMrwgvp2dngH68h+Zo0ErDmHX1HVUn9STd8sgp2CdkRAAob22yUXG0k+whI7A==',key_name='tempest-keypair-1219866838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a744336c1694706a00440e12c12a1b8',ramdisk_id='',reservation_id='r-ew8bc7qc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-731080679',owner_user_name='tempest-SnapshotDataIntegrityTests-731080679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-22T15:08:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8ddd6924f84a66badc00566254193d',uuid=6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0c89949-4ef6-4b84-b494-a092990ada62", "address": "fa:16:3e:8b:ca:d3", "network": {"id": "3d853efa-c1d2-4414-a938-5c09d94f636d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-851102905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a744336c1694706a00440e12c12a1b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c89949-4e", "ovs_interfaceid": "f0c89949-4ef6-4b84-b494-a092990ada62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Converting VIF {"id": "f0c89949-4ef6-4b84-b494-a092990ada62", "address": "fa:16:3e:8b:ca:d3", "network": {"id": "3d853efa-c1d2-4414-a938-5c09d94f636d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-851102905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a744336c1694706a00440e12c12a1b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c89949-4e", "ovs_interfaceid": "f0c89949-4ef6-4b84-b494-a092990ada62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ca:d3,bridge_name='br-int',has_traffic_filtering=True,id=f0c89949-4ef6-4b84-b494-a092990ada62,network=Network(3d853efa-c1d2-4414-a938-5c09d94f636d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0c89949-4e') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG os_vif [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ca:d3,bridge_name='br-int',has_traffic_filtering=True,id=f0c89949-4ef6-4b84-b494-a092990ada62,network=Network(3d853efa-c1d2-4414-a938-5c09d94f636d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0c89949-4e') {{(pid=74776) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4e137c3-9fa2-5b8f-84fe-4178e81a0908', '_type': 'linux-noop'}}, row=False) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0c89949-4e, may_exist=True, interface_attrs={}) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0c89949-4e, col_values=(('qos', UUID('f2f5bf1b-f97f-4a0f-ae91-bb25d53e7bba')),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0c89949-4e, col_values=(('external_ids', {'iface-id': 'f0c89949-4ef6-4b84-b494-a092990ada62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:ca:d3', 'vm-uuid': '6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0'}),), if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:00 user nova-compute[74776]: INFO os_vif [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ca:d3,bridge_name='br-int',has_traffic_filtering=True,id=f0c89949-4ef6-4b84-b494-a092990ada62,network=Network(3d853efa-c1d2-4414-a938-5c09d94f636d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0c89949-4e')
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:09:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] No VIF found with MAC fa:16:3e:8b:ca:d3, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:09:01 user nova-compute[74776]: DEBUG nova.network.neutron [req-bcf43448-592a-45b4-a8e8-71025bb432b5 req-48df0264-4530-4f8e-aaf3-df9d82ee8e98 service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updated VIF entry in instance network info cache for port f0c89949-4ef6-4b84-b494-a092990ada62. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:09:01 user nova-compute[74776]: DEBUG nova.network.neutron [req-bcf43448-592a-45b4-a8e8-71025bb432b5 req-48df0264-4530-4f8e-aaf3-df9d82ee8e98 service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updating instance_info_cache with network_info: [{"id": "f0c89949-4ef6-4b84-b494-a092990ada62", "address": "fa:16:3e:8b:ca:d3", "network": {"id": "3d853efa-c1d2-4414-a938-5c09d94f636d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-851102905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a744336c1694706a00440e12c12a1b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c89949-4e", "ovs_interfaceid": "f0c89949-4ef6-4b84-b494-a092990ada62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:09:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-bcf43448-592a-45b4-a8e8-71025bb432b5 req-48df0264-4530-4f8e-aaf3-df9d82ee8e98 service nova] Releasing lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:09:01 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:01 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:09:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:02 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-da488569-11fa-43db-9c04-745aea7940ec req-5bb43e7e-63f6-4294-8124-106f5892b254 service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Received event network-vif-plugged-f0c89949-4ef6-4b84-b494-a092990ada62 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:09:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-da488569-11fa-43db-9c04-745aea7940ec req-5bb43e7e-63f6-4294-8124-106f5892b254 service nova] Acquiring lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:09:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-da488569-11fa-43db-9c04-745aea7940ec req-5bb43e7e-63f6-4294-8124-106f5892b254 service nova] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:09:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-da488569-11fa-43db-9c04-745aea7940ec req-5bb43e7e-63f6-4294-8124-106f5892b254 service nova] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:09:02 user nova-compute[74776]: DEBUG nova.compute.manager [req-da488569-11fa-43db-9c04-745aea7940ec req-5bb43e7e-63f6-4294-8124-106f5892b254 service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] No waiting events found dispatching network-vif-plugged-f0c89949-4ef6-4b84-b494-a092990ada62 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:09:02 user nova-compute[74776]: WARNING nova.compute.manager [req-da488569-11fa-43db-9c04-745aea7940ec req-5bb43e7e-63f6-4294-8124-106f5892b254 service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Received unexpected event network-vif-plugged-f0c89949-4ef6-4b84-b494-a092990ada62 for instance with vm_state building and task_state spawning.
Nov 22 15:09:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:03 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:03 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:09:04 user nova-compute[74776]: DEBUG nova.compute.manager [req-6b9e23a1-4a86-4f42-bc9e-dec16dc71f7e req-56127f40-f947-40ae-8072-b4a41587fd02 service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Received event network-vif-plugged-f0c89949-4ef6-4b84-b494-a092990ada62 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:09:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6b9e23a1-4a86-4f42-bc9e-dec16dc71f7e req-56127f40-f947-40ae-8072-b4a41587fd02 service nova] Acquiring lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:09:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6b9e23a1-4a86-4f42-bc9e-dec16dc71f7e req-56127f40-f947-40ae-8072-b4a41587fd02 service nova] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:09:04 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-6b9e23a1-4a86-4f42-bc9e-dec16dc71f7e req-56127f40-f947-40ae-8072-b4a41587fd02 service nova] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:09:04 user nova-compute[74776]: DEBUG nova.compute.manager [req-6b9e23a1-4a86-4f42-bc9e-dec16dc71f7e req-56127f40-f947-40ae-8072-b4a41587fd02 service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] No waiting events found dispatching network-vif-plugged-f0c89949-4ef6-4b84-b494-a092990ada62 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:09:04 user nova-compute[74776]: WARNING nova.compute.manager [req-6b9e23a1-4a86-4f42-bc9e-dec16dc71f7e req-56127f40-f947-40ae-8072-b4a41587fd02 service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Received unexpected event network-vif-plugged-f0c89949-4ef6-4b84-b494-a092990ada62 for instance with vm_state building and task_state spawning.
Nov 22 15:09:05 user nova-compute[74776]: DEBUG nova.compute.manager [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Instance event wait completed in 0 seconds for  {{(pid=74776) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 22 15:09:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Guest created on hypervisor {{(pid=74776) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 22 15:09:05 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Instance spawned successfully.
Nov 22 15:09:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 22 15:09:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Found default for hw_cdrom_bus of ide {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:09:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Found default for hw_disk_bus of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:09:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Found default for hw_input_bus of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:09:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Found default for hw_pointer_model of None {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:09:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Found default for hw_video_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:09:05 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Found default for hw_vif_model of virtio {{(pid=74776) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 22 15:09:05 user nova-compute[74776]: INFO nova.compute.manager [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Took 6.88 seconds to spawn the instance on the hypervisor.
Nov 22 15:09:05 user nova-compute[74776]: DEBUG nova.compute.manager [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Checking state {{(pid=74776) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 22 15:09:05 user nova-compute[74776]: INFO nova.compute.manager [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Took 7.57 seconds to build instance.
Nov 22 15:09:05 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-252afabd-4e25-4db1-9fca-3355a952369b tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.677s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:09:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:16 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:09:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:31 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:43 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:09:46 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:09:46 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:09:46 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 15:09:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:09:46 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:09:46 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 15:09:46 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:09:47 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updating instance_info_cache with network_info: [{"id": "f0c89949-4ef6-4b84-b494-a092990ada62", "address": "fa:16:3e:8b:ca:d3", "network": {"id": "3d853efa-c1d2-4414-a938-5c09d94f636d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-851102905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a744336c1694706a00440e12c12a1b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c89949-4e", "ovs_interfaceid": "f0c89949-4ef6-4b84-b494-a092990ada62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:09:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:09:47 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 15:09:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:09:51 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:09:53 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:09:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:09:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:09:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:09:53 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:09:53 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:09:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:09:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:09:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:09:54 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:09:54 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:09:54 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8965MB free_disk=25.002647399902344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:09:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:09:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:09:54 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:09:54 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:09:54 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:09:54 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:09:54 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:09:54 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:09:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:09:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:09:55 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:09:57 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:10:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:10:00 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:10:00 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:10:00 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:10:03 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:10:04 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:10:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:10:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:10:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:10:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:10:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:10:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:10:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:10:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:10:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:10:47 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:10:47 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:10:47 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 15:10:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:10:47 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:10:47 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 15:10:47 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:10:48 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updating instance_info_cache with network_info: [{"id": "f0c89949-4ef6-4b84-b494-a092990ada62", "address": "fa:16:3e:8b:ca:d3", "network": {"id": "3d853efa-c1d2-4414-a938-5c09d94f636d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-851102905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a744336c1694706a00440e12c12a1b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c89949-4e", "ovs_interfaceid": "f0c89949-4ef6-4b84-b494-a092990ada62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:10:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:10:48 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 15:10:49 user nova-compute[74776]: DEBUG nova.compute.manager [req-9defdb16-1e0f-4282-8b6e-004ee0704240 req-b30c315e-3c71-44e7-8ccf-431c2679afd7 service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Received event network-changed-f0c89949-4ef6-4b84-b494-a092990ada62 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:10:49 user nova-compute[74776]: DEBUG nova.compute.manager [req-9defdb16-1e0f-4282-8b6e-004ee0704240 req-b30c315e-3c71-44e7-8ccf-431c2679afd7 service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Refreshing instance network info cache due to event network-changed-f0c89949-4ef6-4b84-b494-a092990ada62. {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 22 15:10:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9defdb16-1e0f-4282-8b6e-004ee0704240 req-b30c315e-3c71-44e7-8ccf-431c2679afd7 service nova] Acquiring lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:10:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9defdb16-1e0f-4282-8b6e-004ee0704240 req-b30c315e-3c71-44e7-8ccf-431c2679afd7 service nova] Acquired lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:10:49 user nova-compute[74776]: DEBUG nova.network.neutron [req-9defdb16-1e0f-4282-8b6e-004ee0704240 req-b30c315e-3c71-44e7-8ccf-431c2679afd7 service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Refreshing network info cache for port f0c89949-4ef6-4b84-b494-a092990ada62 {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 22 15:10:49 user nova-compute[74776]: DEBUG nova.network.neutron [req-9defdb16-1e0f-4282-8b6e-004ee0704240 req-b30c315e-3c71-44e7-8ccf-431c2679afd7 service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updated VIF entry in instance network info cache for port f0c89949-4ef6-4b84-b494-a092990ada62. {{(pid=74776) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 22 15:10:49 user nova-compute[74776]: DEBUG nova.network.neutron [req-9defdb16-1e0f-4282-8b6e-004ee0704240 req-b30c315e-3c71-44e7-8ccf-431c2679afd7 service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updating instance_info_cache with network_info: [{"id": "f0c89949-4ef6-4b84-b494-a092990ada62", "address": "fa:16:3e:8b:ca:d3", "network": {"id": "3d853efa-c1d2-4414-a938-5c09d94f636d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-851102905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a744336c1694706a00440e12c12a1b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c89949-4e", "ovs_interfaceid": "f0c89949-4ef6-4b84-b494-a092990ada62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:10:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-9defdb16-1e0f-4282-8b6e-004ee0704240 req-b30c315e-3c71-44e7-8ccf-431c2679afd7 service nova] Releasing lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:10:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:10:51 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:10:52 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:10:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:10:53 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:10:53 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lazy-loading 'flavor' on Instance uuid 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:10:54 user nova-compute[74776]: INFO nova.compute.manager [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Attaching volume 3999c08f-a752-4385-8194-07c320d5e634 to /dev/vdb
Nov 22 15:10:54 user nova-compute[74776]: DEBUG os_brick.utils [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabe8948-810c-4c58-8c75-148402ed0ee3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70d4c9d-a32a-41d9-8b9b-038053de57ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[438c362e-9084-496a-91d4-ffa3f337947e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be2619d-468c-41c0-8384-6320a51e770d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:10:54 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dba190-6c74-4859-91ee-510015d9e91f]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG os_brick.utils [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updating existing volume attachment record: 22b418cd-8307-4921-b489-f3953ef29a14 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:10:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:10:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:10:55 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:10:55 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:10:55 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8982MB free_disk=25.001850128173828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:10:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:10:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:10:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:10:55 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:10:55 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:10:55 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:10:55 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:10:55 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:10:55 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:10:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:10:56 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:10:56 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:10:58 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtVcLMkm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:11:00 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:11:00 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:11:00 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c54f66-a12c-4359-b813-70459ce356b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:11:00 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c0de93-6831-40d0-90b2-04b39ad46a99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634] added
Nov 22 15:11:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecdafdd-ef40-44f0-ae55-e9cff752b3ac]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[072224bd-8430-4e8a-9676-6443956afcf2]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wtVcLMkm {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wtVcLMkm" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a290f9a-e4b7-4f28-a267-efc2d2bac0f1]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wtVcLMkm'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d138e619-4f5f-471f-b677-8f3425c48688]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f166203-3959-4c31-825b-63d331ddcb6a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 15:11:00 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 15:11:00 user nova-compute[74776]:  {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:11:00 user nova-compute[74776]: WARNING os_brick.initiator.connectors.iscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 15:11:00 user nova-compute[74776]: 
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92120c1-5461-49d3-9c3a-524a4a2e3479]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634, portal: 172.16.0.220,3260]
Nov 22 15:11:00 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634, portal: 172.16.0.220,3260] successful.
Nov 22 15:11:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e278697-1b84-4efc-9cda-5097a669a92f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac1dba8-97b7-4934-b3d7-da09420192b5]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 (non-flash)
Nov 22 15:11:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 (non-flash)
Nov 22 15:11:00 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b392f3-2df8-4a6f-99e7-c9054853f706]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtVcLMkm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:11:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:11:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:11:01 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23738626465356233', 'path': '/dev/sdb'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:11:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738626465356233', 'path': '/dev/sdb'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:11:01 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lazy-loading 'flavor' on Instance uuid 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:11:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 15:11:01 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:11:01 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 15:11:01 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:11:01 user nova-compute[74776]:   <serial>3999c08f-a752-4385-8194-07c320d5e634</serial>
Nov 22 15:11:01 user nova-compute[74776]: </disk>
Nov 22 15:11:01 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 15:11:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:11:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:11:01 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] No VIF found with MAC fa:16:3e:8b:ca:d3, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:11:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d2ef5e2b-f097-4d76-9cd5-91bee82c088f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.796s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:11:02 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:11:02 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:11:02 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:11:04 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:11:04 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:11:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:11:06 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:11:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:11:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:11:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:11:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:11:16 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:11:16 user nova-compute[74776]: INFO nova.compute.manager [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Detaching volume 3999c08f-a752-4385-8194-07c320d5e634
Nov 22 15:11:16 user nova-compute[74776]: INFO nova.virt.block_device [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Attempting to driver detach volume 3999c08f-a752-4385-8194-07c320d5e634 from mountpoint /dev/vdb
Nov 22 15:11:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Attempting to detach device vdb from instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 15:11:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:11:16 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:11:16 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 15:11:16 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:11:16 user nova-compute[74776]:   <serial>3999c08f-a752-4385-8194-07c320d5e634</serial>
Nov 22 15:11:16 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:11:16 user nova-compute[74776]: </disk>
Nov 22 15:11:16 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:11:16 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Successfully detached device vdb from instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 from the persistent domain config.
Nov 22 15:11:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 15:11:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:11:16 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:11:16 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 15:11:16 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:11:16 user nova-compute[74776]:   <serial>3999c08f-a752-4385-8194-07c320d5e634</serial>
Nov 22 15:11:16 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:11:16 user nova-compute[74776]: </disk>
Nov 22 15:11:16 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:11:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:11:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 15:11:17 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:11:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:11:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:11:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:11:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:11:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:11:36 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 is timed out.
Nov 22 15:11:36 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Successfully detached device vdb from instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 from the live domain config.
Nov 22 15:11:36 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:11:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtVcLMkm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:11:36 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:11:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:11:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:11:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:36 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d098be6-2018-4f34-a571-533f7a4ebf99]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:11:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:11:36 user nova-compute[74776]: No targets found.
Nov 22 15:11:36 user nova-compute[74776]: iSNS:
Nov 22 15:11:36 user nova-compute[74776]: No targets found.
Nov 22 15:11:36 user nova-compute[74776]: STATIC:
Nov 22 15:11:36 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634
Nov 22 15:11:36 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:11:36 user nova-compute[74776]:                 Iface Name: default
Nov 22 15:11:36 user nova-compute[74776]: FIRMWARE:
Nov 22 15:11:36 user nova-compute[74776]: No targets found.
Nov 22 15:11:36 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:11:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:11:36 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:11:36 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:11:36 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:11:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:36 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e425a2-2673-474c-8a57-836ed2634c00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:11:36 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e17107-02a2-40f7-a28b-5eee3d4238c1]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 (non-flash)
Nov 22 15:11:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 (non-flash)
Nov 22 15:11:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c7820ce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634'): ({'sdb'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Removing single pathed devices sdb {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8cab61-67b4-4a1c-9855-4207dabf5e03]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5438b579-98a6-4424-9ef7-254925b66b6d]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Flushing IO for device /dev/sdb {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b3895c-5fe4-42d1-87c0-9dbe0e9ab8bb]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82526ae-02cd-4af8-96eb-4af05d046441]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[83865e6c-ea3d-479a-84b9-1091c329547c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1707caa9-9baa-43fc-aa01-2b247e1bac4a]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634, portal: 172.16.0.220,3260]
Nov 22 15:11:37 user nova-compute[74776]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634, portal: 172.16.0.220,3260] successful.
Nov 22 15:11:37 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3999c08f-a752-4385-8194-07c320d5e634 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acb0837-634d-4b30-a148-dd11cac96fdc]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] <== disconnect_volume: return (331ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:11:37 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:11:38 user nova-compute[74776]: DEBUG nova.objects.instance [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lazy-loading 'flavor' on Instance uuid 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:11:38 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-f1040b6e-ea44-43d2-b2b2-3d43a9a00651 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.744s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:11:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:11:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:11:49 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:11:49 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:11:49 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 15:11:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:11:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:11:49 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 15:11:49 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:11:50 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updating instance_info_cache with network_info: [{"id": "f0c89949-4ef6-4b84-b494-a092990ada62", "address": "fa:16:3e:8b:ca:d3", "network": {"id": "3d853efa-c1d2-4414-a938-5c09d94f636d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-851102905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a744336c1694706a00440e12c12a1b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c89949-4e", "ovs_interfaceid": "f0c89949-4ef6-4b84-b494-a092990ada62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:11:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:11:50 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 15:11:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:11:54 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:11:54 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:11:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:11:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:11:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:11:54 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:11:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:11:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:11:55 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:11:55 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:11:55 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8962MB free_disk=25.00075912475586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:11:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:11:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:11:55 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:11:55 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:11:55 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:11:55 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:11:55 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:11:55 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:11:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:11:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:11:57 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:12:00 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:12:00 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:12:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:12:02 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:12:02 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:12:04 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:12:04 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:12:05 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:12:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG nova.objects.instance [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lazy-loading 'flavor' on Instance uuid 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:12:09 user nova-compute[74776]: INFO nova.compute.manager [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Attaching volume 9614889a-0e6e-4e48-b981-e00537c352a5 to /dev/vdb
Nov 22 15:12:09 user nova-compute[74776]: DEBUG os_brick.utils [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[90397e4b-b673-4a7f-8c11-12747c5743ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f606fb6-e4db-4279-9081-ac1848125396]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[af62591b-b4af-42b1-aac1-4b5c48738145]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[978b40e0-2a2b-447f-b929-e019dcb9a686]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:12:09 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:12:09 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c6badd-cac5-4223-9abd-333e1fe1932c]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG os_brick.utils [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:12:09 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updating existing volume attachment record: 6e07c278-6284-4638-9011-35e1ee565129 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:12:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:12:11 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFZMcGhn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:12:15 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:12:15 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:12:15 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b325352-959f-43d0-80e4-f384bb424e95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:12:15 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50bc785-bc92-41b1-a487-96752a36138b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5] added
Nov 22 15:12:15 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4e7ac5-ee82-483d-93e8-d50bc0f134a6]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e279f2d4-70ae-4207-8fbf-53a6c4fe0699]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fFZMcGhn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fFZMcGhn" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a417cc0-a35d-444a-ac12-0c5652c33033]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fFZMcGhn'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd7077e-70c9-4d28-8f61-091b415d25b7]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5b8558-ce7c-4e5d-9941-82afe22cfe59]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 15:12:15 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 15:12:15 user nova-compute[74776]:  {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:12:15 user nova-compute[74776]: WARNING os_brick.initiator.connectors.iscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 15:12:15 user nova-compute[74776]: 
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[25dd1b82-d513-40dc-a967-34d3c065836c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5, portal: 172.16.0.220,3260]
Nov 22 15:12:15 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5, portal: 172.16.0.220,3260] successful.
Nov 22 15:12:15 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8116366-3459-474c-b3f0-e03bc847b179]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f53c11c-67cf-4034-b4b9-88a4fbce501e]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 (non-flash)
Nov 22 15:12:15 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 (non-flash)
Nov 22 15:12:15 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc67ec2-b33e-40d8-8882-7e0e416d9491]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:15 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:12:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:12:16 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:12:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFZMcGhn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:12:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:12:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23038303635303833', 'path': '/dev/sdb'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:12:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038303635303833', 'path': '/dev/sdb'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:12:16 user nova-compute[74776]: DEBUG nova.objects.instance [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lazy-loading 'flavor' on Instance uuid 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:12:16 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 15:12:16 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:12:16 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 15:12:16 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:12:16 user nova-compute[74776]:   <serial>9614889a-0e6e-4e48-b981-e00537c352a5</serial>
Nov 22 15:12:16 user nova-compute[74776]: </disk>
Nov 22 15:12:16 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 15:12:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:12:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:12:17 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] No VIF found with MAC fa:16:3e:8b:ca:d3, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:12:17 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-fb45ac7c-9e2d-48e2-ac20-cfdc1de67caf tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.888s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:12:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:12:19 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:12:19 user nova-compute[74776]: INFO nova.compute.manager [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Detaching volume 9614889a-0e6e-4e48-b981-e00537c352a5
Nov 22 15:12:19 user nova-compute[74776]: INFO nova.virt.block_device [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Attempting to driver detach volume 9614889a-0e6e-4e48-b981-e00537c352a5 from mountpoint /dev/vdb
Nov 22 15:12:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Attempting to detach device vdb from instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 15:12:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:12:19 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:12:19 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 15:12:19 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:12:19 user nova-compute[74776]:   <serial>9614889a-0e6e-4e48-b981-e00537c352a5</serial>
Nov 22 15:12:19 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:12:19 user nova-compute[74776]: </disk>
Nov 22 15:12:19 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:12:19 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Successfully detached device vdb from instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 from the persistent domain config.
Nov 22 15:12:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 15:12:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:12:19 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:12:19 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 15:12:19 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:12:19 user nova-compute[74776]:   <serial>9614889a-0e6e-4e48-b981-e00537c352a5</serial>
Nov 22 15:12:19 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:12:19 user nova-compute[74776]: </disk>
Nov 22 15:12:19 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:12:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 15:12:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:12:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:12:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:12:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:12:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:12:40 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 is timed out.
Nov 22 15:12:40 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Successfully detached device vdb from instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 from the live domain config.
Nov 22 15:12:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fFZMcGhn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:12:40 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:12:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f547ffb2-e01d-44e8-9049-0ed9d4459ade]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:12:40 user nova-compute[74776]: No targets found.
Nov 22 15:12:40 user nova-compute[74776]: iSNS:
Nov 22 15:12:40 user nova-compute[74776]: No targets found.
Nov 22 15:12:40 user nova-compute[74776]: STATIC:
Nov 22 15:12:40 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5
Nov 22 15:12:40 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:12:40 user nova-compute[74776]:                 Iface Name: default
Nov 22 15:12:40 user nova-compute[74776]: FIRMWARE:
Nov 22 15:12:40 user nova-compute[74776]: No targets found.
Nov 22 15:12:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:12:40 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:12:40 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e802ca-376d-42aa-b543-2de0d5ff5d79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f00e949-d358-454a-a50a-751c55e4b0b2]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 (non-flash)
Nov 22 15:12:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 (non-flash)
Nov 22 15:12:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c582771c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5'): ({'sdb'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Removing single pathed devices sdb {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35fe7cb-a2ba-452f-be5d-16e0faf42ec9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad582c26-5a57-4a2f-bbd6-f93bf17f5642]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Flushing IO for device /dev/sdb {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ffd7a5-dd8f-4980-8bb9-7376c74b8f86]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1309084-fee6-42cf-8f01-d391dce4c406]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[506a8ef2-7b07-4d2c-90fe-fed4360887d1]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dce05ea-f7c6-44ac-88dd-e9782b0e00f3]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5, portal: 172.16.0.220,3260]
Nov 22 15:12:40 user nova-compute[74776]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5, portal: 172.16.0.220,3260] successful.
Nov 22 15:12:40 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9614889a-0e6e-4e48-b981-e00537c352a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9d7eea-30ab-4154-aed8-3e4d4049d177]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] <== disconnect_volume: return (268ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:12:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:12:41 user nova-compute[74776]: DEBUG nova.objects.instance [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lazy-loading 'flavor' on Instance uuid 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:12:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-39c66d90-606d-4528-aeac-8ee50a8a6b1e tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.602s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:12:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:12:49 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:12:49 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:12:49 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 15:12:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:12:49 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:12:49 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 15:12:49 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:12:50 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updating instance_info_cache with network_info: [{"id": "f0c89949-4ef6-4b84-b494-a092990ada62", "address": "fa:16:3e:8b:ca:d3", "network": {"id": "3d853efa-c1d2-4414-a938-5c09d94f636d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-851102905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a744336c1694706a00440e12c12a1b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c89949-4e", "ovs_interfaceid": "f0c89949-4ef6-4b84-b494-a092990ada62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:12:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:12:50 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 15:12:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:12:54 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:12:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:12:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:12:54 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:12:54 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:12:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:54 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:12:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:12:55 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:12:55 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:12:55 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8968MB free_disk=24.99974822998047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:12:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:12:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:12:55 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:12:55 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:12:55 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:12:55 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing inventories for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 15:12:55 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating ProviderTree inventory for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 15:12:55 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating inventory in ProviderTree for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 15:12:55 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing aggregate associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, aggregates: None {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 15:12:55 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing trait associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 15:12:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:12:55 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:12:55 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:12:55 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:12:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.281s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:12:56 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:12:57 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:13:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:13:01 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:13:03 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:13:03 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:13:04 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:13:05 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:13:05 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:13:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:13:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:13:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 15:13:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:13:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:13:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:13:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG nova.objects.instance [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lazy-loading 'flavor' on Instance uuid 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:13:13 user nova-compute[74776]: INFO nova.compute.manager [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Attaching volume 821fb1d9-4900-4e6e-90ab-ab448ffb8221 to /dev/vdb
Nov 22 15:13:13 user nova-compute[74776]: DEBUG os_brick.utils [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a522d3-f534-45ea-899a-cbc271c2003f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcee79b6-fb31-43f4-ae79-0c604f49dba6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f46cf2-2821-492f-8b15-58122f9ceda9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fc7783-1477-4790-85cb-41b773147885]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:13:13 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:13:13 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[48049a25-cd0e-45b4-847c-8fa67f0688e5]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG os_brick.utils [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:13:13 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updating existing volume attachment record: 3f1757d5-34e1-4bec-99a7-ea772d6257e7 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:13:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:13:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TbhnLaHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:13:19 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:13:19 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:13:19 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6321b7d-bb13-4cd0-a050-aa9be21464d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:13:19 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3d19bd-7fe2-483e-8902-bd2f66d1f5af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221] added
Nov 22 15:13:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47a0e66-aa5b-47c6-be60-9f95cf57538d]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[62aa4f2a-94c9-4218-a414-4b2de7ca72da]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TbhnLaHg {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TbhnLaHg" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0b6752-768f-4f17-bc91-6992d974ebad]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TbhnLaHg'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1546c3af-51a5-43fb-a47a-044c3f703644]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b466d3-4cf3-42bd-9234-c51a1ffd0a96]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 15:13:19 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 15:13:19 user nova-compute[74776]:  {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:13:19 user nova-compute[74776]: WARNING os_brick.initiator.connectors.iscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 15:13:19 user nova-compute[74776]: 
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae022e4-6c25-49c2-ab93-e7db6499fbc1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221, portal: 172.16.0.220,3260]
Nov 22 15:13:19 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221, portal: 172.16.0.220,3260] successful.
Nov 22 15:13:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dff028-2b3f-49ed-88a7-e908a2483e62]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fdbf79-3397-487d-9943-733f2553efcb]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 (non-flash)
Nov 22 15:13:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 (non-flash)
Nov 22 15:13:19 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb01b31-1afd-4665-a636-ff8f26e6040a]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:13:19 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:13:20 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:13:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TbhnLaHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:13:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:13:20 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26335653339386265', 'path': '/dev/sdb'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:13:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335653339386265', 'path': '/dev/sdb'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:13:20 user nova-compute[74776]: DEBUG nova.objects.instance [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lazy-loading 'flavor' on Instance uuid 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:13:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 15:13:20 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:13:20 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 15:13:20 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:13:20 user nova-compute[74776]:   <serial>821fb1d9-4900-4e6e-90ab-ab448ffb8221</serial>
Nov 22 15:13:20 user nova-compute[74776]: </disk>
Nov 22 15:13:20 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 15:13:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:13:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:13:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:13:20 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] No VIF found with MAC fa:16:3e:8b:ca:d3, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:13:20 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-44c48e1e-5968-413b-b597-dac7d1ece4ed tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.721s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:13:21 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:13:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:13:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:13:23 user nova-compute[74776]: INFO nova.compute.manager [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Detaching volume 821fb1d9-4900-4e6e-90ab-ab448ffb8221
Nov 22 15:13:23 user nova-compute[74776]: INFO nova.virt.block_device [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Attempting to driver detach volume 821fb1d9-4900-4e6e-90ab-ab448ffb8221 from mountpoint /dev/vdb
Nov 22 15:13:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Attempting to detach device vdb from instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 15:13:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:13:23 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:13:23 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 15:13:23 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:13:23 user nova-compute[74776]:   <serial>821fb1d9-4900-4e6e-90ab-ab448ffb8221</serial>
Nov 22 15:13:23 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:13:23 user nova-compute[74776]: </disk>
Nov 22 15:13:23 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:13:23 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Successfully detached device vdb from instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 from the persistent domain config.
Nov 22 15:13:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 15:13:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:13:23 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:13:23 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 15:13:23 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:13:23 user nova-compute[74776]:   <serial>821fb1d9-4900-4e6e-90ab-ab448ffb8221</serial>
Nov 22 15:13:23 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:13:23 user nova-compute[74776]: </disk>
Nov 22 15:13:23 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:13:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 15:13:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:13:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:13:26 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:13:26 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 22 15:13:26 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] There are 0 instances to clean {{(pid=74776) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 22 15:13:30 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:13:30 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74776) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 22 15:13:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:13:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:13:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:13:43 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 is timed out.
Nov 22 15:13:43 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Successfully detached device vdb from instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 from the live domain config.
Nov 22 15:13:43 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:13:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TbhnLaHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:13:43 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:13:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:13:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:13:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaddc48-b4a7-42d0-85f7-33feafa3cfc9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:13:43 user nova-compute[74776]: No targets found.
Nov 22 15:13:43 user nova-compute[74776]: iSNS:
Nov 22 15:13:43 user nova-compute[74776]: No targets found.
Nov 22 15:13:43 user nova-compute[74776]: STATIC:
Nov 22 15:13:43 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221
Nov 22 15:13:43 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:13:43 user nova-compute[74776]:                 Iface Name: default
Nov 22 15:13:43 user nova-compute[74776]: FIRMWARE:
Nov 22 15:13:43 user nova-compute[74776]: No targets found.
Nov 22 15:13:43 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:13:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:13:43 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:13:43 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:13:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:13:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86ddd38-10cf-4fff-b2b3-2b391ad14e75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:43 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:43 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[822731b3-ffb3-47f8-bfea-943ca4a1cff9]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 (non-flash)
Nov 22 15:13:43 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:13:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 (non-flash)
Nov 22 15:13:43 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:13:43 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c58277be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221'): ({'sdb'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:13:43 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Removing single pathed devices sdb {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c28a6c3-44e6-4012-861e-a1cbe28fc904]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[596a00e9-f99b-4fbe-8ff9-edcef70aeefc]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Flushing IO for device /dev/sdb {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[37326dec-097b-4659-a70b-2b820736808f]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[78450904-f40b-4cdb-8e17-e1d557d65ef0]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[954cf342-06ea-4b1e-b6d2-a029f9219f7c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bcaa8f-e8fc-4418-988d-2b0a85621486]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221, portal: 172.16.0.220,3260]
Nov 22 15:13:44 user nova-compute[74776]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221, portal: 172.16.0.220,3260] successful.
Nov 22 15:13:44 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:821fb1d9-4900-4e6e-90ab-ab448ffb8221 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0584c5da-3d2e-45db-b7df-e9f65dd7788d]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] <== disconnect_volume: return (277ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG nova.objects.instance [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lazy-loading 'flavor' on Instance uuid 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:13:44 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-3db4c4b4-474e-4495-9500-3c66da1bf326 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.594s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:13:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:13:50 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:13:50 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:13:50 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 15:13:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:13:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:13:50 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:13:50 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 15:13:50 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:13:51 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updating instance_info_cache with network_info: [{"id": "f0c89949-4ef6-4b84-b494-a092990ada62", "address": "fa:16:3e:8b:ca:d3", "network": {"id": "3d853efa-c1d2-4414-a938-5c09d94f636d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-851102905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a744336c1694706a00440e12c12a1b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c89949-4e", "ovs_interfaceid": "f0c89949-4ef6-4b84-b494-a092990ada62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:13:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:13:51 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 15:13:55 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:13:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:13:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:13:55 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:13:55 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:13:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:13:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:55 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:13:56 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:13:56 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:13:56 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:13:56 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8948MB free_disk=24.99874496459961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:13:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:13:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:13:56 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:13:56 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:13:56 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:13:56 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:13:56 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:13:56 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:13:56 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:13:57 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:13:58 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:14:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:14:01 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:14:05 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:14:05 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:14:05 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:14:05 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:14:05 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:14:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:14:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:14:15 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:14:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:14:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:14:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:14:15 user nova-compute[74776]: DEBUG nova.objects.instance [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lazy-loading 'flavor' on Instance uuid 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:14:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:14:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:14:15 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:14:15 user nova-compute[74776]: INFO nova.compute.manager [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Attaching volume 26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f to /dev/vdb
Nov 22 15:14:16 user nova-compute[74776]: DEBUG os_brick.utils [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:14:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[8327135f-f868-48cd-9b3a-d8a83c4edb15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c655646325b\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[905205d9-cb20-4632-ac3a-1f7e6f1e9d22]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e878fdf-9e5e-4ab5-a0bf-44938f7dd707]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e95fc6-3da9-4acb-aea5-0104c12ef3c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Running cmd (subprocess): nvme version {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] 'nvme version' failed. Not Retrying. {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:14:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] nvme not present on system {{(pid=74776) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 22 15:14:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:16 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 22 15:14:16 user nova-compute[74776]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 22 15:14:16 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[254688c2-51c4-4f79-bcd9-a19efa9eaef7]: (4, '') {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74776) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 22 15:14:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 22 15:14:16 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.lightos [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] LIGHTOS: no hostnqn found. {{(pid=74776) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 22 15:14:16 user nova-compute[74776]: DEBUG os_brick.utils [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c655646325b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:14:16 user nova-compute[74776]: DEBUG nova.virt.block_device [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updating existing volume attachment record: 8d158076-6632-49aa-9218-7f5f35137195 {{(pid=74776) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 22 15:14:16 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:14:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:14:21 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:14:21 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Calling os-brick to attach iSCSI Volume {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 22 15:14:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItzMGRkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:14:21 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:14:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:14:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:14:21 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:14:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:14:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:14:21 user nova-compute[74776]: INFO os_brick.initiator.connectors.iscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 22 15:14:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e2aba2-d10e-41ea-aa79-aaa3ec5e3e15]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 22 15:14:21 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:14:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260 --interface default --op new {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:21 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[743e407b-db16-4c98-898a-2331deef7551]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f] added\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:21 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f] added
Nov 22 15:14:21 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:14:21 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f763802-a866-491b-ae17-219e230f3b9c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d90f0f-131a-4af7-ade4-1222e9bd5290]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ItzMGRkF {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ItzMGRkF" returned: 0 in 0.027s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[381e7314-2c38-489d-9268-19c3b22445cd]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ItzMGRkF'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e1a4ca-2dda-4241-add1-9db593559326]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e38799-1319-4185-a0eb-fffe630ad2ef]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 22 15:14:22 user nova-compute[74776]:  {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 22 15:14:22 user nova-compute[74776]:  {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:14:22 user nova-compute[74776]: WARNING os_brick.initiator.connectors.iscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 22 15:14:22 user nova-compute[74776]: 
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260 --login {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c78ba59-b80b-4aca-8233-8db7059a782b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f, portal: 172.16.0.220,3260]
Nov 22 15:14:22 user nova-compute[74776]: Login to [iface: default, target: iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f, portal: 172.16.0.220,3260] successful.
Nov 22 15:14:22 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.051s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[677c16dd-22cc-4461-9166-246f8e93b7e9]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc953273-3c87-40df-b9a5-68c1f2360458]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f (non-flash)
Nov 22 15:14:22 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f (non-flash)
Nov 22 15:14:22 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Connected to 172.16.0.220:3260 {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=74776) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74776) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fe91c4-2c7c-409a-8ee7-aa06784cbc41]: (4, ('- - 0', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:22 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:14:23 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74776) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 22 15:14:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItzMGRkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74776) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 22 15:14:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:14:23 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26162663131383639', 'path': '/dev/sdb'} {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:14:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162663131383639', 'path': '/dev/sdb'} {{(pid=74776) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 22 15:14:23 user nova-compute[74776]: DEBUG nova.objects.instance [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lazy-loading 'flavor' on Instance uuid 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:14:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] attach device xml: <disk type="block" device="disk">
Nov 22 15:14:23 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:14:23 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 15:14:23 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:14:23 user nova-compute[74776]:   <serial>26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f</serial>
Nov 22 15:14:23 user nova-compute[74776]: </disk>
Nov 22 15:14:23 user nova-compute[74776]:  {{(pid=74776) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 22 15:14:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] No BDM found with device name vda, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:14:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74776) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 22 15:14:23 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] No VIF found with MAC fa:16:3e:8b:ca:d3, not building metadata {{(pid=74776) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 22 15:14:23 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-a0a28353-7923-4493-a7c1-24f29332eadd tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.880s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:14:25 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:14:25 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Triggering sync for uuid 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 22 15:14:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:14:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:14:25 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:14:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:14:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:14:26 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:14:26 user nova-compute[74776]: INFO nova.compute.manager [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Detaching volume 26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f
Nov 22 15:14:26 user nova-compute[74776]: INFO nova.virt.block_device [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Attempting to driver detach volume 26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f from mountpoint /dev/vdb
Nov 22 15:14:26 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Attempting to detach device vdb from instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 from the persistent domain config. {{(pid=74776) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 22 15:14:26 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:14:26 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:14:26 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 15:14:26 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:14:26 user nova-compute[74776]:   <serial>26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f</serial>
Nov 22 15:14:26 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:14:26 user nova-compute[74776]: </disk>
Nov 22 15:14:26 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:14:26 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Successfully detached device vdb from instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 from the persistent domain config.
Nov 22 15:14:26 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 from the live domain config. {{(pid=74776) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 22 15:14:26 user nova-compute[74776]: DEBUG nova.virt.libvirt.guest [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] detach device xml: <disk type="block" device="disk">
Nov 22 15:14:26 user nova-compute[74776]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 22 15:14:26 user nova-compute[74776]:   <source dev="/dev/sdb"/>
Nov 22 15:14:26 user nova-compute[74776]:   <target dev="vdb" bus="virtio"/>
Nov 22 15:14:26 user nova-compute[74776]:   <serial>26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f</serial>
Nov 22 15:14:26 user nova-compute[74776]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 22 15:14:26 user nova-compute[74776]: </disk>
Nov 22 15:14:26 user nova-compute[74776]:  {{(pid=74776) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 22 15:14:26 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:14:26 user nova-compute[74776]: DEBUG nova.virt.libvirt.driver [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 22 15:14:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:14:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:14:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:14:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:14:46 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 is timed out.
Nov 22 15:14:46 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Successfully detached device vdb from instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 from the live domain config.
Nov 22 15:14:46 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] calling os-brick to detach iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1c78077d90>, {'target_iqn': 'iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItzMGRkF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 22 15:14:46 user nova-compute[74776]: WARNING os_brick.initiator.connectors.base [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 22 15:14:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[14182f76-8c55-4893-a13e-0bf27093fd47]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 22 15:14:46 user nova-compute[74776]: No targets found.
Nov 22 15:14:46 user nova-compute[74776]: iSNS:
Nov 22 15:14:46 user nova-compute[74776]: No targets found.
Nov 22 15:14:46 user nova-compute[74776]: STATIC:
Nov 22 15:14:46 user nova-compute[74776]: Target: iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f
Nov 22 15:14:46 user nova-compute[74776]:         Portal: 172.16.0.220:3260,-1
Nov 22 15:14:46 user nova-compute[74776]:                 Iface Name: default
Nov 22 15:14:46 user nova-compute[74776]: FIRMWARE:
Nov 22 15:14:46 user nova-compute[74776]: No targets found.
Nov 22 15:14:46 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 22 15:14:46 user nova-compute[74776]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 22 15:14:46 user nova-compute[74776]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74776) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f', 0)] {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a50bddc-3e48-4c00-bf43-f09a605228fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01f4003-c86f-4591-bdbe-cd3e5279afe2]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f (non-flash)\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f (non-flash)
Nov 22 15:14:46 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f (non-flash)
Nov 22 15:14:46 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1c7820fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f'): ({'sdb'}, set())}) {{(pid=74776) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Removing single pathed devices sdb {{(pid=74776) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[42287579-5b48-4193-b4f0-9a4bc5b179bf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[035a302c-3c89-4298-99c0-2ac7624e064f]: (4, ('ok\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Flushing IO for device /dev/sdb {{(pid=74776) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4297622-d878-4df3-a8ed-c32b8281d69c]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74776) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 22 15:14:46 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:47 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[037999fd-e9dc-4ebd-b9db-0d4c21750321]: (4, ('1', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:47 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 22 15:14:47 user nova-compute[74776]: DEBUG os_brick.initiator.linuxscsi [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] SCSI volumes sdb have been removed. {{(pid=74776) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 22 15:14:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f')] {{(pid=74776) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 22 15:14:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:47 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6707145-c239-4270-a8d2-21f209a4c840]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:14:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260 --logout {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:47 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[14600f88-51a1-4b10-9842-496ba0b2004f]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f, portal: 172.16.0.220,3260]
Nov 22 15:14:47 user nova-compute[74776]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f, portal: 172.16.0.220,3260] successful.
Nov 22 15:14:47 user nova-compute[74776]:  stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:14:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260 --op delete {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:47 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26ebc08f-9ecc-477b-a0ad-a9e72d5a6f2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85789) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:47 user nova-compute[74776]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac4f083-b989-4673-8ed8-195965b67372]: (4, ('', '')) {{(pid=85789) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 22 15:14:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74776) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 22 15:14:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.base [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 22 15:14:47 user nova-compute[74776]: DEBUG os_brick.initiator.connectors.iscsi [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] <== disconnect_volume: return (292ms) None {{(pid=74776) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 22 15:14:47 user nova-compute[74776]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Disconnected iSCSI Volume {{(pid=74776) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 22 15:14:47 user nova-compute[74776]: DEBUG nova.objects.instance [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lazy-loading 'flavor' on Instance uuid 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:14:48 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-d645261c-b8b7-4617-8fb5-857be164110f tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.872s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:14:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:14:51 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:14:51 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:14:51 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 15:14:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 22 15:14:51 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquired lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 22 15:14:51 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Forcefully refreshing network info cache for instance {{(pid=74776) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 22 15:14:51 user nova-compute[74776]: DEBUG nova.objects.instance [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lazy-loading 'info_cache' on Instance uuid 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:14:52 user nova-compute[74776]: DEBUG nova.network.neutron [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updating instance_info_cache with network_info: [{"id": "f0c89949-4ef6-4b84-b494-a092990ada62", "address": "fa:16:3e:8b:ca:d3", "network": {"id": "3d853efa-c1d2-4414-a938-5c09d94f636d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-851102905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a744336c1694706a00440e12c12a1b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c89949-4e", "ovs_interfaceid": "f0c89949-4ef6-4b84-b494-a092990ada62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:14:52 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Releasing lock "refresh_cache-6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" {{(pid=74776) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 22 15:14:52 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updated the network info_cache for instance {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 22 15:14:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:14:57 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:14:57 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:14:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:14:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:14:57 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:14:57 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:14:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:57 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 22 15:14:58 user nova-compute[74776]: DEBUG oslo_concurrency.processutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74776) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 22 15:14:58 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:14:58 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:14:58 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=8970MB free_disk=24.99777603149414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:14:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:14:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:14:58 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74776) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 22 15:14:58 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:14:58 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:14:58 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:14:58 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:14:58 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:14:58 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:14:59 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:15:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:15:03 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:15:05 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:15:05 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:15:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:15:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:15:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 15:15:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:15:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:15:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:15:06 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:15:07 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:15:07 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:15:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:15:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:15:20 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:15:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:15:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:15:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:15:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:15:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:15:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:15:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:15:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:15:39 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:15:39 user nova-compute[74776]: INFO nova.compute.manager [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Terminating instance
Nov 22 15:15:39 user nova-compute[74776]: DEBUG nova.compute.manager [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Start destroying the instance on the hypervisor. {{(pid=74776) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 22 15:15:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:15:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:15:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:15:39 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:15:40 user nova-compute[74776]: DEBUG nova.compute.manager [req-2e61e19e-d725-49c0-b938-475429261452 req-5efcb0b8-33dd-4a27-8274-b0726eb74e7e service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Received event network-vif-unplugged-f0c89949-4ef6-4b84-b494-a092990ada62 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:15:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2e61e19e-d725-49c0-b938-475429261452 req-5efcb0b8-33dd-4a27-8274-b0726eb74e7e service nova] Acquiring lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:15:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2e61e19e-d725-49c0-b938-475429261452 req-5efcb0b8-33dd-4a27-8274-b0726eb74e7e service nova] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:15:40 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-2e61e19e-d725-49c0-b938-475429261452 req-5efcb0b8-33dd-4a27-8274-b0726eb74e7e service nova] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:15:40 user nova-compute[74776]: DEBUG nova.compute.manager [req-2e61e19e-d725-49c0-b938-475429261452 req-5efcb0b8-33dd-4a27-8274-b0726eb74e7e service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] No waiting events found dispatching network-vif-unplugged-f0c89949-4ef6-4b84-b494-a092990ada62 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:15:40 user nova-compute[74776]: DEBUG nova.compute.manager [req-2e61e19e-d725-49c0-b938-475429261452 req-5efcb0b8-33dd-4a27-8274-b0726eb74e7e service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Received event network-vif-unplugged-f0c89949-4ef6-4b84-b494-a092990ada62 for instance with task_state deleting. {{(pid=74776) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 22 15:15:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:15:40 user nova-compute[74776]: INFO nova.virt.libvirt.driver [-] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Instance destroyed successfully.
Nov 22 15:15:40 user nova-compute[74776]: DEBUG nova.objects.instance [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lazy-loading 'resources' on Instance uuid 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0 {{(pid=74776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 22 15:15:40 user nova-compute[74776]: DEBUG nova.virt.libvirt.vif [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-22T15:08:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1801406545',display_name='tempest-SnapshotDataIntegrityTests-server-1801406545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1801406545',id=53,image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4C4PmcF62GI3FDqhtkLrEZGFr5qarA/2UPJIXybtacoYlGK1An4YOTnUyff7d1wHSQCLMrwgvp2dngH68h+Zo0ErDmHX1HVUn9STd8sgp2CdkRAAob22yUXG0k+whI7A==',key_name='tempest-keypair-1219866838',keypairs=<?>,launch_index=0,launched_at=2023-11-22T15:09:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a744336c1694706a00440e12c12a1b8',ramdisk_id='',reservation_id='r-ew8bc7qc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ee204558-2a75-42f8-8c03-3c76a3916fa5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-731080679',owner_user_name='tempest-SnapshotDataIntegrityTests-731080679-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-22T15:09:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8ddd6924f84a66badc00566254193d',uuid=6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0c89949-4ef6-4b84-b494-a092990ada62", "address": "fa:16:3e:8b:ca:d3", "network": {"id": "3d853efa-c1d2-4414-a938-5c09d94f636d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-851102905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a744336c1694706a00440e12c12a1b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c89949-4e", "ovs_interfaceid": "f0c89949-4ef6-4b84-b494-a092990ada62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 22 15:15:40 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Converting VIF {"id": "f0c89949-4ef6-4b84-b494-a092990ada62", "address": "fa:16:3e:8b:ca:d3", "network": {"id": "3d853efa-c1d2-4414-a938-5c09d94f636d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-851102905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a744336c1694706a00440e12c12a1b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0c89949-4e", "ovs_interfaceid": "f0c89949-4ef6-4b84-b494-a092990ada62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 22 15:15:40 user nova-compute[74776]: DEBUG nova.network.os_vif_util [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:ca:d3,bridge_name='br-int',has_traffic_filtering=True,id=f0c89949-4ef6-4b84-b494-a092990ada62,network=Network(3d853efa-c1d2-4414-a938-5c09d94f636d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0c89949-4e') {{(pid=74776) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 22 15:15:40 user nova-compute[74776]: DEBUG os_vif [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:ca:d3,bridge_name='br-int',has_traffic_filtering=True,id=f0c89949-4ef6-4b84-b494-a092990ada62,network=Network(3d853efa-c1d2-4414-a938-5c09d94f636d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0c89949-4e') {{(pid=74776) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 22 15:15:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:15:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0c89949-4e, bridge=br-int, if_exists=True) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:15:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:15:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:15:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:15:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2f5bf1b-f97f-4a0f-ae91-bb25d53e7bba) {{(pid=74776) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 22 15:15:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:15:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:15:40 user nova-compute[74776]: INFO os_vif [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:ca:d3,bridge_name='br-int',has_traffic_filtering=True,id=f0c89949-4ef6-4b84-b494-a092990ada62,network=Network(3d853efa-c1d2-4414-a938-5c09d94f636d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0c89949-4e')
Nov 22 15:15:40 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Deleting instance files /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0_del
Nov 22 15:15:40 user nova-compute[74776]: INFO nova.virt.libvirt.driver [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Deletion of /opt/stack/data/nova/instances/6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0_del complete
Nov 22 15:15:40 user nova-compute[74776]: INFO nova.compute.manager [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 22 15:15:40 user nova-compute[74776]: DEBUG oslo.service.loopingcall [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74776) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 22 15:15:40 user nova-compute[74776]: DEBUG nova.compute.manager [-] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Deallocating network for instance {{(pid=74776) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 22 15:15:40 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] deallocate_for_instance() {{(pid=74776) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 22 15:15:41 user nova-compute[74776]: DEBUG nova.network.neutron [-] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Updating instance_info_cache with network_info: [] {{(pid=74776) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 22 15:15:41 user nova-compute[74776]: INFO nova.compute.manager [-] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Took 0.87 seconds to deallocate network for instance.
Nov 22 15:15:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:15:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:15:41 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:15:41 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:15:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:15:41 user nova-compute[74776]: INFO nova.scheduler.client.report [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Deleted allocations for instance 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0
Nov 22 15:15:41 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-6210c846-6add-402b-aa39-f0ab3b74e927 tempest-SnapshotDataIntegrityTests-731080679 tempest-SnapshotDataIntegrityTests-731080679-project-member] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.079s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:15:42 user nova-compute[74776]: DEBUG nova.compute.manager [req-713d86b9-30ea-42bd-8b4c-be36755359ad req-dab8ef7e-e88d-4b8c-be0f-670fbb049ee7 service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Received event network-vif-plugged-f0c89949-4ef6-4b84-b494-a092990ada62 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:15:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-713d86b9-30ea-42bd-8b4c-be36755359ad req-dab8ef7e-e88d-4b8c-be0f-670fbb049ee7 service nova] Acquiring lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:15:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-713d86b9-30ea-42bd-8b4c-be36755359ad req-dab8ef7e-e88d-4b8c-be0f-670fbb049ee7 service nova] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:15:42 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [req-713d86b9-30ea-42bd-8b4c-be36755359ad req-dab8ef7e-e88d-4b8c-be0f-670fbb049ee7 service nova] Lock "6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:15:42 user nova-compute[74776]: DEBUG nova.compute.manager [req-713d86b9-30ea-42bd-8b4c-be36755359ad req-dab8ef7e-e88d-4b8c-be0f-670fbb049ee7 service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] No waiting events found dispatching network-vif-plugged-f0c89949-4ef6-4b84-b494-a092990ada62 {{(pid=74776) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 22 15:15:42 user nova-compute[74776]: WARNING nova.compute.manager [req-713d86b9-30ea-42bd-8b4c-be36755359ad req-dab8ef7e-e88d-4b8c-be0f-670fbb049ee7 service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Received unexpected event network-vif-plugged-f0c89949-4ef6-4b84-b494-a092990ada62 for instance with vm_state deleted and task_state None.
Nov 22 15:15:42 user nova-compute[74776]: DEBUG nova.compute.manager [req-713d86b9-30ea-42bd-8b4c-be36755359ad req-dab8ef7e-e88d-4b8c-be0f-670fbb049ee7 service nova] [instance: 6d28bba4-5ae2-44fb-83f0-d4ab8580f6d0] Received event network-vif-deleted-f0c89949-4ef6-4b84-b494-a092990ada62 {{(pid=74776) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 22 15:15:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:15:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:15:52 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:15:52 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:15:52 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 15:15:52 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Didn't find any instances for network info cache update. {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 15:15:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:15:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:15:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 15:15:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:15:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:15:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:15:57 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:15:59 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:15:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:15:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:15:59 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:15:59 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:16:00 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:16:00 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:16:00 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=9111MB free_disk=25.024883270263672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:16:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:16:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:16:00 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:16:00 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:16:00 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:16:00 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:16:00 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:16:00 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:16:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:16:01 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:16:03 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:16:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:16:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:16:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 15:16:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:16:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:16:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:16:06 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:16:06 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:16:07 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:16:08 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:16:09 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:16:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:16:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:16:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 15:16:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:16:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:16:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:16:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:16:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:16:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:16:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 15:16:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:16:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:16:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:16:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:16:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:16:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:16:33 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:16:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:16:36 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:16:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:16:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:16:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:16:52 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:16:52 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:16:52 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 15:16:52 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Didn't find any instances for network info cache update. {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 15:16:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:16:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:16:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74776) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 22 15:16:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:16:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74776) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 22 15:16:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:16:57 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:17:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:17:00 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:17:01 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:17:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:17:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:17:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:17:01 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:17:02 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:17:02 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:17:02 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=9241MB free_disk=24.94336700439453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:17:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:17:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:17:02 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:17:02 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:17:02 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:17:02 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:17:02 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:17:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:17:05 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:17:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:17:07 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:17:07 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:17:08 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:17:08 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:17:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:17:11 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:17:15 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:17:20 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:17:21 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:17:25 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:17:30 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:17:35 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:17:40 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:17:45 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:17:50 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:17:53 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:17:53 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Starting heal instance info cache {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 22 15:17:53 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Rebuilding the list of instances to heal {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 22 15:17:53 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Didn't find any instances for network info cache update. {{(pid=74776) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 22 15:17:55 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 22 15:17:57 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:18:00 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:18:00 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:18:01 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:18:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:18:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:18:01 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:18:01 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Auditing locally available compute resources for user (node: user) {{(pid=74776) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 22 15:18:02 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:18:02 user nova-compute[74776]: WARNING nova.virt.libvirt.driver [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 22 15:18:02 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Hypervisor/Node resource view: name=user free_ram=9268MB free_disk=25.016311645507812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74776) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 22 15:18:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 22 15:18:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 22 15:18:02 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 22 15:18:02 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74776) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 22 15:18:02 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing inventories for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 22 15:18:02 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating ProviderTree inventory for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 22 15:18:02 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Updating inventory in ProviderTree for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 22 15:18:02 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing aggregate associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, aggregates: None {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 22 15:18:02 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Refreshing trait associations for resource provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a, traits: COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=74776) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 22 15:18:02 user nova-compute[74776]: DEBUG nova.compute.provider_tree [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed in ProviderTree for provider: b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a {{(pid=74776) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 22 15:18:02 user nova-compute[74776]: DEBUG nova.scheduler.client.report [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Inventory has not changed for provider b8db2995-40f1-4f7e-b0f4-1a4ae9ef985a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74776) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 22 15:18:02 user nova-compute[74776]: DEBUG nova.compute.resource_tracker [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Compute_service record updated for user:user {{(pid=74776) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 22 15:18:02 user nova-compute[74776]: DEBUG oslo_concurrency.lockutils [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=74776) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 22 15:18:05 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 22 15:18:07 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:18:08 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:18:08 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:18:09 user nova-compute[74776]: DEBUG oslo_service.periodic_task [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74776) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 22 15:18:09 user nova-compute[74776]: DEBUG nova.compute.manager [None req-7b387b79-4dbe-4bb5-a7fa-ae8d64b19e61 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74776) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 22 15:18:10 user nova-compute[74776]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74776) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}